00:00:00.002 Started by upstream project "autotest-spdk-master-vs-dpdk-main" build number 3390 00:00:00.002 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3001 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.053 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.053 The recommended git tool is: git 00:00:00.053 using credential 00000000-0000-0000-0000-000000000002 00:00:00.055 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.079 Fetching changes from the remote Git repository 00:00:00.080 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.116 Using shallow fetch with depth 1 00:00:00.116 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.116 > git --version # timeout=10 00:00:00.152 > git --version # 'git version 2.39.2' 00:00:00.152 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.153 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.153 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.441 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.454 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.465 Checking out Revision 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 (FETCH_HEAD) 00:00:02.465 > git config core.sparsecheckout # timeout=10 00:00:02.475 > git read-tree -mu HEAD # timeout=10 00:00:02.490 > git checkout -f 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 # timeout=5 00:00:02.505 Commit message: "perf/upload_to_db: update columns after changes in get_results.sh" 00:00:02.505 > git rev-list --no-walk 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 # timeout=10 00:00:02.638 [Pipeline] Start of Pipeline 00:00:02.655 [Pipeline] library 00:00:02.656 Loading library shm_lib@master 00:00:02.656 Library shm_lib@master is cached. Copying from home. 00:00:02.673 [Pipeline] node 00:00:02.680 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:02.682 [Pipeline] { 00:00:02.689 [Pipeline] catchError 00:00:02.690 [Pipeline] { 00:00:02.699 [Pipeline] wrap 00:00:02.707 [Pipeline] { 00:00:02.712 [Pipeline] stage 00:00:02.713 [Pipeline] { (Prologue) 00:00:02.853 [Pipeline] sh 00:00:03.135 + logger -p user.info -t JENKINS-CI 00:00:03.152 [Pipeline] echo 00:00:03.154 Node: GP11 00:00:03.161 [Pipeline] sh 00:00:03.458 [Pipeline] setCustomBuildProperty 00:00:03.467 [Pipeline] echo 00:00:03.468 Cleanup processes 00:00:03.471 [Pipeline] sh 00:00:03.760 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:03.760 2160566 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:03.775 [Pipeline] sh 00:00:04.064 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:04.064 ++ grep -v 'sudo pgrep' 00:00:04.064 ++ awk '{print $1}' 00:00:04.064 + sudo kill -9 00:00:04.064 + true 00:00:04.077 [Pipeline] cleanWs 00:00:04.085 [WS-CLEANUP] Deleting project workspace... 00:00:04.085 [WS-CLEANUP] Deferred wipeout is used... 00:00:04.092 [WS-CLEANUP] done 00:00:04.095 [Pipeline] setCustomBuildProperty 00:00:04.109 [Pipeline] sh 00:00:04.393 + sudo git config --global --replace-all safe.directory '*' 00:00:04.457 [Pipeline] nodesByLabel 00:00:04.458 Found a total of 1 nodes with the 'sorcerer' label 00:00:04.465 [Pipeline] httpRequest 00:00:04.469 HttpMethod: GET 00:00:04.470 URL: http://10.211.164.101/packages/jbp_3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338.tar.gz 00:00:04.477 Sending request to url: http://10.211.164.101/packages/jbp_3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338.tar.gz 00:00:04.485 Response Code: HTTP/1.1 200 OK 00:00:04.485 Success: Status code 200 is in the accepted range: 200,404 00:00:04.486 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338.tar.gz 00:00:06.186 [Pipeline] sh 00:00:06.470 + tar --no-same-owner -xf jbp_3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338.tar.gz 00:00:06.489 [Pipeline] httpRequest 00:00:06.494 HttpMethod: GET 00:00:06.495 URL: http://10.211.164.101/packages/spdk_a1264177cd264beaac27476984a68dceee651050.tar.gz 00:00:06.496 Sending request to url: http://10.211.164.101/packages/spdk_a1264177cd264beaac27476984a68dceee651050.tar.gz 00:00:06.519 Response Code: HTTP/1.1 200 OK 00:00:06.519 Success: Status code 200 is in the accepted range: 200,404 00:00:06.520 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_a1264177cd264beaac27476984a68dceee651050.tar.gz 00:00:41.636 [Pipeline] sh 00:00:41.926 + tar --no-same-owner -xf spdk_a1264177cd264beaac27476984a68dceee651050.tar.gz 00:00:45.243 [Pipeline] sh 00:00:45.530 + git -C spdk log --oneline -n5 00:00:45.530 a1264177c pkgdep/git: Adjust ICE driver to kernel >= 6.8.x 00:00:45.530 af95268b1 pkgdep/git: Adjust QAT driver to kernel >= 6.8.x 00:00:45.530 5e75b9137 scripts/pkgdep: Simplify mdl installation 00:00:45.530 ba909a45b lib/iscsi: add rpc method iscsi_get_histogram 00:00:45.530 90ba272ce lib/iscsi: add rpc method iscsi_enable_histogram 00:00:45.549 [Pipeline] withCredentials 00:00:45.560 > git --version # timeout=10 00:00:45.570 > git --version # 'git version 2.39.2' 00:00:45.589 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:45.591 [Pipeline] { 00:00:45.599 [Pipeline] retry 00:00:45.600 [Pipeline] { 00:00:45.616 [Pipeline] sh 00:00:45.901 + git ls-remote http://dpdk.org/git/dpdk main 00:00:46.174 [Pipeline] } 00:00:46.199 [Pipeline] // retry 00:00:46.204 [Pipeline] } 00:00:46.228 [Pipeline] // withCredentials 00:00:46.242 [Pipeline] httpRequest 00:00:46.248 HttpMethod: GET 00:00:46.249 URL: http://10.211.164.101/packages/dpdk_7e06c0de1952d3109a5b0c4779d7e7d8059c9d78.tar.gz 00:00:46.254 Sending request to url: http://10.211.164.101/packages/dpdk_7e06c0de1952d3109a5b0c4779d7e7d8059c9d78.tar.gz 00:00:46.269 Response Code: HTTP/1.1 200 OK 00:00:46.269 Success: Status code 200 is in the accepted range: 200,404 00:00:46.270 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_7e06c0de1952d3109a5b0c4779d7e7d8059c9d78.tar.gz 00:01:24.833 [Pipeline] sh 00:01:25.119 + tar --no-same-owner -xf dpdk_7e06c0de1952d3109a5b0c4779d7e7d8059c9d78.tar.gz 00:01:26.512 [Pipeline] sh 00:01:26.798 + git -C dpdk log --oneline -n5 00:01:26.798 7e06c0de19 examples: move alignment attribute on types for MSVC 00:01:26.798 27595cd830 drivers: move alignment attribute on types for MSVC 00:01:26.798 0efea35a2b app: move alignment attribute on types for MSVC 00:01:26.798 e2e546ab5b version: 24.07-rc0 00:01:26.798 a9778aad62 version: 24.03.0 00:01:26.811 [Pipeline] } 00:01:26.830 [Pipeline] // stage 00:01:26.838 [Pipeline] stage 00:01:26.841 [Pipeline] { (Prepare) 00:01:26.866 [Pipeline] writeFile 00:01:26.885 [Pipeline] sh 00:01:27.170 + logger -p user.info -t JENKINS-CI 00:01:27.183 [Pipeline] sh 00:01:27.469 + logger -p user.info -t JENKINS-CI 00:01:27.480 [Pipeline] sh 00:01:27.765 + cat autorun-spdk.conf 00:01:27.765 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:27.765 SPDK_TEST_NVMF=1 00:01:27.765 SPDK_TEST_NVME_CLI=1 00:01:27.765 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:27.765 SPDK_TEST_NVMF_NICS=e810 00:01:27.765 SPDK_TEST_VFIOUSER=1 00:01:27.765 SPDK_RUN_UBSAN=1 00:01:27.765 NET_TYPE=phy 00:01:27.765 SPDK_TEST_NATIVE_DPDK=main 00:01:27.765 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:27.772 RUN_NIGHTLY=1 00:01:27.777 [Pipeline] readFile 00:01:27.806 [Pipeline] withEnv 00:01:27.808 [Pipeline] { 00:01:27.823 [Pipeline] sh 00:01:28.108 + set -ex 00:01:28.108 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:28.108 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:28.108 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:28.108 ++ SPDK_TEST_NVMF=1 00:01:28.108 ++ SPDK_TEST_NVME_CLI=1 00:01:28.108 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:28.108 ++ SPDK_TEST_NVMF_NICS=e810 00:01:28.108 ++ SPDK_TEST_VFIOUSER=1 00:01:28.108 ++ SPDK_RUN_UBSAN=1 00:01:28.108 ++ NET_TYPE=phy 00:01:28.108 ++ SPDK_TEST_NATIVE_DPDK=main 00:01:28.108 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:28.108 ++ RUN_NIGHTLY=1 00:01:28.108 + case $SPDK_TEST_NVMF_NICS in 00:01:28.108 + DRIVERS=ice 00:01:28.108 + [[ tcp == \r\d\m\a ]] 00:01:28.108 + [[ -n ice ]] 00:01:28.108 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:28.108 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:28.108 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:28.108 rmmod: ERROR: Module irdma is not currently loaded 00:01:28.108 rmmod: ERROR: Module i40iw is not currently loaded 00:01:28.108 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:28.108 + true 00:01:28.108 + for D in $DRIVERS 00:01:28.108 + sudo modprobe ice 00:01:28.108 + exit 0 00:01:28.118 [Pipeline] } 00:01:28.137 [Pipeline] // withEnv 00:01:28.142 [Pipeline] } 00:01:28.161 [Pipeline] // stage 00:01:28.172 [Pipeline] catchError 00:01:28.174 [Pipeline] { 00:01:28.192 [Pipeline] timeout 00:01:28.192 Timeout set to expire in 40 min 00:01:28.194 [Pipeline] { 00:01:28.212 [Pipeline] stage 00:01:28.214 [Pipeline] { (Tests) 00:01:28.233 [Pipeline] sh 00:01:28.516 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.516 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.516 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.516 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:28.516 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:28.516 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:28.516 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:28.516 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:28.516 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:28.516 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:28.516 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.516 + source /etc/os-release 00:01:28.516 ++ NAME='Fedora Linux' 00:01:28.516 ++ VERSION='38 (Cloud Edition)' 00:01:28.516 ++ ID=fedora 00:01:28.516 ++ VERSION_ID=38 00:01:28.516 ++ VERSION_CODENAME= 00:01:28.516 ++ PLATFORM_ID=platform:f38 00:01:28.516 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:28.516 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:28.516 ++ LOGO=fedora-logo-icon 00:01:28.516 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:28.516 ++ HOME_URL=https://fedoraproject.org/ 00:01:28.516 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:28.516 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:28.516 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:28.516 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:28.516 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:28.516 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:28.516 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:28.516 ++ SUPPORT_END=2024-05-14 00:01:28.516 ++ VARIANT='Cloud Edition' 00:01:28.516 ++ VARIANT_ID=cloud 00:01:28.516 + uname -a 00:01:28.516 Linux spdk-gp-11 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:28.516 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:29.454 Hugepages 00:01:29.454 node hugesize free / total 00:01:29.455 node0 1048576kB 0 / 0 00:01:29.455 node0 2048kB 0 / 0 00:01:29.455 node1 1048576kB 0 / 0 00:01:29.455 node1 2048kB 0 / 0 00:01:29.455 00:01:29.455 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:29.455 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:29.455 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:29.455 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:29.455 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:29.455 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:29.455 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:29.455 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:29.455 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:29.455 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:29.713 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:29.713 + rm -f /tmp/spdk-ld-path 00:01:29.713 + source autorun-spdk.conf 00:01:29.713 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.713 ++ SPDK_TEST_NVMF=1 00:01:29.713 ++ SPDK_TEST_NVME_CLI=1 00:01:29.713 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.713 ++ SPDK_TEST_NVMF_NICS=e810 00:01:29.713 ++ SPDK_TEST_VFIOUSER=1 00:01:29.713 ++ SPDK_RUN_UBSAN=1 00:01:29.713 ++ NET_TYPE=phy 00:01:29.713 ++ SPDK_TEST_NATIVE_DPDK=main 00:01:29.713 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.713 ++ RUN_NIGHTLY=1 00:01:29.713 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:29.713 + [[ -n '' ]] 00:01:29.713 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:29.713 + for M in /var/spdk/build-*-manifest.txt 00:01:29.713 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:29.713 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:29.713 + for M in /var/spdk/build-*-manifest.txt 00:01:29.713 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:29.713 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:29.713 ++ uname 00:01:29.713 + [[ Linux == \L\i\n\u\x ]] 00:01:29.713 + sudo dmesg -T 00:01:29.713 + sudo dmesg --clear 00:01:29.713 + dmesg_pid=2161880 00:01:29.713 + [[ Fedora Linux == FreeBSD ]] 00:01:29.714 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.714 + sudo dmesg -Tw 00:01:29.714 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.714 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:29.714 + [[ -x /usr/src/fio-static/fio ]] 00:01:29.714 + export FIO_BIN=/usr/src/fio-static/fio 00:01:29.714 + FIO_BIN=/usr/src/fio-static/fio 00:01:29.714 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:29.714 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:29.714 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:29.714 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.714 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.714 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:29.714 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.714 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.714 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:29.714 Test configuration: 00:01:29.714 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.714 SPDK_TEST_NVMF=1 00:01:29.714 SPDK_TEST_NVME_CLI=1 00:01:29.714 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.714 SPDK_TEST_NVMF_NICS=e810 00:01:29.714 SPDK_TEST_VFIOUSER=1 00:01:29.714 SPDK_RUN_UBSAN=1 00:01:29.714 NET_TYPE=phy 00:01:29.714 SPDK_TEST_NATIVE_DPDK=main 00:01:29.714 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.714 RUN_NIGHTLY=1 04:46:08 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:29.714 04:46:08 -- scripts/common.sh@502 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:29.714 04:46:08 -- scripts/common.sh@510 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:29.714 04:46:08 -- scripts/common.sh@511 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:29.714 04:46:08 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.714 04:46:08 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.714 04:46:08 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.714 04:46:08 -- paths/export.sh@5 -- $ export PATH 00:01:29.714 04:46:08 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.714 04:46:08 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:29.714 04:46:08 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:29.714 04:46:08 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713840368.XXXXXX 00:01:29.714 04:46:08 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713840368.weO5cz 00:01:29.714 04:46:08 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:29.714 04:46:08 -- common/autobuild_common.sh@441 -- $ '[' -n main ']' 00:01:29.714 04:46:08 -- common/autobuild_common.sh@442 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.714 04:46:08 -- common/autobuild_common.sh@442 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:29.714 04:46:08 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:29.714 04:46:08 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:29.714 04:46:08 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:29.714 04:46:08 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:01:29.714 04:46:08 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.714 04:46:08 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:29.714 04:46:08 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:01:29.714 04:46:08 -- pm/common@17 -- $ local monitor 00:01:29.714 04:46:08 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.714 04:46:08 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2161916 00:01:29.714 04:46:08 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.714 04:46:08 -- pm/common@21 -- $ date +%s 00:01:29.714 04:46:08 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2161918 00:01:29.714 04:46:08 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.714 04:46:08 -- pm/common@21 -- $ date +%s 00:01:29.714 04:46:08 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2161921 00:01:29.714 04:46:08 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.714 04:46:08 -- pm/common@21 -- $ date +%s 00:01:29.714 04:46:08 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2161924 00:01:29.714 04:46:08 -- pm/common@26 -- $ sleep 1 00:01:29.714 04:46:08 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713840368 00:01:29.714 04:46:08 -- pm/common@21 -- $ date +%s 00:01:29.714 04:46:08 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713840368 00:01:29.714 04:46:08 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713840368 00:01:29.714 04:46:08 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713840368 00:01:29.714 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713840368_collect-vmstat.pm.log 00:01:29.714 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713840368_collect-bmc-pm.bmc.pm.log 00:01:29.714 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713840368_collect-cpu-load.pm.log 00:01:29.714 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713840368_collect-cpu-temp.pm.log 00:01:30.655 04:46:09 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:01:30.655 04:46:09 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:30.655 04:46:09 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:30.655 04:46:09 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:30.655 04:46:09 -- spdk/autobuild.sh@16 -- $ date -u 00:01:30.655 Tue Apr 23 02:46:09 AM UTC 2024 00:01:30.655 04:46:09 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:30.914 v24.05-pre-435-ga1264177c 00:01:30.914 04:46:09 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:30.914 04:46:09 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:30.914 04:46:09 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:30.914 04:46:09 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:30.914 04:46:09 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:30.914 04:46:09 -- common/autotest_common.sh@10 -- $ set +x 00:01:30.914 ************************************ 00:01:30.914 START TEST ubsan 00:01:30.914 ************************************ 00:01:30.914 04:46:09 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:01:30.914 using ubsan 00:01:30.914 00:01:30.914 real 0m0.000s 00:01:30.914 user 0m0.000s 00:01:30.914 sys 0m0.000s 00:01:30.914 04:46:09 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:01:30.914 04:46:09 -- common/autotest_common.sh@10 -- $ set +x 00:01:30.914 ************************************ 00:01:30.914 END TEST ubsan 00:01:30.914 ************************************ 00:01:30.914 04:46:09 -- spdk/autobuild.sh@27 -- $ '[' -n main ']' 00:01:30.914 04:46:09 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:30.914 04:46:09 -- common/autobuild_common.sh@427 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:30.914 04:46:09 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:30.914 04:46:09 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:30.914 04:46:09 -- common/autotest_common.sh@10 -- $ set +x 00:01:30.914 ************************************ 00:01:30.914 START TEST build_native_dpdk 00:01:30.914 ************************************ 00:01:30.914 04:46:10 -- common/autotest_common.sh@1111 -- $ _build_native_dpdk 00:01:30.914 04:46:10 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:30.914 04:46:10 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:30.914 04:46:10 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:30.914 04:46:10 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:30.914 04:46:10 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:30.914 04:46:10 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:30.914 04:46:10 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:30.914 04:46:10 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:30.914 04:46:10 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:30.914 04:46:10 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:30.914 04:46:10 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:30.914 04:46:10 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:30.914 04:46:10 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:30.914 04:46:10 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:30.914 04:46:10 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:30.914 04:46:10 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:30.914 04:46:10 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:30.914 04:46:10 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:30.914 04:46:10 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:30.914 04:46:10 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:30.914 7e06c0de19 examples: move alignment attribute on types for MSVC 00:01:30.914 27595cd830 drivers: move alignment attribute on types for MSVC 00:01:30.914 0efea35a2b app: move alignment attribute on types for MSVC 00:01:30.914 e2e546ab5b version: 24.07-rc0 00:01:30.914 a9778aad62 version: 24.03.0 00:01:30.914 04:46:10 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:30.914 04:46:10 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:30.914 04:46:10 -- common/autobuild_common.sh@87 -- $ dpdk_ver=24.07.0-rc0 00:01:30.914 04:46:10 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:30.914 04:46:10 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:30.914 04:46:10 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:30.915 04:46:10 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:30.915 04:46:10 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:30.915 04:46:10 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:30.915 04:46:10 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:30.915 04:46:10 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:30.915 04:46:10 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:30.915 04:46:10 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:30.915 04:46:10 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:30.915 04:46:10 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:30.915 04:46:10 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:30.915 04:46:10 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:30.915 04:46:10 -- common/autobuild_common.sh@169 -- $ lt 24.07.0-rc0 21.11.0 00:01:30.915 04:46:10 -- scripts/common.sh@370 -- $ cmp_versions 24.07.0-rc0 '<' 21.11.0 00:01:30.915 04:46:10 -- scripts/common.sh@330 -- $ local ver1 ver1_l 00:01:30.915 04:46:10 -- scripts/common.sh@331 -- $ local ver2 ver2_l 00:01:30.915 04:46:10 -- scripts/common.sh@333 -- $ IFS=.-: 00:01:30.915 04:46:10 -- scripts/common.sh@333 -- $ read -ra ver1 00:01:30.915 04:46:10 -- scripts/common.sh@334 -- $ IFS=.-: 00:01:30.915 04:46:10 -- scripts/common.sh@334 -- $ read -ra ver2 00:01:30.915 04:46:10 -- scripts/common.sh@335 -- $ local 'op=<' 00:01:30.915 04:46:10 -- scripts/common.sh@337 -- $ ver1_l=4 00:01:30.915 04:46:10 -- scripts/common.sh@338 -- $ ver2_l=3 00:01:30.915 04:46:10 -- scripts/common.sh@340 -- $ local lt=0 gt=0 eq=0 v 00:01:30.915 04:46:10 -- scripts/common.sh@341 -- $ case "$op" in 00:01:30.915 04:46:10 -- scripts/common.sh@342 -- $ : 1 00:01:30.915 04:46:10 -- scripts/common.sh@361 -- $ (( v = 0 )) 00:01:30.915 04:46:10 -- scripts/common.sh@361 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:30.915 04:46:10 -- scripts/common.sh@362 -- $ decimal 24 00:01:30.915 04:46:10 -- scripts/common.sh@350 -- $ local d=24 00:01:30.915 04:46:10 -- scripts/common.sh@351 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:30.915 04:46:10 -- scripts/common.sh@352 -- $ echo 24 00:01:30.915 04:46:10 -- scripts/common.sh@362 -- $ ver1[v]=24 00:01:30.915 04:46:10 -- scripts/common.sh@363 -- $ decimal 21 00:01:30.915 04:46:10 -- scripts/common.sh@350 -- $ local d=21 00:01:30.915 04:46:10 -- scripts/common.sh@351 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:30.915 04:46:10 -- scripts/common.sh@352 -- $ echo 21 00:01:30.915 04:46:10 -- scripts/common.sh@363 -- $ ver2[v]=21 00:01:30.915 04:46:10 -- scripts/common.sh@364 -- $ (( ver1[v] > ver2[v] )) 00:01:30.915 04:46:10 -- scripts/common.sh@364 -- $ return 1 00:01:30.915 04:46:10 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:30.915 patching file config/rte_config.h 00:01:30.915 Hunk #1 succeeded at 70 (offset 11 lines). 00:01:30.915 04:46:10 -- common/autobuild_common.sh@177 -- $ dpdk_kmods=false 00:01:30.915 04:46:10 -- common/autobuild_common.sh@178 -- $ uname -s 00:01:30.915 04:46:10 -- common/autobuild_common.sh@178 -- $ '[' Linux = FreeBSD ']' 00:01:31.175 04:46:10 -- common/autobuild_common.sh@182 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:31.175 04:46:10 -- common/autobuild_common.sh@182 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:35.374 The Meson build system 00:01:35.374 Version: 1.3.1 00:01:35.374 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:35.374 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:35.374 Build type: native build 00:01:35.374 Program cat found: YES (/usr/bin/cat) 00:01:35.374 Project name: DPDK 00:01:35.374 Project version: 24.07.0-rc0 00:01:35.374 C compiler for the host machine: gcc (gcc 13.2.1 "gcc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:35.374 C linker for the host machine: gcc ld.bfd 2.39-16 00:01:35.374 Host machine cpu family: x86_64 00:01:35.374 Host machine cpu: x86_64 00:01:35.374 Message: ## Building in Developer Mode ## 00:01:35.374 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:35.374 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:35.374 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:35.374 Program python3 found: YES (/usr/bin/python3) 00:01:35.374 Program cat found: YES (/usr/bin/cat) 00:01:35.374 config/meson.build:120: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:35.374 Compiler for C supports arguments -march=native: YES 00:01:35.374 Checking for size of "void *" : 8 00:01:35.374 Checking for size of "void *" : 8 (cached) 00:01:35.374 Compiler for C supports link arguments -Wl,--undefined-version: NO 00:01:35.374 Library m found: YES 00:01:35.374 Library numa found: YES 00:01:35.374 Has header "numaif.h" : YES 00:01:35.374 Library fdt found: NO 00:01:35.374 Library execinfo found: NO 00:01:35.374 Has header "execinfo.h" : YES 00:01:35.374 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:35.374 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:35.374 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:35.374 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:35.374 Run-time dependency openssl found: YES 3.0.9 00:01:35.374 Run-time dependency libpcap found: YES 1.10.4 00:01:35.374 Has header "pcap.h" with dependency libpcap: YES 00:01:35.374 Compiler for C supports arguments -Wcast-qual: YES 00:01:35.374 Compiler for C supports arguments -Wdeprecated: YES 00:01:35.374 Compiler for C supports arguments -Wformat: YES 00:01:35.374 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:35.374 Compiler for C supports arguments -Wformat-security: NO 00:01:35.374 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:35.374 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:35.374 Compiler for C supports arguments -Wnested-externs: YES 00:01:35.374 Compiler for C supports arguments -Wold-style-definition: YES 00:01:35.374 Compiler for C supports arguments -Wpointer-arith: YES 00:01:35.374 Compiler for C supports arguments -Wsign-compare: YES 00:01:35.374 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:35.374 Compiler for C supports arguments -Wundef: YES 00:01:35.374 Compiler for C supports arguments -Wwrite-strings: YES 00:01:35.374 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:35.374 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:35.374 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:35.374 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:35.374 Program objdump found: YES (/usr/bin/objdump) 00:01:35.374 Compiler for C supports arguments -mavx512f: YES 00:01:35.374 Checking if "AVX512 checking" compiles: YES 00:01:35.374 Fetching value of define "__SSE4_2__" : 1 00:01:35.374 Fetching value of define "__AES__" : 1 00:01:35.374 Fetching value of define "__AVX__" : 1 00:01:35.374 Fetching value of define "__AVX2__" : (undefined) 00:01:35.374 Fetching value of define "__AVX512BW__" : (undefined) 00:01:35.374 Fetching value of define "__AVX512CD__" : (undefined) 00:01:35.374 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:35.374 Fetching value of define "__AVX512F__" : (undefined) 00:01:35.374 Fetching value of define "__AVX512VL__" : (undefined) 00:01:35.374 Fetching value of define "__PCLMUL__" : 1 00:01:35.374 Fetching value of define "__RDRND__" : 1 00:01:35.374 Fetching value of define "__RDSEED__" : (undefined) 00:01:35.374 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:35.374 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:35.374 Message: lib/log: Defining dependency "log" 00:01:35.374 Message: lib/kvargs: Defining dependency "kvargs" 00:01:35.374 Message: lib/argparse: Defining dependency "argparse" 00:01:35.374 Message: lib/telemetry: Defining dependency "telemetry" 00:01:35.374 Checking for function "getentropy" : NO 00:01:35.374 Message: lib/eal: Defining dependency "eal" 00:01:35.374 Message: lib/ring: Defining dependency "ring" 00:01:35.374 Message: lib/rcu: Defining dependency "rcu" 00:01:35.374 Message: lib/mempool: Defining dependency "mempool" 00:01:35.374 Message: lib/mbuf: Defining dependency "mbuf" 00:01:35.374 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:35.374 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:35.374 Compiler for C supports arguments -mpclmul: YES 00:01:35.374 Compiler for C supports arguments -maes: YES 00:01:35.374 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:35.374 Compiler for C supports arguments -mavx512bw: YES 00:01:35.374 Compiler for C supports arguments -mavx512dq: YES 00:01:35.374 Compiler for C supports arguments -mavx512vl: YES 00:01:35.374 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:35.374 Compiler for C supports arguments -mavx2: YES 00:01:35.374 Compiler for C supports arguments -mavx: YES 00:01:35.374 Message: lib/net: Defining dependency "net" 00:01:35.374 Message: lib/meter: Defining dependency "meter" 00:01:35.374 Message: lib/ethdev: Defining dependency "ethdev" 00:01:35.374 Message: lib/pci: Defining dependency "pci" 00:01:35.374 Message: lib/cmdline: Defining dependency "cmdline" 00:01:35.374 Message: lib/metrics: Defining dependency "metrics" 00:01:35.374 Message: lib/hash: Defining dependency "hash" 00:01:35.374 Message: lib/timer: Defining dependency "timer" 00:01:35.374 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:35.374 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:35.374 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:35.374 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:35.374 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:35.374 Message: lib/acl: Defining dependency "acl" 00:01:35.374 Message: lib/bbdev: Defining dependency "bbdev" 00:01:35.374 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:35.374 Run-time dependency libelf found: YES 0.190 00:01:35.374 Message: lib/bpf: Defining dependency "bpf" 00:01:35.374 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:35.374 Message: lib/compressdev: Defining dependency "compressdev" 00:01:35.374 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:35.374 Message: lib/distributor: Defining dependency "distributor" 00:01:35.374 Message: lib/dmadev: Defining dependency "dmadev" 00:01:35.375 Message: lib/efd: Defining dependency "efd" 00:01:35.375 Message: lib/eventdev: Defining dependency "eventdev" 00:01:35.375 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:35.375 Message: lib/gpudev: Defining dependency "gpudev" 00:01:35.375 Message: lib/gro: Defining dependency "gro" 00:01:35.375 Message: lib/gso: Defining dependency "gso" 00:01:35.375 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:35.375 Message: lib/jobstats: Defining dependency "jobstats" 00:01:35.375 Message: lib/latencystats: Defining dependency "latencystats" 00:01:35.375 Message: lib/lpm: Defining dependency "lpm" 00:01:35.375 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:35.375 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:35.375 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:35.375 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:35.375 Message: lib/member: Defining dependency "member" 00:01:35.375 Message: lib/pcapng: Defining dependency "pcapng" 00:01:35.375 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:35.375 Message: lib/power: Defining dependency "power" 00:01:35.375 Message: lib/rawdev: Defining dependency "rawdev" 00:01:35.375 Message: lib/regexdev: Defining dependency "regexdev" 00:01:35.375 Message: lib/mldev: Defining dependency "mldev" 00:01:35.375 Message: lib/rib: Defining dependency "rib" 00:01:35.375 Message: lib/reorder: Defining dependency "reorder" 00:01:35.375 Message: lib/sched: Defining dependency "sched" 00:01:35.375 Message: lib/security: Defining dependency "security" 00:01:35.375 Message: lib/stack: Defining dependency "stack" 00:01:35.375 Has header "linux/userfaultfd.h" : YES 00:01:35.375 Has header "linux/vduse.h" : YES 00:01:35.375 Message: lib/vhost: Defining dependency "vhost" 00:01:35.375 Message: lib/ipsec: Defining dependency "ipsec" 00:01:35.375 Message: lib/pdcp: Defining dependency "pdcp" 00:01:35.375 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:35.375 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:35.375 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:35.375 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:35.375 Message: lib/fib: Defining dependency "fib" 00:01:35.375 Message: lib/port: Defining dependency "port" 00:01:35.375 Message: lib/pdump: Defining dependency "pdump" 00:01:35.375 Message: lib/table: Defining dependency "table" 00:01:35.375 Message: lib/pipeline: Defining dependency "pipeline" 00:01:35.375 Message: lib/graph: Defining dependency "graph" 00:01:35.375 Message: lib/node: Defining dependency "node" 00:01:35.375 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:36.756 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:36.756 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:36.756 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:36.756 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:36.756 Compiler for C supports arguments -Wno-unused-value: YES 00:01:36.756 Compiler for C supports arguments -Wno-format: YES 00:01:36.756 Compiler for C supports arguments -Wno-format-security: YES 00:01:36.756 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:36.756 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:36.756 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:36.756 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:36.756 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:36.756 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:36.756 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:36.756 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:36.756 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:36.756 Has header "sys/epoll.h" : YES 00:01:36.756 Program doxygen found: YES (/usr/bin/doxygen) 00:01:36.756 Configuring doxy-api-html.conf using configuration 00:01:36.756 Configuring doxy-api-man.conf using configuration 00:01:36.756 Program mandb found: YES (/usr/bin/mandb) 00:01:36.756 Program sphinx-build found: NO 00:01:36.756 Configuring rte_build_config.h using configuration 00:01:36.756 Message: 00:01:36.756 ================= 00:01:36.756 Applications Enabled 00:01:36.756 ================= 00:01:36.756 00:01:36.756 apps: 00:01:36.756 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:36.756 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:36.756 test-pmd, test-regex, test-sad, test-security-perf, 00:01:36.756 00:01:36.756 Message: 00:01:36.756 ================= 00:01:36.756 Libraries Enabled 00:01:36.756 ================= 00:01:36.756 00:01:36.756 libs: 00:01:36.756 log, kvargs, argparse, telemetry, eal, ring, rcu, mempool, 00:01:36.756 mbuf, net, meter, ethdev, pci, cmdline, metrics, hash, 00:01:36.756 timer, acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, 00:01:36.756 distributor, dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, 00:01:36.756 ip_frag, jobstats, latencystats, lpm, member, pcapng, power, rawdev, 00:01:36.756 regexdev, mldev, rib, reorder, sched, security, stack, vhost, 00:01:36.756 ipsec, pdcp, fib, port, pdump, table, pipeline, graph, 00:01:36.756 node, 00:01:36.756 00:01:36.756 Message: 00:01:36.756 =============== 00:01:36.756 Drivers Enabled 00:01:36.756 =============== 00:01:36.756 00:01:36.756 common: 00:01:36.756 00:01:36.756 bus: 00:01:36.756 pci, vdev, 00:01:36.756 mempool: 00:01:36.756 ring, 00:01:36.756 dma: 00:01:36.756 00:01:36.756 net: 00:01:36.756 i40e, 00:01:36.756 raw: 00:01:36.756 00:01:36.756 crypto: 00:01:36.756 00:01:36.756 compress: 00:01:36.756 00:01:36.756 regex: 00:01:36.756 00:01:36.756 ml: 00:01:36.756 00:01:36.756 vdpa: 00:01:36.756 00:01:36.756 event: 00:01:36.756 00:01:36.756 baseband: 00:01:36.756 00:01:36.756 gpu: 00:01:36.756 00:01:36.756 00:01:36.756 Message: 00:01:36.756 ================= 00:01:36.756 Content Skipped 00:01:36.756 ================= 00:01:36.756 00:01:36.756 apps: 00:01:36.756 00:01:36.756 libs: 00:01:36.756 00:01:36.756 drivers: 00:01:36.756 common/cpt: not in enabled drivers build config 00:01:36.756 common/dpaax: not in enabled drivers build config 00:01:36.756 common/iavf: not in enabled drivers build config 00:01:36.756 common/idpf: not in enabled drivers build config 00:01:36.756 common/ionic: not in enabled drivers build config 00:01:36.756 common/mvep: not in enabled drivers build config 00:01:36.756 common/octeontx: not in enabled drivers build config 00:01:36.756 bus/auxiliary: not in enabled drivers build config 00:01:36.756 bus/cdx: not in enabled drivers build config 00:01:36.756 bus/dpaa: not in enabled drivers build config 00:01:36.756 bus/fslmc: not in enabled drivers build config 00:01:36.756 bus/ifpga: not in enabled drivers build config 00:01:36.756 bus/platform: not in enabled drivers build config 00:01:36.756 bus/uacce: not in enabled drivers build config 00:01:36.756 bus/vmbus: not in enabled drivers build config 00:01:36.756 common/cnxk: not in enabled drivers build config 00:01:36.756 common/mlx5: not in enabled drivers build config 00:01:36.756 common/nfp: not in enabled drivers build config 00:01:36.756 common/nitrox: not in enabled drivers build config 00:01:36.756 common/qat: not in enabled drivers build config 00:01:36.756 common/sfc_efx: not in enabled drivers build config 00:01:36.756 mempool/bucket: not in enabled drivers build config 00:01:36.756 mempool/cnxk: not in enabled drivers build config 00:01:36.756 mempool/dpaa: not in enabled drivers build config 00:01:36.756 mempool/dpaa2: not in enabled drivers build config 00:01:36.756 mempool/octeontx: not in enabled drivers build config 00:01:36.756 mempool/stack: not in enabled drivers build config 00:01:36.756 dma/cnxk: not in enabled drivers build config 00:01:36.756 dma/dpaa: not in enabled drivers build config 00:01:36.756 dma/dpaa2: not in enabled drivers build config 00:01:36.756 dma/hisilicon: not in enabled drivers build config 00:01:36.756 dma/idxd: not in enabled drivers build config 00:01:36.756 dma/ioat: not in enabled drivers build config 00:01:36.756 dma/skeleton: not in enabled drivers build config 00:01:36.756 net/af_packet: not in enabled drivers build config 00:01:36.756 net/af_xdp: not in enabled drivers build config 00:01:36.756 net/ark: not in enabled drivers build config 00:01:36.756 net/atlantic: not in enabled drivers build config 00:01:36.756 net/avp: not in enabled drivers build config 00:01:36.756 net/axgbe: not in enabled drivers build config 00:01:36.756 net/bnx2x: not in enabled drivers build config 00:01:36.756 net/bnxt: not in enabled drivers build config 00:01:36.756 net/bonding: not in enabled drivers build config 00:01:36.756 net/cnxk: not in enabled drivers build config 00:01:36.756 net/cpfl: not in enabled drivers build config 00:01:36.756 net/cxgbe: not in enabled drivers build config 00:01:36.756 net/dpaa: not in enabled drivers build config 00:01:36.756 net/dpaa2: not in enabled drivers build config 00:01:36.756 net/e1000: not in enabled drivers build config 00:01:36.756 net/ena: not in enabled drivers build config 00:01:36.756 net/enetc: not in enabled drivers build config 00:01:36.756 net/enetfec: not in enabled drivers build config 00:01:36.756 net/enic: not in enabled drivers build config 00:01:36.756 net/failsafe: not in enabled drivers build config 00:01:36.756 net/fm10k: not in enabled drivers build config 00:01:36.756 net/gve: not in enabled drivers build config 00:01:36.756 net/hinic: not in enabled drivers build config 00:01:36.756 net/hns3: not in enabled drivers build config 00:01:36.756 net/iavf: not in enabled drivers build config 00:01:36.756 net/ice: not in enabled drivers build config 00:01:36.756 net/idpf: not in enabled drivers build config 00:01:36.756 net/igc: not in enabled drivers build config 00:01:36.756 net/ionic: not in enabled drivers build config 00:01:36.756 net/ipn3ke: not in enabled drivers build config 00:01:36.756 net/ixgbe: not in enabled drivers build config 00:01:36.756 net/mana: not in enabled drivers build config 00:01:36.756 net/memif: not in enabled drivers build config 00:01:36.756 net/mlx4: not in enabled drivers build config 00:01:36.756 net/mlx5: not in enabled drivers build config 00:01:36.756 net/mvneta: not in enabled drivers build config 00:01:36.756 net/mvpp2: not in enabled drivers build config 00:01:36.756 net/netvsc: not in enabled drivers build config 00:01:36.756 net/nfb: not in enabled drivers build config 00:01:36.756 net/nfp: not in enabled drivers build config 00:01:36.756 net/ngbe: not in enabled drivers build config 00:01:36.756 net/null: not in enabled drivers build config 00:01:36.756 net/octeontx: not in enabled drivers build config 00:01:36.756 net/octeon_ep: not in enabled drivers build config 00:01:36.756 net/pcap: not in enabled drivers build config 00:01:36.756 net/pfe: not in enabled drivers build config 00:01:36.756 net/qede: not in enabled drivers build config 00:01:36.756 net/ring: not in enabled drivers build config 00:01:36.756 net/sfc: not in enabled drivers build config 00:01:36.756 net/softnic: not in enabled drivers build config 00:01:36.756 net/tap: not in enabled drivers build config 00:01:36.756 net/thunderx: not in enabled drivers build config 00:01:36.756 net/txgbe: not in enabled drivers build config 00:01:36.756 net/vdev_netvsc: not in enabled drivers build config 00:01:36.756 net/vhost: not in enabled drivers build config 00:01:36.756 net/virtio: not in enabled drivers build config 00:01:36.756 net/vmxnet3: not in enabled drivers build config 00:01:36.756 raw/cnxk_bphy: not in enabled drivers build config 00:01:36.756 raw/cnxk_gpio: not in enabled drivers build config 00:01:36.756 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:36.756 raw/ifpga: not in enabled drivers build config 00:01:36.756 raw/ntb: not in enabled drivers build config 00:01:36.756 raw/skeleton: not in enabled drivers build config 00:01:36.756 crypto/armv8: not in enabled drivers build config 00:01:36.756 crypto/bcmfs: not in enabled drivers build config 00:01:36.756 crypto/caam_jr: not in enabled drivers build config 00:01:36.756 crypto/ccp: not in enabled drivers build config 00:01:36.756 crypto/cnxk: not in enabled drivers build config 00:01:36.757 crypto/dpaa_sec: not in enabled drivers build config 00:01:36.757 crypto/dpaa2_sec: not in enabled drivers build config 00:01:36.757 crypto/ipsec_mb: not in enabled drivers build config 00:01:36.757 crypto/mlx5: not in enabled drivers build config 00:01:36.757 crypto/mvsam: not in enabled drivers build config 00:01:36.757 crypto/nitrox: not in enabled drivers build config 00:01:36.757 crypto/null: not in enabled drivers build config 00:01:36.757 crypto/octeontx: not in enabled drivers build config 00:01:36.757 crypto/openssl: not in enabled drivers build config 00:01:36.757 crypto/scheduler: not in enabled drivers build config 00:01:36.757 crypto/uadk: not in enabled drivers build config 00:01:36.757 crypto/virtio: not in enabled drivers build config 00:01:36.757 compress/isal: not in enabled drivers build config 00:01:36.757 compress/mlx5: not in enabled drivers build config 00:01:36.757 compress/nitrox: not in enabled drivers build config 00:01:36.757 compress/octeontx: not in enabled drivers build config 00:01:36.757 compress/zlib: not in enabled drivers build config 00:01:36.757 regex/mlx5: not in enabled drivers build config 00:01:36.757 regex/cn9k: not in enabled drivers build config 00:01:36.757 ml/cnxk: not in enabled drivers build config 00:01:36.757 vdpa/ifc: not in enabled drivers build config 00:01:36.757 vdpa/mlx5: not in enabled drivers build config 00:01:36.757 vdpa/nfp: not in enabled drivers build config 00:01:36.757 vdpa/sfc: not in enabled drivers build config 00:01:36.757 event/cnxk: not in enabled drivers build config 00:01:36.757 event/dlb2: not in enabled drivers build config 00:01:36.757 event/dpaa: not in enabled drivers build config 00:01:36.757 event/dpaa2: not in enabled drivers build config 00:01:36.757 event/dsw: not in enabled drivers build config 00:01:36.757 event/opdl: not in enabled drivers build config 00:01:36.757 event/skeleton: not in enabled drivers build config 00:01:36.757 event/sw: not in enabled drivers build config 00:01:36.757 event/octeontx: not in enabled drivers build config 00:01:36.757 baseband/acc: not in enabled drivers build config 00:01:36.757 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:36.757 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:36.757 baseband/la12xx: not in enabled drivers build config 00:01:36.757 baseband/null: not in enabled drivers build config 00:01:36.757 baseband/turbo_sw: not in enabled drivers build config 00:01:36.757 gpu/cuda: not in enabled drivers build config 00:01:36.757 00:01:36.757 00:01:36.757 Build targets in project: 224 00:01:36.757 00:01:36.757 DPDK 24.07.0-rc0 00:01:36.757 00:01:36.757 User defined options 00:01:36.757 libdir : lib 00:01:36.757 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:36.757 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:36.757 c_link_args : 00:01:36.757 enable_docs : false 00:01:36.757 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:36.757 enable_kmods : false 00:01:36.757 machine : native 00:01:36.757 tests : false 00:01:36.757 00:01:36.757 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:36.757 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:36.757 04:46:15 -- common/autobuild_common.sh@186 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:36.757 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:36.757 [1/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:36.757 [2/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:36.757 [3/722] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:36.757 [4/722] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:36.757 [5/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:36.757 [6/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:36.757 [7/722] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:36.757 [8/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:37.018 [9/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:37.018 [10/722] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:37.018 [11/722] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:37.018 [12/722] Linking static target lib/librte_kvargs.a 00:01:37.018 [13/722] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:37.018 [14/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:37.018 [15/722] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:37.018 [16/722] Linking static target lib/librte_log.a 00:01:37.278 [17/722] Compiling C object lib/librte_argparse.a.p/argparse_rte_argparse.c.o 00:01:37.278 [18/722] Linking static target lib/librte_argparse.a 00:01:37.278 [19/722] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.549 [20/722] Generating lib/argparse.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.808 [21/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:37.809 [22/722] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.809 [23/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:37.809 [24/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:37.809 [25/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:37.809 [26/722] Linking target lib/librte_log.so.24.2 00:01:37.809 [27/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:37.809 [28/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:37.809 [29/722] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:37.809 [30/722] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:37.809 [31/722] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:37.809 [32/722] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:37.809 [33/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:37.809 [34/722] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:37.809 [35/722] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:38.071 [36/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:38.071 [37/722] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:38.071 [38/722] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:38.071 [39/722] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:38.071 [40/722] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:38.071 [41/722] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:38.071 [42/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:38.071 [43/722] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:38.071 [44/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:38.071 [45/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:38.071 [46/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:38.071 [47/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:38.071 [48/722] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:38.071 [49/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:38.071 [50/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:38.071 [51/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:38.071 [52/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:38.071 [53/722] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:38.071 [54/722] Generating symbol file lib/librte_log.so.24.2.p/librte_log.so.24.2.symbols 00:01:38.071 [55/722] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:38.071 [56/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:38.071 [57/722] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:38.071 [58/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:38.071 [59/722] Linking target lib/librte_kvargs.so.24.2 00:01:38.071 [60/722] Linking target lib/librte_argparse.so.24.2 00:01:38.071 [61/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:38.335 [62/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:38.335 [63/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:38.335 [64/722] Generating symbol file lib/librte_kvargs.so.24.2.p/librte_kvargs.so.24.2.symbols 00:01:38.596 [65/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:38.596 [66/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:38.596 [67/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:38.596 [68/722] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:38.596 [69/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:38.596 [70/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:38.858 [71/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:38.858 [72/722] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:38.858 [73/722] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:38.858 [74/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:38.858 [75/722] Linking static target lib/librte_pci.a 00:01:38.858 [76/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:39.125 [77/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:39.125 [78/722] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:39.125 [79/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:39.125 [80/722] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:39.125 [81/722] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:39.125 [82/722] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:39.125 [83/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:39.125 [84/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:39.125 [85/722] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:39.125 [86/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:39.125 [87/722] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:39.386 [88/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:39.386 [89/722] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:39.386 [90/722] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.386 [91/722] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:39.386 [92/722] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:39.386 [93/722] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:39.386 [94/722] Linking static target lib/librte_ring.a 00:01:39.386 [95/722] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:39.386 [96/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:39.386 [97/722] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:39.386 [98/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:39.386 [99/722] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:39.386 [100/722] Linking static target lib/librte_meter.a 00:01:39.386 [101/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:39.386 [102/722] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:39.386 [103/722] Compiling C object lib/librte_hash.a.p/hash_rte_hash_crc.c.o 00:01:39.386 [104/722] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:39.386 [105/722] Linking static target lib/librte_telemetry.a 00:01:39.386 [106/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:39.386 [107/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:39.386 [108/722] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:39.386 [109/722] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:39.645 [110/722] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:39.645 [111/722] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:39.645 [112/722] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:39.645 [113/722] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:39.645 [114/722] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:39.645 [115/722] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.645 [116/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:39.906 [117/722] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.906 [118/722] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:39.906 [119/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:39.906 [120/722] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:39.906 [121/722] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:39.906 [122/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:39.906 [123/722] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:39.906 [124/722] Linking static target lib/librte_net.a 00:01:39.906 [125/722] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_linux_ethtool.c.o 00:01:39.906 [126/722] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:40.172 [127/722] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.172 [128/722] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:40.172 [129/722] Linking static target lib/librte_mempool.a 00:01:40.172 [130/722] Linking target lib/librte_telemetry.so.24.2 00:01:40.172 [131/722] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:40.172 [132/722] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:40.172 [133/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:40.172 [134/722] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:40.172 [135/722] Linking static target lib/librte_eal.a 00:01:40.172 [136/722] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.172 [137/722] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:40.432 [138/722] Linking static target lib/librte_cmdline.a 00:01:40.432 [139/722] Generating symbol file lib/librte_telemetry.so.24.2.p/librte_telemetry.so.24.2.symbols 00:01:40.432 [140/722] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:40.432 [141/722] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:40.432 [142/722] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:40.432 [143/722] Linking static target lib/librte_cfgfile.a 00:01:40.432 [144/722] Compiling C object lib/librte_hash.a.p/hash_rte_thash_gfni.c.o 00:01:40.432 [145/722] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:40.432 [146/722] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:40.432 [147/722] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:40.432 [148/722] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:40.432 [149/722] Linking static target lib/librte_metrics.a 00:01:40.693 [150/722] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:40.693 [151/722] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:40.693 [152/722] Linking static target lib/librte_rcu.a 00:01:40.693 [153/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:40.693 [154/722] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:40.960 [155/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:40.960 [156/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:40.960 [157/722] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:40.960 [158/722] Linking static target lib/librte_bitratestats.a 00:01:40.960 [159/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:40.960 [160/722] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.960 [161/722] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:40.960 [162/722] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:41.221 [163/722] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.221 [164/722] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.221 [165/722] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:41.221 [166/722] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.221 [167/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:41.221 [168/722] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:41.221 [169/722] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:41.221 [170/722] Linking static target lib/librte_timer.a 00:01:41.221 [171/722] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.487 [172/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:41.487 [173/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:41.487 [174/722] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:41.487 [175/722] Linking static target lib/librte_bbdev.a 00:01:41.487 [176/722] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:41.487 [177/722] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:41.487 [178/722] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:41.487 [179/722] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.487 [180/722] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:41.751 [181/722] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:41.751 [182/722] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.751 [183/722] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:41.751 [184/722] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:41.751 [185/722] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:42.013 [186/722] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:42.013 [187/722] Linking static target lib/librte_compressdev.a 00:01:42.013 [188/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:42.276 [189/722] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:42.277 [190/722] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:42.277 [191/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:42.277 [192/722] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:42.277 [193/722] Linking static target lib/librte_distributor.a 00:01:42.542 [194/722] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.542 [195/722] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:42.542 [196/722] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:42.542 [197/722] Linking static target lib/librte_dmadev.a 00:01:42.542 [198/722] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:42.542 [199/722] Linking static target lib/librte_bpf.a 00:01:42.542 [200/722] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:42.542 [201/722] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:42.542 [202/722] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.542 [203/722] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:42.807 [204/722] Linking static target lib/librte_dispatcher.a 00:01:42.807 [205/722] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.807 [206/722] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:42.807 [207/722] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:42.807 [208/722] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:42.807 [209/722] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:42.807 [210/722] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:42.807 [211/722] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:42.807 [212/722] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:42.807 [213/722] Linking static target lib/librte_gpudev.a 00:01:42.807 [214/722] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:42.807 [215/722] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:42.807 [216/722] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:42.807 [217/722] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:42.807 [218/722] Linking static target lib/librte_gro.a 00:01:42.807 [219/722] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:43.065 [220/722] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:43.065 [221/722] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:43.065 [222/722] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.065 [223/722] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:43.065 [224/722] Linking static target lib/librte_jobstats.a 00:01:43.065 [225/722] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:43.327 [226/722] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:43.327 [227/722] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.327 [228/722] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.327 [229/722] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:43.327 [230/722] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.327 [231/722] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:43.592 [232/722] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.592 [233/722] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:43.592 [234/722] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:43.592 [235/722] Linking static target lib/librte_latencystats.a 00:01:43.592 [236/722] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:43.592 [237/722] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:43.592 [238/722] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:43.592 [239/722] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:43.856 [240/722] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:43.856 [241/722] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:43.856 [242/722] Linking static target lib/librte_ip_frag.a 00:01:43.856 [243/722] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:43.856 [244/722] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:43.856 [245/722] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:44.118 [246/722] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.118 [247/722] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:44.118 [248/722] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:44.118 [249/722] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.118 [250/722] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:44.118 [251/722] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:44.386 [252/722] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:44.386 [253/722] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.386 [254/722] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:44.386 [255/722] Linking static target lib/librte_gso.a 00:01:44.386 [256/722] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:44.650 [257/722] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:44.650 [258/722] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:44.650 [259/722] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:44.650 [260/722] Linking static target lib/librte_regexdev.a 00:01:44.650 [261/722] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:44.650 [262/722] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:44.650 [263/722] Linking static target lib/librte_efd.a 00:01:44.650 [264/722] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:44.650 [265/722] Linking static target lib/librte_rawdev.a 00:01:44.650 [266/722] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:44.650 [267/722] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:44.912 [268/722] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.912 [269/722] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:44.912 [270/722] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:44.912 [271/722] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:44.912 [272/722] Linking static target lib/librte_pcapng.a 00:01:44.912 [273/722] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:44.912 [274/722] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:44.912 [275/722] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:44.912 [276/722] Linking static target lib/librte_mldev.a 00:01:45.176 [277/722] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.176 [278/722] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:45.176 [279/722] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:45.176 [280/722] Linking static target lib/librte_stack.a 00:01:45.176 [281/722] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:45.176 [282/722] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:45.176 [283/722] Linking static target lib/librte_lpm.a 00:01:45.176 [284/722] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:45.176 [285/722] Linking static target lib/acl/libavx2_tmp.a 00:01:45.176 [286/722] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:45.176 [287/722] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:45.176 [288/722] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:45.441 [289/722] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:45.441 [290/722] Linking static target lib/librte_hash.a 00:01:45.441 [291/722] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.441 [292/722] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.441 [293/722] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:45.441 [294/722] Linking static target lib/librte_reorder.a 00:01:45.441 [295/722] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.441 [296/722] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:45.441 [297/722] Compiling C object lib/librte_port.a.p/port_port_log.c.o 00:01:45.441 [298/722] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:45.706 [299/722] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:45.706 [300/722] Linking static target lib/acl/libavx512_tmp.a 00:01:45.706 [301/722] Linking static target lib/librte_acl.a 00:01:45.706 [302/722] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:45.706 [303/722] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:45.706 [304/722] Linking static target lib/librte_power.a 00:01:45.706 [305/722] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:45.706 [306/722] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.706 [307/722] Linking static target lib/librte_security.a 00:01:45.706 [308/722] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.969 [309/722] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:45.969 [310/722] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.969 [311/722] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:45.969 [312/722] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:45.969 [313/722] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:46.232 [314/722] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.233 [315/722] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:46.233 [316/722] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:46.233 [317/722] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:46.233 [318/722] Linking static target lib/librte_rib.a 00:01:46.233 [319/722] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:46.233 [320/722] Linking static target lib/librte_mbuf.a 00:01:46.233 [321/722] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:46.233 [322/722] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:46.233 [323/722] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:46.233 [324/722] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:46.233 [325/722] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.495 [326/722] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.495 [327/722] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:46.495 [328/722] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:46.495 [329/722] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:46.495 [330/722] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:46.495 [331/722] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:46.495 [332/722] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:46.495 [333/722] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:46.754 [334/722] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.754 [335/722] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:46.754 [336/722] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.754 [337/722] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:47.020 [338/722] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:47.020 [339/722] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:47.020 [340/722] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.020 [341/722] Compiling C object lib/librte_table.a.p/table_table_log.c.o 00:01:47.020 [342/722] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:47.283 [343/722] Linking static target lib/librte_eventdev.a 00:01:47.283 [344/722] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.552 [345/722] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:47.552 [346/722] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:47.552 [347/722] Linking static target lib/librte_member.a 00:01:47.553 [348/722] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:47.553 [349/722] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:47.553 [350/722] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:47.553 [351/722] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:47.553 [352/722] Linking static target lib/librte_ethdev.a 00:01:47.814 [353/722] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:47.814 [354/722] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:47.814 [355/722] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:47.814 [356/722] Linking static target lib/librte_cryptodev.a 00:01:47.814 [357/722] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:47.814 [358/722] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:47.814 [359/722] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:47.814 [360/722] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:47.814 [361/722] Linking static target lib/librte_sched.a 00:01:47.814 [362/722] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:47.814 [363/722] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:47.814 [364/722] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:47.814 [365/722] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:47.814 [366/722] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:47.814 [367/722] Linking static target lib/librte_fib.a 00:01:48.076 [368/722] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.076 [369/722] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:48.076 [370/722] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:48.076 [371/722] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:48.076 [372/722] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:48.076 [373/722] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:48.337 [374/722] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:48.337 [375/722] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:48.337 [376/722] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:48.337 [377/722] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.337 [378/722] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:48.337 [379/722] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.602 [380/722] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:48.602 [381/722] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:48.602 [382/722] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:48.870 [383/722] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:48.870 [384/722] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:48.870 [385/722] Linking static target lib/librte_pdump.a 00:01:48.870 [386/722] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:48.870 [387/722] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:48.870 [388/722] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:48.870 [389/722] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:48.870 [390/722] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:49.129 [391/722] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:49.129 [392/722] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:49.129 [393/722] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:49.130 [394/722] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:49.130 [395/722] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:49.130 [396/722] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:49.130 [397/722] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:49.130 [398/722] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:49.130 [399/722] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.394 [400/722] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:49.394 [401/722] Linking static target lib/librte_ipsec.a 00:01:49.394 [402/722] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:49.394 [403/722] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:49.394 [404/722] Linking static target lib/librte_table.a 00:01:49.656 [405/722] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:49.656 [406/722] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:49.656 [407/722] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.656 [408/722] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:49.915 [409/722] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:49.915 [410/722] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.915 [411/722] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:50.180 [412/722] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:50.180 [413/722] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:50.180 [414/722] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:50.460 [415/722] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:50.460 [416/722] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:50.460 [417/722] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:50.460 [418/722] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:50.460 [419/722] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:50.460 [420/722] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:50.460 [421/722] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:50.460 [422/722] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.460 [423/722] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:50.734 [424/722] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.734 [425/722] Generating app/graph/commands_hdr with a custom command (wrapped by meson to capture output) 00:01:50.734 [426/722] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:50.734 [427/722] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:50.734 [428/722] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:50.734 [429/722] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:50.996 [430/722] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:50.996 [431/722] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:50.996 [432/722] Linking static target drivers/librte_bus_vdev.a 00:01:50.996 [433/722] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:50.996 [434/722] Compiling C object drivers/librte_bus_vdev.so.24.2.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:50.996 [435/722] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:50.996 [436/722] Linking static target lib/librte_port.a 00:01:51.274 [437/722] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:51.274 [438/722] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:51.274 [439/722] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.274 [440/722] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:51.274 [441/722] Linking static target drivers/librte_bus_pci.a 00:01:51.274 [442/722] Linking static target lib/librte_graph.a 00:01:51.274 [443/722] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.274 [444/722] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:51.274 [445/722] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:51.538 [446/722] Compiling C object drivers/librte_bus_pci.so.24.2.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.538 [447/722] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:51.538 [448/722] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.538 [449/722] Linking target lib/librte_eal.so.24.2 00:01:51.538 [450/722] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:51.538 [451/722] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:51.799 [452/722] Generating symbol file lib/librte_eal.so.24.2.p/librte_eal.so.24.2.symbols 00:01:51.799 [453/722] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.799 [454/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:52.062 [455/722] Linking target lib/librte_ring.so.24.2 00:01:52.062 [456/722] Linking target lib/librte_meter.so.24.2 00:01:52.062 [457/722] Linking target lib/librte_pci.so.24.2 00:01:52.062 [458/722] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:52.062 [459/722] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:52.062 [460/722] Linking target lib/librte_timer.so.24.2 00:01:52.062 [461/722] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:52.062 [462/722] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:52.062 [463/722] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.062 [464/722] Linking target lib/librte_acl.so.24.2 00:01:52.062 [465/722] Linking target lib/librte_cfgfile.so.24.2 00:01:52.062 [466/722] Linking target lib/librte_dmadev.so.24.2 00:01:52.062 [467/722] Linking target lib/librte_jobstats.so.24.2 00:01:52.324 [468/722] Generating symbol file lib/librte_pci.so.24.2.p/librte_pci.so.24.2.symbols 00:01:52.324 [469/722] Generating symbol file lib/librte_ring.so.24.2.p/librte_ring.so.24.2.symbols 00:01:52.324 [470/722] Generating symbol file lib/librte_meter.so.24.2.p/librte_meter.so.24.2.symbols 00:01:52.324 [471/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:52.324 [472/722] Linking target lib/librte_rawdev.so.24.2 00:01:52.324 [473/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:52.324 [474/722] Linking target lib/librte_stack.so.24.2 00:01:52.324 [475/722] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:52.324 [476/722] Linking static target drivers/librte_mempool_ring.a 00:01:52.324 [477/722] Compiling C object drivers/librte_mempool_ring.so.24.2.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:52.324 [478/722] Linking target lib/librte_rcu.so.24.2 00:01:52.324 [479/722] Linking target drivers/librte_bus_pci.so.24.2 00:01:52.324 [480/722] Linking target drivers/librte_bus_vdev.so.24.2 00:01:52.324 [481/722] Linking target lib/librte_mempool.so.24.2 00:01:52.324 [482/722] Generating symbol file lib/librte_timer.so.24.2.p/librte_timer.so.24.2.symbols 00:01:52.324 [483/722] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.324 [484/722] Generating symbol file lib/librte_acl.so.24.2.p/librte_acl.so.24.2.symbols 00:01:52.324 [485/722] Generating symbol file lib/librte_dmadev.so.24.2.p/librte_dmadev.so.24.2.symbols 00:01:52.584 [486/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:52.584 [487/722] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:52.584 [488/722] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:52.584 [489/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:52.584 [490/722] Generating symbol file drivers/librte_bus_pci.so.24.2.p/librte_bus_pci.so.24.2.symbols 00:01:52.584 [491/722] Generating symbol file drivers/librte_bus_vdev.so.24.2.p/librte_bus_vdev.so.24.2.symbols 00:01:52.584 [492/722] Generating symbol file lib/librte_rcu.so.24.2.p/librte_rcu.so.24.2.symbols 00:01:52.584 [493/722] Generating symbol file lib/librte_mempool.so.24.2.p/librte_mempool.so.24.2.symbols 00:01:52.584 [494/722] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:52.584 [495/722] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:52.584 [496/722] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:52.584 [497/722] Linking target lib/librte_mbuf.so.24.2 00:01:52.584 [498/722] Linking target lib/librte_rib.so.24.2 00:01:52.584 [499/722] Linking target drivers/librte_mempool_ring.so.24.2 00:01:52.843 [500/722] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:52.843 [501/722] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:52.843 [502/722] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:52.843 [503/722] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:52.843 [504/722] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:52.843 [505/722] Compiling C object app/dpdk-graph.p/graph_l2fwd.c.o 00:01:52.843 [506/722] Generating symbol file lib/librte_mbuf.so.24.2.p/librte_mbuf.so.24.2.symbols 00:01:52.843 [507/722] Generating symbol file lib/librte_rib.so.24.2.p/librte_rib.so.24.2.symbols 00:01:52.843 [508/722] Linking target lib/librte_net.so.24.2 00:01:52.843 [509/722] Linking target lib/librte_bbdev.so.24.2 00:01:53.106 [510/722] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:53.106 [511/722] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:53.106 [512/722] Linking target lib/librte_compressdev.so.24.2 00:01:53.106 [513/722] Linking target lib/librte_cryptodev.so.24.2 00:01:53.106 [514/722] Linking target lib/librte_distributor.so.24.2 00:01:53.106 [515/722] Linking target lib/librte_gpudev.so.24.2 00:01:53.106 [516/722] Generating symbol file lib/librte_net.so.24.2.p/librte_net.so.24.2.symbols 00:01:53.106 [517/722] Linking target lib/librte_regexdev.so.24.2 00:01:53.106 [518/722] Linking target lib/librte_mldev.so.24.2 00:01:53.372 [519/722] Linking target lib/librte_reorder.so.24.2 00:01:53.372 [520/722] Linking target lib/librte_cmdline.so.24.2 00:01:53.372 [521/722] Linking target lib/librte_hash.so.24.2 00:01:53.372 [522/722] Generating symbol file lib/librte_cryptodev.so.24.2.p/librte_cryptodev.so.24.2.symbols 00:01:53.372 [523/722] Linking target lib/librte_sched.so.24.2 00:01:53.372 [524/722] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:53.372 [525/722] Linking target lib/librte_security.so.24.2 00:01:53.372 [526/722] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:53.372 [527/722] Linking target lib/librte_fib.so.24.2 00:01:53.372 [528/722] Generating symbol file lib/librte_reorder.so.24.2.p/librte_reorder.so.24.2.symbols 00:01:53.372 [529/722] Generating symbol file lib/librte_hash.so.24.2.p/librte_hash.so.24.2.symbols 00:01:53.631 [530/722] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:53.631 [531/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:53.631 [532/722] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:53.631 [533/722] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:53.631 [534/722] Linking target lib/librte_efd.so.24.2 00:01:53.631 [535/722] Generating symbol file lib/librte_sched.so.24.2.p/librte_sched.so.24.2.symbols 00:01:53.631 [536/722] Linking target lib/librte_lpm.so.24.2 00:01:53.631 [537/722] Linking target lib/librte_member.so.24.2 00:01:53.631 [538/722] Generating symbol file lib/librte_security.so.24.2.p/librte_security.so.24.2.symbols 00:01:53.631 [539/722] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:53.631 [540/722] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:53.631 [541/722] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:53.631 [542/722] Linking target lib/librte_ipsec.so.24.2 00:01:53.893 [543/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:53.893 [544/722] Generating symbol file lib/librte_lpm.so.24.2.p/librte_lpm.so.24.2.symbols 00:01:53.893 [545/722] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:53.893 [546/722] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:53.893 [547/722] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:53.893 [548/722] Generating symbol file lib/librte_ipsec.so.24.2.p/librte_ipsec.so.24.2.symbols 00:01:53.893 [549/722] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:53.893 [550/722] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:54.158 [551/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:54.158 [552/722] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:54.158 [553/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:54.158 [554/722] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:54.158 [555/722] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:54.736 [556/722] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:54.736 [557/722] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:54.736 [558/722] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:54.736 [559/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:54.736 [560/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:54.736 [561/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:54.736 [562/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:55.002 [563/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:55.002 [564/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:55.002 [565/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:55.002 [566/722] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:55.265 [567/722] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:55.265 [568/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:55.265 [569/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:55.265 [570/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:55.527 [571/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:55.527 [572/722] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:55.791 [573/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:56.053 [574/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:56.053 [575/722] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:56.053 [576/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:56.053 [577/722] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:56.053 [578/722] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:56.053 [579/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:56.053 [580/722] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.316 [581/722] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:56.316 [582/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:56.316 [583/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:56.316 [584/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:56.316 [585/722] Linking target lib/librte_ethdev.so.24.2 00:01:56.580 [586/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:56.580 [587/722] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:56.580 [588/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:56.580 [589/722] Linking static target lib/librte_pdcp.a 00:01:56.580 [590/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:56.580 [591/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:56.580 [592/722] Generating symbol file lib/librte_ethdev.so.24.2.p/librte_ethdev.so.24.2.symbols 00:01:56.580 [593/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:56.580 [594/722] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:56.580 [595/722] Linking target lib/librte_metrics.so.24.2 00:01:56.580 [596/722] Linking target lib/librte_bpf.so.24.2 00:01:56.580 [597/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:56.580 [598/722] Linking target lib/librte_eventdev.so.24.2 00:01:56.842 [599/722] Linking target lib/librte_gro.so.24.2 00:01:56.842 [600/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:56.842 [601/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:56.842 [602/722] Linking target lib/librte_gso.so.24.2 00:01:56.842 [603/722] Linking target lib/librte_ip_frag.so.24.2 00:01:56.842 [604/722] Generating symbol file lib/librte_metrics.so.24.2.p/librte_metrics.so.24.2.symbols 00:01:56.842 [605/722] Generating symbol file lib/librte_bpf.so.24.2.p/librte_bpf.so.24.2.symbols 00:01:56.842 [606/722] Linking target lib/librte_pcapng.so.24.2 00:01:56.842 [607/722] Generating symbol file lib/librte_eventdev.so.24.2.p/librte_eventdev.so.24.2.symbols 00:01:56.842 [608/722] Linking target lib/librte_power.so.24.2 00:01:57.104 [609/722] Linking target lib/librte_bitratestats.so.24.2 00:01:57.104 [610/722] Linking target lib/librte_latencystats.so.24.2 00:01:57.104 [611/722] Linking target lib/librte_dispatcher.so.24.2 00:01:57.104 [612/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:57.104 [613/722] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.104 [614/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:57.104 [615/722] Generating symbol file lib/librte_ip_frag.so.24.2.p/librte_ip_frag.so.24.2.symbols 00:01:57.104 [616/722] Generating symbol file lib/librte_pcapng.so.24.2.p/librte_pcapng.so.24.2.symbols 00:01:57.104 [617/722] Linking target lib/librte_pdcp.so.24.2 00:01:57.366 [618/722] Linking target lib/librte_pdump.so.24.2 00:01:57.366 [619/722] Linking target lib/librte_graph.so.24.2 00:01:57.366 [620/722] Linking target lib/librte_port.so.24.2 00:01:57.366 [621/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:57.366 [622/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:01:57.366 [623/722] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:57.366 [624/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:57.366 [625/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:57.366 [626/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:57.366 [627/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:57.366 [628/722] Generating symbol file lib/librte_graph.so.24.2.p/librte_graph.so.24.2.symbols 00:01:57.366 [629/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:57.627 [630/722] Generating symbol file lib/librte_port.so.24.2.p/librte_port.so.24.2.symbols 00:01:57.627 [631/722] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:57.627 [632/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:57.627 [633/722] Linking target lib/librte_table.so.24.2 00:01:57.627 [634/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:57.890 [635/722] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:01:57.890 [636/722] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:57.890 [637/722] Generating symbol file lib/librte_table.so.24.2.p/librte_table.so.24.2.symbols 00:01:57.890 [638/722] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:57.890 [639/722] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:58.150 [640/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:58.150 [641/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:58.409 [642/722] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:58.409 [643/722] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:58.409 [644/722] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:58.409 [645/722] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:58.668 [646/722] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:58.668 [647/722] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:58.668 [648/722] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:58.668 [649/722] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:58.668 [650/722] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:58.668 [651/722] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:01:58.668 [652/722] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:58.668 [653/722] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:58.927 [654/722] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:58.927 [655/722] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:59.186 [656/722] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:59.186 [657/722] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:59.186 [658/722] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:59.186 [659/722] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:59.445 [660/722] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:59.445 [661/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:59.445 [662/722] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:59.445 [663/722] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:59.703 [664/722] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:59.703 [665/722] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:59.703 [666/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:59.703 [667/722] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:59.703 [668/722] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:59.961 [669/722] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:59.961 [670/722] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:59.961 [671/722] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:59.961 [672/722] Compiling C object drivers/librte_net_i40e.so.24.2.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:59.961 [673/722] Linking static target drivers/librte_net_i40e.a 00:01:59.961 [674/722] Compiling C object app/dpdk-test-security-perf.p/test_test_security_proto.c.o 00:02:00.219 [675/722] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:02:00.219 [676/722] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:02:00.477 [677/722] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:00.736 [678/722] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.736 [679/722] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:00.736 [680/722] Linking target drivers/librte_net_i40e.so.24.2 00:02:00.736 [681/722] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:00.995 [682/722] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:01.253 [683/722] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:01.511 [684/722] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:01.511 [685/722] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:02:01.511 [686/722] Linking static target lib/librte_node.a 00:02:01.769 [687/722] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.035 [688/722] Linking target lib/librte_node.so.24.2 00:02:03.411 [689/722] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:02:03.411 [690/722] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:02:03.411 [691/722] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:04.786 [692/722] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:05.352 [693/722] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:13.525 [694/722] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:40.051 [695/722] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:40.051 [696/722] Linking static target lib/librte_vhost.a 00:02:40.987 [697/722] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:40.987 [698/722] Linking target lib/librte_vhost.so.24.2 00:02:55.894 [699/722] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:55.894 [700/722] Linking static target lib/librte_pipeline.a 00:02:55.894 [701/722] Linking target app/dpdk-proc-info 00:02:55.894 [702/722] Linking target app/dpdk-dumpcap 00:02:55.894 [703/722] Linking target app/dpdk-pdump 00:02:55.894 [704/722] Linking target app/dpdk-test-acl 00:02:55.894 [705/722] Linking target app/dpdk-test-dma-perf 00:02:55.894 [706/722] Linking target app/dpdk-test-flow-perf 00:02:55.894 [707/722] Linking target app/dpdk-test-gpudev 00:02:55.894 [708/722] Linking target app/dpdk-test-cmdline 00:02:55.894 [709/722] Linking target app/dpdk-test-sad 00:02:55.894 [710/722] Linking target app/dpdk-test-fib 00:02:55.894 [711/722] Linking target app/dpdk-test-regex 00:02:55.894 [712/722] Linking target app/dpdk-test-compress-perf 00:02:55.894 [713/722] Linking target app/dpdk-test-security-perf 00:02:55.894 [714/722] Linking target app/dpdk-graph 00:02:55.894 [715/722] Linking target app/dpdk-test-pipeline 00:02:55.894 [716/722] Linking target app/dpdk-test-mldev 00:02:55.894 [717/722] Linking target app/dpdk-test-bbdev 00:02:55.894 [718/722] Linking target app/dpdk-test-crypto-perf 00:02:55.894 [719/722] Linking target app/dpdk-test-eventdev 00:02:55.894 [720/722] Linking target app/dpdk-testpmd 00:02:56.830 [721/722] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:56.830 [722/722] Linking target lib/librte_pipeline.so.24.2 00:02:56.830 04:47:35 -- common/autobuild_common.sh@187 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:56.830 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:56.830 [0/1] Installing files. 00:02:57.092 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:57.092 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.092 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:57.093 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:57.094 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:57.095 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.096 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:57.097 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.098 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipv6_addr_swap.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipv6_addr_swap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:57.359 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:57.360 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:57.360 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:57.360 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:57.360 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:57.360 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:57.360 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:57.360 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_log.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_kvargs.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_argparse.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_argparse.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_telemetry.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_eal.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_ring.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_rcu.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_mempool.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_mbuf.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_net.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_meter.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_ethdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_pci.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_cmdline.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_metrics.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_hash.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_timer.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_acl.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_bbdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_bitratestats.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_bpf.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_cfgfile.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_compressdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_cryptodev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_distributor.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_dmadev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_efd.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_eventdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_dispatcher.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_gpudev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_gro.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_gso.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_ip_frag.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_jobstats.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_latencystats.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_lpm.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_member.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_pcapng.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_power.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.360 Installing lib/librte_rawdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_regexdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_mldev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_rib.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_reorder.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_sched.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.934 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_security.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_stack.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_vhost.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_ipsec.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_pdcp.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_fib.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_port.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_pdump.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_table.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_pipeline.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_graph.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing lib/librte_node.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing drivers/librte_bus_pci.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2 00:02:57.935 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing drivers/librte_bus_vdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2 00:02:57.935 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing drivers/librte_mempool_ring.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2 00:02:57.935 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.935 Installing drivers/librte_net_i40e.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2 00:02:57.935 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/argparse/rte_argparse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.935 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.936 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.937 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.938 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:57.939 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:57.939 Installing symlink pointing to librte_log.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:02:57.939 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:02:57.939 Installing symlink pointing to librte_kvargs.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:02:57.939 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:57.939 Installing symlink pointing to librte_argparse.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_argparse.so.24 00:02:57.939 Installing symlink pointing to librte_argparse.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_argparse.so 00:02:57.939 Installing symlink pointing to librte_telemetry.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:02:57.939 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:57.939 Installing symlink pointing to librte_eal.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:02:57.939 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:57.939 Installing symlink pointing to librte_ring.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:02:57.939 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:57.939 Installing symlink pointing to librte_rcu.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:02:57.939 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:57.939 Installing symlink pointing to librte_mempool.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:02:57.939 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:57.939 Installing symlink pointing to librte_mbuf.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:02:57.939 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:57.939 Installing symlink pointing to librte_net.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:02:57.939 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:57.939 Installing symlink pointing to librte_meter.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:02:57.939 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:57.939 Installing symlink pointing to librte_ethdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:02:57.939 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:57.939 Installing symlink pointing to librte_pci.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:02:57.939 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:57.939 Installing symlink pointing to librte_cmdline.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:02:57.939 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:57.939 Installing symlink pointing to librte_metrics.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:02:57.939 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:57.939 Installing symlink pointing to librte_hash.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:02:57.939 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:57.939 Installing symlink pointing to librte_timer.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:02:57.939 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:57.939 Installing symlink pointing to librte_acl.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:02:57.939 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:57.939 Installing symlink pointing to librte_bbdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:02:57.939 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:57.939 Installing symlink pointing to librte_bitratestats.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:02:57.939 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:57.939 Installing symlink pointing to librte_bpf.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:02:57.939 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:57.939 Installing symlink pointing to librte_cfgfile.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:02:57.939 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:57.940 Installing symlink pointing to librte_compressdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:02:57.940 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:57.940 Installing symlink pointing to librte_cryptodev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:02:57.940 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:57.940 Installing symlink pointing to librte_distributor.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:02:57.940 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:57.940 Installing symlink pointing to librte_dmadev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:02:57.940 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:57.940 Installing symlink pointing to librte_efd.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:02:57.940 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:57.940 Installing symlink pointing to librte_eventdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:02:57.940 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:57.940 Installing symlink pointing to librte_dispatcher.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:02:57.940 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:02:57.940 Installing symlink pointing to librte_gpudev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:02:57.940 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:57.940 Installing symlink pointing to librte_gro.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:02:57.940 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:57.940 Installing symlink pointing to librte_gso.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:02:57.940 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:57.940 Installing symlink pointing to librte_ip_frag.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:02:57.940 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:58.199 './librte_bus_pci.so' -> 'dpdk/pmds-24.2/librte_bus_pci.so' 00:02:58.199 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.2/librte_bus_pci.so.24' 00:02:58.199 './librte_bus_pci.so.24.2' -> 'dpdk/pmds-24.2/librte_bus_pci.so.24.2' 00:02:58.199 './librte_bus_vdev.so' -> 'dpdk/pmds-24.2/librte_bus_vdev.so' 00:02:58.199 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.2/librte_bus_vdev.so.24' 00:02:58.199 './librte_bus_vdev.so.24.2' -> 'dpdk/pmds-24.2/librte_bus_vdev.so.24.2' 00:02:58.199 './librte_mempool_ring.so' -> 'dpdk/pmds-24.2/librte_mempool_ring.so' 00:02:58.199 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.2/librte_mempool_ring.so.24' 00:02:58.199 './librte_mempool_ring.so.24.2' -> 'dpdk/pmds-24.2/librte_mempool_ring.so.24.2' 00:02:58.199 './librte_net_i40e.so' -> 'dpdk/pmds-24.2/librte_net_i40e.so' 00:02:58.199 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.2/librte_net_i40e.so.24' 00:02:58.199 './librte_net_i40e.so.24.2' -> 'dpdk/pmds-24.2/librte_net_i40e.so.24.2' 00:02:58.199 Installing symlink pointing to librte_jobstats.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:02:58.199 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:58.199 Installing symlink pointing to librte_latencystats.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:02:58.199 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:58.199 Installing symlink pointing to librte_lpm.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:02:58.199 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:58.199 Installing symlink pointing to librte_member.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:02:58.199 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:58.199 Installing symlink pointing to librte_pcapng.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:02:58.199 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:58.199 Installing symlink pointing to librte_power.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:02:58.199 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:58.199 Installing symlink pointing to librte_rawdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:02:58.199 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:58.199 Installing symlink pointing to librte_regexdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:02:58.199 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:58.200 Installing symlink pointing to librte_mldev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:02:58.200 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:02:58.200 Installing symlink pointing to librte_rib.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:02:58.200 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:58.200 Installing symlink pointing to librte_reorder.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:02:58.200 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:58.200 Installing symlink pointing to librte_sched.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:02:58.200 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:58.200 Installing symlink pointing to librte_security.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:02:58.200 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:58.200 Installing symlink pointing to librte_stack.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:02:58.200 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:58.200 Installing symlink pointing to librte_vhost.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:02:58.200 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:58.200 Installing symlink pointing to librte_ipsec.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:02:58.200 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:58.200 Installing symlink pointing to librte_pdcp.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:02:58.200 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:02:58.200 Installing symlink pointing to librte_fib.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:02:58.200 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:58.200 Installing symlink pointing to librte_port.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:02:58.200 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:58.200 Installing symlink pointing to librte_pdump.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:02:58.200 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:58.200 Installing symlink pointing to librte_table.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:02:58.200 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:58.200 Installing symlink pointing to librte_pipeline.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:02:58.200 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:58.200 Installing symlink pointing to librte_graph.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:02:58.200 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:58.200 Installing symlink pointing to librte_node.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:02:58.200 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:58.200 Installing symlink pointing to librte_bus_pci.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_pci.so.24 00:02:58.200 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_pci.so 00:02:58.200 Installing symlink pointing to librte_bus_vdev.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_vdev.so.24 00:02:58.200 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_vdev.so 00:02:58.200 Installing symlink pointing to librte_mempool_ring.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_mempool_ring.so.24 00:02:58.200 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_mempool_ring.so 00:02:58.200 Installing symlink pointing to librte_net_i40e.so.24.2 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_net_i40e.so.24 00:02:58.200 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_net_i40e.so 00:02:58.200 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.2' 00:02:58.200 04:47:37 -- common/autobuild_common.sh@189 -- $ uname -s 00:02:58.200 04:47:37 -- common/autobuild_common.sh@189 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:58.200 04:47:37 -- common/autobuild_common.sh@200 -- $ cat 00:02:58.200 04:47:37 -- common/autobuild_common.sh@205 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:58.200 00:02:58.200 real 1m27.104s 00:02:58.200 user 18m16.379s 00:02:58.200 sys 2m9.370s 00:02:58.200 04:47:37 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:02:58.200 04:47:37 -- common/autotest_common.sh@10 -- $ set +x 00:02:58.200 ************************************ 00:02:58.200 END TEST build_native_dpdk 00:02:58.200 ************************************ 00:02:58.200 04:47:37 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:58.200 04:47:37 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:58.200 04:47:37 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:58.200 04:47:37 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:58.200 04:47:37 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:58.200 04:47:37 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:58.200 04:47:37 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:58.200 04:47:37 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:58.200 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:58.200 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:58.200 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:58.460 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:58.720 Using 'verbs' RDMA provider 00:03:09.277 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.spdk-isal.log)...done. 00:03:19.254 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:03:19.254 Creating mk/config.mk...done. 00:03:19.254 Creating mk/cc.flags.mk...done. 00:03:19.254 Type 'make' to build. 00:03:19.254 04:47:56 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:19.254 04:47:56 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:19.254 04:47:56 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:19.254 04:47:56 -- common/autotest_common.sh@10 -- $ set +x 00:03:19.254 ************************************ 00:03:19.254 START TEST make 00:03:19.254 ************************************ 00:03:19.254 04:47:57 -- common/autotest_common.sh@1111 -- $ make -j48 00:03:19.254 make[1]: Nothing to be done for 'all'. 00:03:19.834 The Meson build system 00:03:19.834 Version: 1.3.1 00:03:19.834 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:19.834 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:19.834 Build type: native build 00:03:19.834 Project name: libvfio-user 00:03:19.834 Project version: 0.0.1 00:03:19.834 C compiler for the host machine: gcc (gcc 13.2.1 "gcc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:03:19.834 C linker for the host machine: gcc ld.bfd 2.39-16 00:03:19.834 Host machine cpu family: x86_64 00:03:19.834 Host machine cpu: x86_64 00:03:19.834 Run-time dependency threads found: YES 00:03:19.834 Library dl found: YES 00:03:19.834 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:03:19.834 Run-time dependency json-c found: YES 0.17 00:03:19.834 Run-time dependency cmocka found: YES 1.1.7 00:03:19.834 Program pytest-3 found: NO 00:03:19.834 Program flake8 found: NO 00:03:19.834 Program misspell-fixer found: NO 00:03:19.834 Program restructuredtext-lint found: NO 00:03:19.834 Program valgrind found: YES (/usr/bin/valgrind) 00:03:19.834 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:19.834 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:19.834 Compiler for C supports arguments -Wwrite-strings: YES 00:03:19.834 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:19.834 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:19.834 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:19.834 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:19.834 Build targets in project: 8 00:03:19.834 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:19.834 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:19.834 00:03:19.834 libvfio-user 0.0.1 00:03:19.834 00:03:19.834 User defined options 00:03:19.834 buildtype : debug 00:03:19.835 default_library: shared 00:03:19.835 libdir : /usr/local/lib 00:03:19.835 00:03:19.835 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:20.409 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:20.671 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:20.671 [2/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:20.671 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:20.671 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:20.671 [5/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:20.931 [6/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:20.931 [7/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:20.931 [8/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:20.931 [9/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:20.931 [10/37] Compiling C object samples/null.p/null.c.o 00:03:20.931 [11/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:20.931 [12/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:20.931 [13/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:20.931 [14/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:20.931 [15/37] Compiling C object samples/server.p/server.c.o 00:03:20.931 [16/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:20.931 [17/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:20.931 [18/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:20.931 [19/37] Compiling C object samples/client.p/client.c.o 00:03:20.931 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:20.931 [21/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:20.931 [22/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:20.931 [23/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:20.931 [24/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:20.931 [25/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:20.931 [26/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:20.931 [27/37] Linking target samples/client 00:03:21.192 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:21.192 [29/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:21.192 [30/37] Linking target lib/libvfio-user.so.0.0.1 00:03:21.192 [31/37] Linking target test/unit_tests 00:03:21.456 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:21.456 [33/37] Linking target samples/server 00:03:21.456 [34/37] Linking target samples/lspci 00:03:21.456 [35/37] Linking target samples/gpio-pci-idio-16 00:03:21.456 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:21.456 [37/37] Linking target samples/null 00:03:21.456 INFO: autodetecting backend as ninja 00:03:21.456 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:21.456 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:22.404 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:22.404 ninja: no work to do. 00:03:34.598 CC lib/log/log.o 00:03:34.598 CC lib/log/log_flags.o 00:03:34.598 CC lib/log/log_deprecated.o 00:03:34.598 CC lib/ut/ut.o 00:03:34.598 CC lib/ut_mock/mock.o 00:03:34.598 LIB libspdk_ut_mock.a 00:03:34.598 LIB libspdk_log.a 00:03:34.598 SO libspdk_ut_mock.so.6.0 00:03:34.598 LIB libspdk_ut.a 00:03:34.598 SO libspdk_log.so.7.0 00:03:34.598 SO libspdk_ut.so.2.0 00:03:34.598 SYMLINK libspdk_ut_mock.so 00:03:34.598 SYMLINK libspdk_ut.so 00:03:34.598 SYMLINK libspdk_log.so 00:03:34.598 CC lib/dma/dma.o 00:03:34.598 CC lib/util/base64.o 00:03:34.598 CC lib/ioat/ioat.o 00:03:34.598 CC lib/util/bit_array.o 00:03:34.598 CXX lib/trace_parser/trace.o 00:03:34.598 CC lib/util/cpuset.o 00:03:34.598 CC lib/util/crc16.o 00:03:34.598 CC lib/util/crc32.o 00:03:34.598 CC lib/util/crc32c.o 00:03:34.598 CC lib/util/crc32_ieee.o 00:03:34.598 CC lib/util/crc64.o 00:03:34.598 CC lib/util/dif.o 00:03:34.598 CC lib/util/fd.o 00:03:34.598 CC lib/util/file.o 00:03:34.598 CC lib/util/hexlify.o 00:03:34.598 CC lib/util/iov.o 00:03:34.598 CC lib/util/math.o 00:03:34.598 CC lib/util/pipe.o 00:03:34.598 CC lib/util/strerror_tls.o 00:03:34.598 CC lib/util/string.o 00:03:34.598 CC lib/util/uuid.o 00:03:34.598 CC lib/util/fd_group.o 00:03:34.598 CC lib/util/xor.o 00:03:34.598 CC lib/util/zipf.o 00:03:34.598 CC lib/vfio_user/host/vfio_user_pci.o 00:03:34.598 CC lib/vfio_user/host/vfio_user.o 00:03:34.598 LIB libspdk_dma.a 00:03:34.598 SO libspdk_dma.so.4.0 00:03:34.598 SYMLINK libspdk_dma.so 00:03:34.598 LIB libspdk_ioat.a 00:03:34.598 SO libspdk_ioat.so.7.0 00:03:34.598 LIB libspdk_vfio_user.a 00:03:34.598 SYMLINK libspdk_ioat.so 00:03:34.598 SO libspdk_vfio_user.so.5.0 00:03:34.598 SYMLINK libspdk_vfio_user.so 00:03:34.598 LIB libspdk_util.a 00:03:34.598 SO libspdk_util.so.9.0 00:03:34.598 SYMLINK libspdk_util.so 00:03:34.598 CC lib/json/json_parse.o 00:03:34.598 CC lib/vmd/vmd.o 00:03:34.598 CC lib/idxd/idxd.o 00:03:34.598 CC lib/conf/conf.o 00:03:34.598 CC lib/idxd/idxd_user.o 00:03:34.598 CC lib/vmd/led.o 00:03:34.598 CC lib/env_dpdk/env.o 00:03:34.598 CC lib/json/json_util.o 00:03:34.598 CC lib/rdma/common.o 00:03:34.599 CC lib/rdma/rdma_verbs.o 00:03:34.599 CC lib/json/json_write.o 00:03:34.599 CC lib/env_dpdk/memory.o 00:03:34.599 CC lib/env_dpdk/pci.o 00:03:34.599 CC lib/env_dpdk/init.o 00:03:34.599 CC lib/env_dpdk/threads.o 00:03:34.599 CC lib/env_dpdk/pci_ioat.o 00:03:34.599 CC lib/env_dpdk/pci_virtio.o 00:03:34.599 CC lib/env_dpdk/pci_vmd.o 00:03:34.599 CC lib/env_dpdk/pci_idxd.o 00:03:34.599 CC lib/env_dpdk/pci_event.o 00:03:34.599 CC lib/env_dpdk/sigbus_handler.o 00:03:34.599 CC lib/env_dpdk/pci_dpdk.o 00:03:34.599 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:34.599 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:34.599 LIB libspdk_trace_parser.a 00:03:34.599 SO libspdk_trace_parser.so.5.0 00:03:34.857 SYMLINK libspdk_trace_parser.so 00:03:34.857 LIB libspdk_conf.a 00:03:34.857 SO libspdk_conf.so.6.0 00:03:34.857 LIB libspdk_rdma.a 00:03:34.857 SYMLINK libspdk_conf.so 00:03:34.857 LIB libspdk_json.a 00:03:34.857 SO libspdk_rdma.so.6.0 00:03:34.857 SO libspdk_json.so.6.0 00:03:34.857 SYMLINK libspdk_rdma.so 00:03:35.114 SYMLINK libspdk_json.so 00:03:35.114 LIB libspdk_idxd.a 00:03:35.114 CC lib/jsonrpc/jsonrpc_server.o 00:03:35.114 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:35.114 CC lib/jsonrpc/jsonrpc_client.o 00:03:35.114 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:35.114 SO libspdk_idxd.so.12.0 00:03:35.114 SYMLINK libspdk_idxd.so 00:03:35.114 LIB libspdk_vmd.a 00:03:35.371 SO libspdk_vmd.so.6.0 00:03:35.371 SYMLINK libspdk_vmd.so 00:03:35.371 LIB libspdk_jsonrpc.a 00:03:35.371 SO libspdk_jsonrpc.so.6.0 00:03:35.628 SYMLINK libspdk_jsonrpc.so 00:03:35.628 CC lib/rpc/rpc.o 00:03:35.886 LIB libspdk_rpc.a 00:03:35.886 SO libspdk_rpc.so.6.0 00:03:35.886 SYMLINK libspdk_rpc.so 00:03:36.144 CC lib/notify/notify.o 00:03:36.144 CC lib/trace/trace.o 00:03:36.144 CC lib/keyring/keyring.o 00:03:36.144 CC lib/notify/notify_rpc.o 00:03:36.144 CC lib/keyring/keyring_rpc.o 00:03:36.144 CC lib/trace/trace_flags.o 00:03:36.144 CC lib/trace/trace_rpc.o 00:03:36.402 LIB libspdk_notify.a 00:03:36.402 SO libspdk_notify.so.6.0 00:03:36.402 LIB libspdk_keyring.a 00:03:36.402 LIB libspdk_trace.a 00:03:36.402 SYMLINK libspdk_notify.so 00:03:36.402 SO libspdk_keyring.so.1.0 00:03:36.403 SO libspdk_trace.so.10.0 00:03:36.403 SYMLINK libspdk_keyring.so 00:03:36.403 SYMLINK libspdk_trace.so 00:03:36.661 LIB libspdk_env_dpdk.a 00:03:36.661 SO libspdk_env_dpdk.so.14.0 00:03:36.661 CC lib/thread/thread.o 00:03:36.661 CC lib/thread/iobuf.o 00:03:36.661 CC lib/sock/sock.o 00:03:36.661 CC lib/sock/sock_rpc.o 00:03:36.661 SYMLINK libspdk_env_dpdk.so 00:03:36.919 LIB libspdk_sock.a 00:03:37.178 SO libspdk_sock.so.9.0 00:03:37.178 SYMLINK libspdk_sock.so 00:03:37.178 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:37.178 CC lib/nvme/nvme_ctrlr.o 00:03:37.178 CC lib/nvme/nvme_fabric.o 00:03:37.178 CC lib/nvme/nvme_ns_cmd.o 00:03:37.178 CC lib/nvme/nvme_ns.o 00:03:37.178 CC lib/nvme/nvme_pcie_common.o 00:03:37.178 CC lib/nvme/nvme_pcie.o 00:03:37.178 CC lib/nvme/nvme_qpair.o 00:03:37.178 CC lib/nvme/nvme.o 00:03:37.178 CC lib/nvme/nvme_quirks.o 00:03:37.178 CC lib/nvme/nvme_transport.o 00:03:37.178 CC lib/nvme/nvme_discovery.o 00:03:37.178 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:37.178 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:37.178 CC lib/nvme/nvme_tcp.o 00:03:37.178 CC lib/nvme/nvme_opal.o 00:03:37.178 CC lib/nvme/nvme_io_msg.o 00:03:37.178 CC lib/nvme/nvme_poll_group.o 00:03:37.178 CC lib/nvme/nvme_zns.o 00:03:37.178 CC lib/nvme/nvme_stubs.o 00:03:37.178 CC lib/nvme/nvme_auth.o 00:03:37.178 CC lib/nvme/nvme_cuse.o 00:03:37.178 CC lib/nvme/nvme_vfio_user.o 00:03:37.178 CC lib/nvme/nvme_rdma.o 00:03:38.114 LIB libspdk_thread.a 00:03:38.370 SO libspdk_thread.so.10.0 00:03:38.370 SYMLINK libspdk_thread.so 00:03:38.626 CC lib/accel/accel.o 00:03:38.626 CC lib/virtio/virtio.o 00:03:38.626 CC lib/init/json_config.o 00:03:38.626 CC lib/vfu_tgt/tgt_endpoint.o 00:03:38.626 CC lib/accel/accel_rpc.o 00:03:38.626 CC lib/init/subsystem.o 00:03:38.626 CC lib/blob/blobstore.o 00:03:38.626 CC lib/virtio/virtio_vhost_user.o 00:03:38.626 CC lib/accel/accel_sw.o 00:03:38.626 CC lib/blob/request.o 00:03:38.626 CC lib/init/subsystem_rpc.o 00:03:38.626 CC lib/virtio/virtio_vfio_user.o 00:03:38.626 CC lib/vfu_tgt/tgt_rpc.o 00:03:38.626 CC lib/blob/zeroes.o 00:03:38.626 CC lib/init/rpc.o 00:03:38.626 CC lib/virtio/virtio_pci.o 00:03:38.626 CC lib/blob/blob_bs_dev.o 00:03:38.883 LIB libspdk_init.a 00:03:38.883 SO libspdk_init.so.5.0 00:03:38.883 LIB libspdk_virtio.a 00:03:38.883 LIB libspdk_vfu_tgt.a 00:03:38.883 SYMLINK libspdk_init.so 00:03:38.883 SO libspdk_virtio.so.7.0 00:03:38.883 SO libspdk_vfu_tgt.so.3.0 00:03:38.883 SYMLINK libspdk_vfu_tgt.so 00:03:38.883 SYMLINK libspdk_virtio.so 00:03:39.140 CC lib/event/app.o 00:03:39.140 CC lib/event/reactor.o 00:03:39.140 CC lib/event/log_rpc.o 00:03:39.140 CC lib/event/app_rpc.o 00:03:39.140 CC lib/event/scheduler_static.o 00:03:39.397 LIB libspdk_event.a 00:03:39.397 SO libspdk_event.so.13.0 00:03:39.654 SYMLINK libspdk_event.so 00:03:39.654 LIB libspdk_accel.a 00:03:39.654 SO libspdk_accel.so.15.0 00:03:39.654 LIB libspdk_nvme.a 00:03:39.654 SYMLINK libspdk_accel.so 00:03:39.654 SO libspdk_nvme.so.13.0 00:03:39.911 CC lib/bdev/bdev.o 00:03:39.911 CC lib/bdev/bdev_rpc.o 00:03:39.911 CC lib/bdev/bdev_zone.o 00:03:39.911 CC lib/bdev/part.o 00:03:39.911 CC lib/bdev/scsi_nvme.o 00:03:40.169 SYMLINK libspdk_nvme.so 00:03:41.571 LIB libspdk_blob.a 00:03:41.571 SO libspdk_blob.so.11.0 00:03:41.571 SYMLINK libspdk_blob.so 00:03:41.571 CC lib/blobfs/blobfs.o 00:03:41.571 CC lib/lvol/lvol.o 00:03:41.571 CC lib/blobfs/tree.o 00:03:42.508 LIB libspdk_bdev.a 00:03:42.508 SO libspdk_bdev.so.15.0 00:03:42.508 SYMLINK libspdk_bdev.so 00:03:42.508 LIB libspdk_blobfs.a 00:03:42.508 SO libspdk_blobfs.so.10.0 00:03:42.508 LIB libspdk_lvol.a 00:03:42.508 SYMLINK libspdk_blobfs.so 00:03:42.508 SO libspdk_lvol.so.10.0 00:03:42.508 CC lib/ublk/ublk.o 00:03:42.508 CC lib/nbd/nbd.o 00:03:42.508 CC lib/nvmf/ctrlr.o 00:03:42.508 CC lib/ftl/ftl_core.o 00:03:42.508 CC lib/ublk/ublk_rpc.o 00:03:42.508 CC lib/scsi/dev.o 00:03:42.508 CC lib/nvmf/ctrlr_discovery.o 00:03:42.508 CC lib/nbd/nbd_rpc.o 00:03:42.508 CC lib/scsi/lun.o 00:03:42.508 CC lib/nvmf/ctrlr_bdev.o 00:03:42.508 CC lib/ftl/ftl_init.o 00:03:42.508 CC lib/nvmf/subsystem.o 00:03:42.508 CC lib/scsi/port.o 00:03:42.508 CC lib/ftl/ftl_layout.o 00:03:42.508 CC lib/nvmf/nvmf.o 00:03:42.508 CC lib/ftl/ftl_debug.o 00:03:42.508 CC lib/scsi/scsi.o 00:03:42.508 CC lib/nvmf/nvmf_rpc.o 00:03:42.508 CC lib/nvmf/transport.o 00:03:42.508 CC lib/scsi/scsi_pr.o 00:03:42.508 CC lib/scsi/scsi_bdev.o 00:03:42.508 CC lib/ftl/ftl_io.o 00:03:42.508 CC lib/ftl/ftl_sb.o 00:03:42.508 CC lib/nvmf/tcp.o 00:03:42.508 CC lib/scsi/scsi_rpc.o 00:03:42.508 CC lib/nvmf/vfio_user.o 00:03:42.508 CC lib/ftl/ftl_l2p_flat.o 00:03:42.508 CC lib/ftl/ftl_l2p.o 00:03:42.508 CC lib/nvmf/rdma.o 00:03:42.508 CC lib/scsi/task.o 00:03:42.508 CC lib/ftl/ftl_band.o 00:03:42.508 CC lib/ftl/ftl_nv_cache.o 00:03:42.508 CC lib/ftl/ftl_band_ops.o 00:03:42.508 CC lib/ftl/ftl_writer.o 00:03:42.508 CC lib/ftl/ftl_rq.o 00:03:42.508 CC lib/ftl/ftl_reloc.o 00:03:42.508 CC lib/ftl/ftl_l2p_cache.o 00:03:42.508 CC lib/ftl/ftl_p2l.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:42.508 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:42.773 SYMLINK libspdk_lvol.so 00:03:42.773 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:43.035 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:43.035 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:43.035 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:43.035 CC lib/ftl/utils/ftl_conf.o 00:03:43.035 CC lib/ftl/utils/ftl_md.o 00:03:43.035 CC lib/ftl/utils/ftl_mempool.o 00:03:43.035 CC lib/ftl/utils/ftl_bitmap.o 00:03:43.035 CC lib/ftl/utils/ftl_property.o 00:03:43.035 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:43.035 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:43.035 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:43.035 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:43.035 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:43.035 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:43.035 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:43.035 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:43.035 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:43.035 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:43.294 CC lib/ftl/base/ftl_base_dev.o 00:03:43.294 CC lib/ftl/base/ftl_base_bdev.o 00:03:43.294 CC lib/ftl/ftl_trace.o 00:03:43.552 LIB libspdk_nbd.a 00:03:43.552 SO libspdk_nbd.so.7.0 00:03:43.552 SYMLINK libspdk_nbd.so 00:03:43.552 LIB libspdk_scsi.a 00:03:43.552 SO libspdk_scsi.so.9.0 00:03:43.552 LIB libspdk_ublk.a 00:03:43.810 SO libspdk_ublk.so.3.0 00:03:43.811 SYMLINK libspdk_scsi.so 00:03:43.811 SYMLINK libspdk_ublk.so 00:03:43.811 CC lib/vhost/vhost.o 00:03:43.811 CC lib/iscsi/conn.o 00:03:43.811 CC lib/iscsi/init_grp.o 00:03:43.811 CC lib/vhost/vhost_rpc.o 00:03:43.811 CC lib/vhost/vhost_scsi.o 00:03:43.811 CC lib/iscsi/iscsi.o 00:03:43.811 CC lib/iscsi/md5.o 00:03:43.811 CC lib/vhost/vhost_blk.o 00:03:43.811 CC lib/iscsi/param.o 00:03:43.811 CC lib/vhost/rte_vhost_user.o 00:03:43.811 CC lib/iscsi/portal_grp.o 00:03:43.811 CC lib/iscsi/tgt_node.o 00:03:43.811 CC lib/iscsi/iscsi_subsystem.o 00:03:43.811 CC lib/iscsi/iscsi_rpc.o 00:03:43.811 CC lib/iscsi/task.o 00:03:44.069 LIB libspdk_ftl.a 00:03:44.069 SO libspdk_ftl.so.9.0 00:03:44.632 SYMLINK libspdk_ftl.so 00:03:45.196 LIB libspdk_vhost.a 00:03:45.197 SO libspdk_vhost.so.8.0 00:03:45.197 LIB libspdk_nvmf.a 00:03:45.197 SYMLINK libspdk_vhost.so 00:03:45.197 SO libspdk_nvmf.so.18.0 00:03:45.197 LIB libspdk_iscsi.a 00:03:45.197 SO libspdk_iscsi.so.8.0 00:03:45.454 SYMLINK libspdk_nvmf.so 00:03:45.454 SYMLINK libspdk_iscsi.so 00:03:45.713 CC module/env_dpdk/env_dpdk_rpc.o 00:03:45.713 CC module/vfu_device/vfu_virtio.o 00:03:45.713 CC module/vfu_device/vfu_virtio_blk.o 00:03:45.713 CC module/vfu_device/vfu_virtio_scsi.o 00:03:45.713 CC module/vfu_device/vfu_virtio_rpc.o 00:03:45.713 CC module/accel/dsa/accel_dsa.o 00:03:45.713 CC module/blob/bdev/blob_bdev.o 00:03:45.713 CC module/accel/dsa/accel_dsa_rpc.o 00:03:45.713 CC module/sock/posix/posix.o 00:03:45.713 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:45.713 CC module/accel/error/accel_error.o 00:03:45.713 CC module/keyring/file/keyring.o 00:03:45.713 CC module/accel/error/accel_error_rpc.o 00:03:45.713 CC module/accel/ioat/accel_ioat.o 00:03:45.713 CC module/accel/iaa/accel_iaa.o 00:03:45.713 CC module/keyring/file/keyring_rpc.o 00:03:45.713 CC module/scheduler/gscheduler/gscheduler.o 00:03:45.713 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:45.713 CC module/accel/ioat/accel_ioat_rpc.o 00:03:45.713 CC module/accel/iaa/accel_iaa_rpc.o 00:03:45.971 LIB libspdk_env_dpdk_rpc.a 00:03:45.971 SO libspdk_env_dpdk_rpc.so.6.0 00:03:45.971 SYMLINK libspdk_env_dpdk_rpc.so 00:03:45.971 LIB libspdk_keyring_file.a 00:03:45.971 LIB libspdk_scheduler_gscheduler.a 00:03:45.971 LIB libspdk_scheduler_dpdk_governor.a 00:03:45.971 SO libspdk_keyring_file.so.1.0 00:03:45.971 SO libspdk_scheduler_gscheduler.so.4.0 00:03:45.971 SO libspdk_scheduler_dpdk_governor.so.4.0 00:03:45.971 LIB libspdk_accel_error.a 00:03:45.971 LIB libspdk_accel_ioat.a 00:03:45.971 LIB libspdk_scheduler_dynamic.a 00:03:45.971 LIB libspdk_accel_iaa.a 00:03:45.971 SO libspdk_accel_error.so.2.0 00:03:45.971 SO libspdk_accel_ioat.so.6.0 00:03:45.971 SO libspdk_scheduler_dynamic.so.4.0 00:03:45.971 SYMLINK libspdk_scheduler_gscheduler.so 00:03:45.971 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:45.971 SYMLINK libspdk_keyring_file.so 00:03:45.971 SO libspdk_accel_iaa.so.3.0 00:03:45.971 LIB libspdk_accel_dsa.a 00:03:46.229 SYMLINK libspdk_accel_error.so 00:03:46.229 LIB libspdk_blob_bdev.a 00:03:46.229 SO libspdk_accel_dsa.so.5.0 00:03:46.229 SYMLINK libspdk_scheduler_dynamic.so 00:03:46.229 SYMLINK libspdk_accel_ioat.so 00:03:46.229 SYMLINK libspdk_accel_iaa.so 00:03:46.229 SO libspdk_blob_bdev.so.11.0 00:03:46.229 SYMLINK libspdk_accel_dsa.so 00:03:46.229 SYMLINK libspdk_blob_bdev.so 00:03:46.488 LIB libspdk_vfu_device.a 00:03:46.488 SO libspdk_vfu_device.so.3.0 00:03:46.488 CC module/bdev/passthru/vbdev_passthru.o 00:03:46.488 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:46.488 CC module/bdev/nvme/bdev_nvme.o 00:03:46.488 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:46.488 CC module/bdev/delay/vbdev_delay.o 00:03:46.488 CC module/bdev/nvme/nvme_rpc.o 00:03:46.488 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:46.488 CC module/bdev/error/vbdev_error.o 00:03:46.488 CC module/bdev/malloc/bdev_malloc.o 00:03:46.488 CC module/bdev/raid/bdev_raid.o 00:03:46.488 CC module/bdev/split/vbdev_split.o 00:03:46.488 CC module/bdev/error/vbdev_error_rpc.o 00:03:46.488 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:46.488 CC module/bdev/nvme/bdev_mdns_client.o 00:03:46.488 CC module/bdev/aio/bdev_aio.o 00:03:46.488 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:46.488 CC module/bdev/raid/bdev_raid_rpc.o 00:03:46.488 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:46.488 CC module/bdev/lvol/vbdev_lvol.o 00:03:46.488 CC module/bdev/split/vbdev_split_rpc.o 00:03:46.488 CC module/bdev/ftl/bdev_ftl.o 00:03:46.488 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:46.488 CC module/bdev/nvme/vbdev_opal.o 00:03:46.488 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:46.488 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:46.488 CC module/bdev/raid/bdev_raid_sb.o 00:03:46.488 CC module/bdev/aio/bdev_aio_rpc.o 00:03:46.488 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:46.488 CC module/bdev/raid/raid0.o 00:03:46.488 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:46.488 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:46.488 CC module/bdev/raid/raid1.o 00:03:46.488 CC module/bdev/null/bdev_null.o 00:03:46.488 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:46.488 CC module/bdev/null/bdev_null_rpc.o 00:03:46.488 CC module/bdev/gpt/gpt.o 00:03:46.488 CC module/bdev/raid/concat.o 00:03:46.488 CC module/blobfs/bdev/blobfs_bdev.o 00:03:46.488 CC module/bdev/iscsi/bdev_iscsi.o 00:03:46.488 CC module/bdev/gpt/vbdev_gpt.o 00:03:46.488 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:46.488 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:46.488 SYMLINK libspdk_vfu_device.so 00:03:46.747 LIB libspdk_sock_posix.a 00:03:46.747 SO libspdk_sock_posix.so.6.0 00:03:46.747 SYMLINK libspdk_sock_posix.so 00:03:46.747 LIB libspdk_blobfs_bdev.a 00:03:47.005 SO libspdk_blobfs_bdev.so.6.0 00:03:47.005 LIB libspdk_bdev_split.a 00:03:47.005 SO libspdk_bdev_split.so.6.0 00:03:47.005 LIB libspdk_bdev_passthru.a 00:03:47.005 LIB libspdk_bdev_malloc.a 00:03:47.005 SYMLINK libspdk_blobfs_bdev.so 00:03:47.005 LIB libspdk_bdev_null.a 00:03:47.005 SO libspdk_bdev_passthru.so.6.0 00:03:47.005 SO libspdk_bdev_malloc.so.6.0 00:03:47.005 LIB libspdk_bdev_ftl.a 00:03:47.005 LIB libspdk_bdev_aio.a 00:03:47.005 LIB libspdk_bdev_error.a 00:03:47.005 SO libspdk_bdev_null.so.6.0 00:03:47.005 SYMLINK libspdk_bdev_split.so 00:03:47.005 LIB libspdk_bdev_gpt.a 00:03:47.005 SO libspdk_bdev_ftl.so.6.0 00:03:47.005 SO libspdk_bdev_aio.so.6.0 00:03:47.005 SO libspdk_bdev_error.so.6.0 00:03:47.005 SO libspdk_bdev_gpt.so.6.0 00:03:47.005 SYMLINK libspdk_bdev_passthru.so 00:03:47.005 SYMLINK libspdk_bdev_malloc.so 00:03:47.005 SYMLINK libspdk_bdev_null.so 00:03:47.005 LIB libspdk_bdev_zone_block.a 00:03:47.005 SYMLINK libspdk_bdev_ftl.so 00:03:47.005 LIB libspdk_bdev_virtio.a 00:03:47.005 SYMLINK libspdk_bdev_aio.so 00:03:47.005 SYMLINK libspdk_bdev_error.so 00:03:47.005 LIB libspdk_bdev_iscsi.a 00:03:47.005 SYMLINK libspdk_bdev_gpt.so 00:03:47.005 SO libspdk_bdev_zone_block.so.6.0 00:03:47.005 LIB libspdk_bdev_delay.a 00:03:47.005 SO libspdk_bdev_virtio.so.6.0 00:03:47.005 SO libspdk_bdev_iscsi.so.6.0 00:03:47.005 SO libspdk_bdev_delay.so.6.0 00:03:47.264 SYMLINK libspdk_bdev_zone_block.so 00:03:47.264 SYMLINK libspdk_bdev_virtio.so 00:03:47.264 SYMLINK libspdk_bdev_iscsi.so 00:03:47.264 SYMLINK libspdk_bdev_delay.so 00:03:47.264 LIB libspdk_bdev_lvol.a 00:03:47.264 SO libspdk_bdev_lvol.so.6.0 00:03:47.264 SYMLINK libspdk_bdev_lvol.so 00:03:47.522 LIB libspdk_bdev_raid.a 00:03:47.522 SO libspdk_bdev_raid.so.6.0 00:03:47.780 SYMLINK libspdk_bdev_raid.so 00:03:48.715 LIB libspdk_bdev_nvme.a 00:03:48.715 SO libspdk_bdev_nvme.so.7.0 00:03:48.973 SYMLINK libspdk_bdev_nvme.so 00:03:49.231 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:49.231 CC module/event/subsystems/vmd/vmd.o 00:03:49.231 CC module/event/subsystems/sock/sock.o 00:03:49.231 CC module/event/subsystems/scheduler/scheduler.o 00:03:49.231 CC module/event/subsystems/keyring/keyring.o 00:03:49.231 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:49.231 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:49.231 CC module/event/subsystems/iobuf/iobuf.o 00:03:49.231 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:49.490 LIB libspdk_event_sock.a 00:03:49.490 LIB libspdk_event_keyring.a 00:03:49.490 LIB libspdk_event_vhost_blk.a 00:03:49.490 LIB libspdk_event_scheduler.a 00:03:49.490 LIB libspdk_event_vmd.a 00:03:49.490 LIB libspdk_event_vfu_tgt.a 00:03:49.490 SO libspdk_event_keyring.so.1.0 00:03:49.491 SO libspdk_event_sock.so.5.0 00:03:49.491 SO libspdk_event_vhost_blk.so.3.0 00:03:49.491 LIB libspdk_event_iobuf.a 00:03:49.491 SO libspdk_event_vfu_tgt.so.3.0 00:03:49.491 SO libspdk_event_scheduler.so.4.0 00:03:49.491 SO libspdk_event_vmd.so.6.0 00:03:49.491 SO libspdk_event_iobuf.so.3.0 00:03:49.491 SYMLINK libspdk_event_keyring.so 00:03:49.491 SYMLINK libspdk_event_sock.so 00:03:49.491 SYMLINK libspdk_event_vhost_blk.so 00:03:49.491 SYMLINK libspdk_event_vfu_tgt.so 00:03:49.491 SYMLINK libspdk_event_scheduler.so 00:03:49.491 SYMLINK libspdk_event_vmd.so 00:03:49.491 SYMLINK libspdk_event_iobuf.so 00:03:49.749 CC module/event/subsystems/accel/accel.o 00:03:49.749 LIB libspdk_event_accel.a 00:03:50.007 SO libspdk_event_accel.so.6.0 00:03:50.007 SYMLINK libspdk_event_accel.so 00:03:50.007 CC module/event/subsystems/bdev/bdev.o 00:03:50.265 LIB libspdk_event_bdev.a 00:03:50.265 SO libspdk_event_bdev.so.6.0 00:03:50.265 SYMLINK libspdk_event_bdev.so 00:03:50.524 CC module/event/subsystems/scsi/scsi.o 00:03:50.524 CC module/event/subsystems/nbd/nbd.o 00:03:50.524 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:50.524 CC module/event/subsystems/ublk/ublk.o 00:03:50.524 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:50.782 LIB libspdk_event_nbd.a 00:03:50.782 LIB libspdk_event_ublk.a 00:03:50.782 LIB libspdk_event_scsi.a 00:03:50.782 SO libspdk_event_nbd.so.6.0 00:03:50.782 SO libspdk_event_ublk.so.3.0 00:03:50.782 SO libspdk_event_scsi.so.6.0 00:03:50.782 SYMLINK libspdk_event_nbd.so 00:03:50.782 SYMLINK libspdk_event_ublk.so 00:03:50.782 SYMLINK libspdk_event_scsi.so 00:03:50.782 LIB libspdk_event_nvmf.a 00:03:50.782 SO libspdk_event_nvmf.so.6.0 00:03:50.782 SYMLINK libspdk_event_nvmf.so 00:03:51.040 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:51.040 CC module/event/subsystems/iscsi/iscsi.o 00:03:51.040 LIB libspdk_event_vhost_scsi.a 00:03:51.040 LIB libspdk_event_iscsi.a 00:03:51.040 SO libspdk_event_vhost_scsi.so.3.0 00:03:51.040 SO libspdk_event_iscsi.so.6.0 00:03:51.298 SYMLINK libspdk_event_vhost_scsi.so 00:03:51.298 SYMLINK libspdk_event_iscsi.so 00:03:51.298 SO libspdk.so.6.0 00:03:51.298 SYMLINK libspdk.so 00:03:51.564 CXX app/trace/trace.o 00:03:51.564 CC app/trace_record/trace_record.o 00:03:51.564 CC app/spdk_lspci/spdk_lspci.o 00:03:51.564 CC app/spdk_nvme_perf/perf.o 00:03:51.564 CC app/spdk_nvme_discover/discovery_aer.o 00:03:51.564 CC app/spdk_nvme_identify/identify.o 00:03:51.564 CC app/spdk_top/spdk_top.o 00:03:51.564 CC test/rpc_client/rpc_client_test.o 00:03:51.564 TEST_HEADER include/spdk/accel.h 00:03:51.564 TEST_HEADER include/spdk/accel_module.h 00:03:51.564 TEST_HEADER include/spdk/assert.h 00:03:51.564 TEST_HEADER include/spdk/barrier.h 00:03:51.564 TEST_HEADER include/spdk/base64.h 00:03:51.564 TEST_HEADER include/spdk/bdev.h 00:03:51.564 TEST_HEADER include/spdk/bdev_module.h 00:03:51.564 TEST_HEADER include/spdk/bdev_zone.h 00:03:51.564 TEST_HEADER include/spdk/bit_array.h 00:03:51.564 TEST_HEADER include/spdk/bit_pool.h 00:03:51.564 TEST_HEADER include/spdk/blob_bdev.h 00:03:51.564 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:51.564 TEST_HEADER include/spdk/blobfs.h 00:03:51.564 TEST_HEADER include/spdk/blob.h 00:03:51.564 TEST_HEADER include/spdk/conf.h 00:03:51.564 TEST_HEADER include/spdk/config.h 00:03:51.564 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:51.564 TEST_HEADER include/spdk/cpuset.h 00:03:51.564 TEST_HEADER include/spdk/crc16.h 00:03:51.564 TEST_HEADER include/spdk/crc32.h 00:03:51.564 CC app/spdk_dd/spdk_dd.o 00:03:51.564 TEST_HEADER include/spdk/crc64.h 00:03:51.564 CC app/nvmf_tgt/nvmf_main.o 00:03:51.564 TEST_HEADER include/spdk/dif.h 00:03:51.564 TEST_HEADER include/spdk/dma.h 00:03:51.564 TEST_HEADER include/spdk/endian.h 00:03:51.564 TEST_HEADER include/spdk/env_dpdk.h 00:03:51.564 CC app/iscsi_tgt/iscsi_tgt.o 00:03:51.564 CC app/vhost/vhost.o 00:03:51.564 TEST_HEADER include/spdk/env.h 00:03:51.564 TEST_HEADER include/spdk/event.h 00:03:51.564 TEST_HEADER include/spdk/fd_group.h 00:03:51.564 TEST_HEADER include/spdk/fd.h 00:03:51.564 TEST_HEADER include/spdk/file.h 00:03:51.564 TEST_HEADER include/spdk/ftl.h 00:03:51.564 TEST_HEADER include/spdk/gpt_spec.h 00:03:51.564 CC examples/idxd/perf/perf.o 00:03:51.564 TEST_HEADER include/spdk/hexlify.h 00:03:51.564 CC examples/accel/perf/accel_perf.o 00:03:51.565 CC examples/nvme/hello_world/hello_world.o 00:03:51.565 CC app/spdk_tgt/spdk_tgt.o 00:03:51.565 TEST_HEADER include/spdk/histogram_data.h 00:03:51.565 TEST_HEADER include/spdk/idxd.h 00:03:51.565 CC examples/sock/hello_world/hello_sock.o 00:03:51.565 CC examples/ioat/perf/perf.o 00:03:51.565 CC test/event/event_perf/event_perf.o 00:03:51.565 CC examples/nvme/arbitration/arbitration.o 00:03:51.565 TEST_HEADER include/spdk/idxd_spec.h 00:03:51.565 CC examples/nvme/reconnect/reconnect.o 00:03:51.565 TEST_HEADER include/spdk/init.h 00:03:51.565 CC test/app/histogram_perf/histogram_perf.o 00:03:51.565 TEST_HEADER include/spdk/ioat.h 00:03:51.565 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:51.832 CC examples/vmd/lsvmd/lsvmd.o 00:03:51.832 TEST_HEADER include/spdk/ioat_spec.h 00:03:51.832 CC examples/util/zipf/zipf.o 00:03:51.832 CC app/fio/nvme/fio_plugin.o 00:03:51.832 CC examples/vmd/led/led.o 00:03:51.832 CC examples/nvme/hotplug/hotplug.o 00:03:51.832 TEST_HEADER include/spdk/iscsi_spec.h 00:03:51.832 CC test/nvme/aer/aer.o 00:03:51.832 CC test/app/jsoncat/jsoncat.o 00:03:51.832 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:51.832 TEST_HEADER include/spdk/json.h 00:03:51.832 CC test/thread/poller_perf/poller_perf.o 00:03:51.832 TEST_HEADER include/spdk/jsonrpc.h 00:03:51.832 TEST_HEADER include/spdk/keyring.h 00:03:51.832 TEST_HEADER include/spdk/keyring_module.h 00:03:51.832 TEST_HEADER include/spdk/likely.h 00:03:51.832 TEST_HEADER include/spdk/log.h 00:03:51.832 TEST_HEADER include/spdk/lvol.h 00:03:51.832 TEST_HEADER include/spdk/memory.h 00:03:51.832 TEST_HEADER include/spdk/mmio.h 00:03:51.832 TEST_HEADER include/spdk/nbd.h 00:03:51.832 CC examples/blob/cli/blobcli.o 00:03:51.832 CC test/accel/dif/dif.o 00:03:51.832 CC examples/nvmf/nvmf/nvmf.o 00:03:51.832 TEST_HEADER include/spdk/notify.h 00:03:51.832 TEST_HEADER include/spdk/nvme.h 00:03:51.832 CC examples/blob/hello_world/hello_blob.o 00:03:51.832 TEST_HEADER include/spdk/nvme_intel.h 00:03:51.832 CC examples/bdev/bdevperf/bdevperf.o 00:03:51.832 CC examples/bdev/hello_world/hello_bdev.o 00:03:51.832 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:51.832 CC test/blobfs/mkfs/mkfs.o 00:03:51.832 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:51.832 CC test/app/bdev_svc/bdev_svc.o 00:03:51.832 CC test/bdev/bdevio/bdevio.o 00:03:51.832 TEST_HEADER include/spdk/nvme_spec.h 00:03:51.832 CC test/dma/test_dma/test_dma.o 00:03:51.832 TEST_HEADER include/spdk/nvme_zns.h 00:03:51.832 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:51.832 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:51.832 CC examples/thread/thread/thread_ex.o 00:03:51.832 TEST_HEADER include/spdk/nvmf.h 00:03:51.832 TEST_HEADER include/spdk/nvmf_spec.h 00:03:51.832 TEST_HEADER include/spdk/nvmf_transport.h 00:03:51.832 TEST_HEADER include/spdk/opal.h 00:03:51.832 TEST_HEADER include/spdk/opal_spec.h 00:03:51.832 TEST_HEADER include/spdk/pci_ids.h 00:03:51.832 TEST_HEADER include/spdk/pipe.h 00:03:51.832 TEST_HEADER include/spdk/queue.h 00:03:51.832 TEST_HEADER include/spdk/reduce.h 00:03:51.832 TEST_HEADER include/spdk/rpc.h 00:03:51.832 TEST_HEADER include/spdk/scheduler.h 00:03:51.832 TEST_HEADER include/spdk/scsi.h 00:03:51.832 TEST_HEADER include/spdk/scsi_spec.h 00:03:51.832 TEST_HEADER include/spdk/sock.h 00:03:51.832 TEST_HEADER include/spdk/stdinc.h 00:03:51.832 LINK spdk_lspci 00:03:51.832 TEST_HEADER include/spdk/string.h 00:03:51.832 TEST_HEADER include/spdk/thread.h 00:03:51.832 CC test/lvol/esnap/esnap.o 00:03:51.832 CC test/env/mem_callbacks/mem_callbacks.o 00:03:51.832 TEST_HEADER include/spdk/trace.h 00:03:51.832 TEST_HEADER include/spdk/trace_parser.h 00:03:51.832 TEST_HEADER include/spdk/tree.h 00:03:51.832 TEST_HEADER include/spdk/ublk.h 00:03:51.832 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:51.832 TEST_HEADER include/spdk/util.h 00:03:51.832 TEST_HEADER include/spdk/uuid.h 00:03:51.832 TEST_HEADER include/spdk/version.h 00:03:51.832 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:51.832 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:51.832 TEST_HEADER include/spdk/vhost.h 00:03:51.832 TEST_HEADER include/spdk/vmd.h 00:03:51.832 TEST_HEADER include/spdk/xor.h 00:03:51.832 TEST_HEADER include/spdk/zipf.h 00:03:51.832 CXX test/cpp_headers/accel.o 00:03:51.832 LINK rpc_client_test 00:03:51.832 LINK spdk_nvme_discover 00:03:52.102 LINK lsvmd 00:03:52.102 LINK interrupt_tgt 00:03:52.102 LINK event_perf 00:03:52.102 LINK led 00:03:52.102 LINK nvmf_tgt 00:03:52.102 LINK jsoncat 00:03:52.102 LINK poller_perf 00:03:52.102 LINK histogram_perf 00:03:52.102 LINK zipf 00:03:52.102 LINK spdk_trace_record 00:03:52.103 LINK vhost 00:03:52.103 LINK iscsi_tgt 00:03:52.103 LINK cmb_copy 00:03:52.103 LINK spdk_tgt 00:03:52.103 LINK ioat_perf 00:03:52.103 LINK hello_world 00:03:52.103 LINK bdev_svc 00:03:52.103 LINK hello_sock 00:03:52.103 LINK mkfs 00:03:52.103 LINK hotplug 00:03:52.103 LINK hello_bdev 00:03:52.368 LINK hello_blob 00:03:52.368 CXX test/cpp_headers/accel_module.o 00:03:52.368 LINK aer 00:03:52.368 LINK thread 00:03:52.368 LINK idxd_perf 00:03:52.368 LINK spdk_dd 00:03:52.368 CC examples/nvme/abort/abort.o 00:03:52.368 LINK arbitration 00:03:52.368 LINK nvmf 00:03:52.368 CXX test/cpp_headers/assert.o 00:03:52.368 LINK reconnect 00:03:52.368 LINK spdk_trace 00:03:52.368 CXX test/cpp_headers/barrier.o 00:03:52.368 LINK dif 00:03:52.368 CC app/fio/bdev/fio_plugin.o 00:03:52.368 CC test/nvme/reset/reset.o 00:03:52.368 CC test/event/reactor/reactor.o 00:03:52.368 CXX test/cpp_headers/base64.o 00:03:52.368 CC test/event/reactor_perf/reactor_perf.o 00:03:52.632 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:52.632 LINK bdevio 00:03:52.632 CC examples/ioat/verify/verify.o 00:03:52.632 CC test/env/vtophys/vtophys.o 00:03:52.632 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:52.632 CC test/app/stub/stub.o 00:03:52.632 CC test/nvme/sgl/sgl.o 00:03:52.632 LINK test_dma 00:03:52.632 LINK accel_perf 00:03:52.632 CXX test/cpp_headers/bdev.o 00:03:52.632 CC test/nvme/e2edp/nvme_dp.o 00:03:52.632 CXX test/cpp_headers/bdev_module.o 00:03:52.632 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:52.632 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:52.632 CC test/nvme/overhead/overhead.o 00:03:52.632 CC test/nvme/err_injection/err_injection.o 00:03:52.632 CXX test/cpp_headers/bdev_zone.o 00:03:52.632 LINK nvme_fuzz 00:03:52.632 LINK nvme_manage 00:03:52.632 CXX test/cpp_headers/bit_array.o 00:03:52.632 CC test/event/app_repeat/app_repeat.o 00:03:52.632 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:52.632 LINK blobcli 00:03:52.632 CXX test/cpp_headers/bit_pool.o 00:03:52.632 LINK spdk_nvme 00:03:52.898 CC test/nvme/startup/startup.o 00:03:52.898 CXX test/cpp_headers/blob_bdev.o 00:03:52.898 CC test/event/scheduler/scheduler.o 00:03:52.898 LINK reactor 00:03:52.898 CC test/env/memory/memory_ut.o 00:03:52.898 LINK vtophys 00:03:52.898 CC test/env/pci/pci_ut.o 00:03:52.898 LINK reactor_perf 00:03:52.898 CC test/nvme/simple_copy/simple_copy.o 00:03:52.898 CC test/nvme/reserve/reserve.o 00:03:52.898 CC test/nvme/connect_stress/connect_stress.o 00:03:52.898 CXX test/cpp_headers/blobfs_bdev.o 00:03:52.898 CXX test/cpp_headers/blobfs.o 00:03:52.898 LINK pmr_persistence 00:03:52.898 LINK stub 00:03:52.898 CC test/nvme/boot_partition/boot_partition.o 00:03:52.898 CC test/nvme/compliance/nvme_compliance.o 00:03:52.898 LINK verify 00:03:52.898 CXX test/cpp_headers/blob.o 00:03:52.898 CXX test/cpp_headers/conf.o 00:03:52.898 LINK reset 00:03:52.898 CXX test/cpp_headers/config.o 00:03:52.898 CXX test/cpp_headers/cpuset.o 00:03:53.160 LINK app_repeat 00:03:53.160 LINK abort 00:03:53.160 LINK mem_callbacks 00:03:53.160 CXX test/cpp_headers/crc16.o 00:03:53.160 CXX test/cpp_headers/crc32.o 00:03:53.160 CXX test/cpp_headers/crc64.o 00:03:53.160 CC test/nvme/fused_ordering/fused_ordering.o 00:03:53.160 LINK env_dpdk_post_init 00:03:53.160 LINK err_injection 00:03:53.160 LINK spdk_nvme_perf 00:03:53.160 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:53.160 LINK sgl 00:03:53.160 CC test/nvme/fdp/fdp.o 00:03:53.160 CC test/nvme/cuse/cuse.o 00:03:53.160 CXX test/cpp_headers/dif.o 00:03:53.160 CXX test/cpp_headers/dma.o 00:03:53.160 LINK spdk_nvme_identify 00:03:53.160 CXX test/cpp_headers/endian.o 00:03:53.160 CXX test/cpp_headers/env_dpdk.o 00:03:53.160 CXX test/cpp_headers/env.o 00:03:53.160 LINK startup 00:03:53.160 CXX test/cpp_headers/event.o 00:03:53.160 LINK nvme_dp 00:03:53.160 LINK spdk_top 00:03:53.160 CXX test/cpp_headers/fd_group.o 00:03:53.160 CXX test/cpp_headers/fd.o 00:03:53.160 LINK connect_stress 00:03:53.160 CXX test/cpp_headers/file.o 00:03:53.160 CXX test/cpp_headers/ftl.o 00:03:53.160 LINK overhead 00:03:53.160 CXX test/cpp_headers/gpt_spec.o 00:03:53.160 LINK bdevperf 00:03:53.160 LINK scheduler 00:03:53.160 LINK boot_partition 00:03:53.425 CXX test/cpp_headers/hexlify.o 00:03:53.425 LINK reserve 00:03:53.425 LINK simple_copy 00:03:53.425 CXX test/cpp_headers/histogram_data.o 00:03:53.425 CXX test/cpp_headers/idxd.o 00:03:53.425 CXX test/cpp_headers/idxd_spec.o 00:03:53.425 CXX test/cpp_headers/init.o 00:03:53.425 CXX test/cpp_headers/ioat.o 00:03:53.425 CXX test/cpp_headers/ioat_spec.o 00:03:53.425 CXX test/cpp_headers/iscsi_spec.o 00:03:53.425 CXX test/cpp_headers/json.o 00:03:53.425 CXX test/cpp_headers/jsonrpc.o 00:03:53.425 CXX test/cpp_headers/keyring.o 00:03:53.425 CXX test/cpp_headers/keyring_module.o 00:03:53.425 CXX test/cpp_headers/likely.o 00:03:53.425 CXX test/cpp_headers/log.o 00:03:53.425 LINK spdk_bdev 00:03:53.425 LINK vhost_fuzz 00:03:53.425 CXX test/cpp_headers/lvol.o 00:03:53.425 CXX test/cpp_headers/memory.o 00:03:53.425 LINK doorbell_aers 00:03:53.425 CXX test/cpp_headers/mmio.o 00:03:53.425 CXX test/cpp_headers/nbd.o 00:03:53.425 CXX test/cpp_headers/notify.o 00:03:53.425 CXX test/cpp_headers/nvme.o 00:03:53.425 CXX test/cpp_headers/nvme_ocssd.o 00:03:53.425 CXX test/cpp_headers/nvme_intel.o 00:03:53.425 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:53.425 LINK fused_ordering 00:03:53.425 CXX test/cpp_headers/nvme_spec.o 00:03:53.425 CXX test/cpp_headers/nvme_zns.o 00:03:53.690 CXX test/cpp_headers/nvmf_cmd.o 00:03:53.690 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:53.690 LINK pci_ut 00:03:53.690 CXX test/cpp_headers/nvmf.o 00:03:53.690 LINK nvme_compliance 00:03:53.690 CXX test/cpp_headers/nvmf_spec.o 00:03:53.690 CXX test/cpp_headers/nvmf_transport.o 00:03:53.690 CXX test/cpp_headers/opal.o 00:03:53.690 CXX test/cpp_headers/opal_spec.o 00:03:53.690 CXX test/cpp_headers/pci_ids.o 00:03:53.690 CXX test/cpp_headers/pipe.o 00:03:53.690 CXX test/cpp_headers/queue.o 00:03:53.690 CXX test/cpp_headers/reduce.o 00:03:53.690 CXX test/cpp_headers/rpc.o 00:03:53.690 CXX test/cpp_headers/scheduler.o 00:03:53.690 CXX test/cpp_headers/scsi.o 00:03:53.690 CXX test/cpp_headers/scsi_spec.o 00:03:53.690 CXX test/cpp_headers/sock.o 00:03:53.690 CXX test/cpp_headers/stdinc.o 00:03:53.690 CXX test/cpp_headers/string.o 00:03:53.690 LINK fdp 00:03:53.690 CXX test/cpp_headers/thread.o 00:03:53.690 CXX test/cpp_headers/trace.o 00:03:53.690 CXX test/cpp_headers/trace_parser.o 00:03:53.690 CXX test/cpp_headers/tree.o 00:03:53.690 CXX test/cpp_headers/ublk.o 00:03:53.690 CXX test/cpp_headers/util.o 00:03:53.690 CXX test/cpp_headers/uuid.o 00:03:53.690 CXX test/cpp_headers/version.o 00:03:53.690 CXX test/cpp_headers/vfio_user_pci.o 00:03:53.690 CXX test/cpp_headers/vfio_user_spec.o 00:03:53.951 CXX test/cpp_headers/vhost.o 00:03:53.951 CXX test/cpp_headers/vmd.o 00:03:53.951 CXX test/cpp_headers/xor.o 00:03:53.951 CXX test/cpp_headers/zipf.o 00:03:54.210 LINK memory_ut 00:03:54.473 LINK cuse 00:03:55.039 LINK iscsi_fuzz 00:03:57.569 LINK esnap 00:03:57.569 00:03:57.569 real 0m39.652s 00:03:57.569 user 7m27.279s 00:03:57.569 sys 1m48.898s 00:03:57.569 04:48:36 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:03:57.570 04:48:36 -- common/autotest_common.sh@10 -- $ set +x 00:03:57.570 ************************************ 00:03:57.570 END TEST make 00:03:57.570 ************************************ 00:03:57.570 04:48:36 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:03:57.570 04:48:36 -- pm/common@30 -- $ signal_monitor_resources TERM 00:03:57.570 04:48:36 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:03:57.570 04:48:36 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.570 04:48:36 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:03:57.570 04:48:36 -- pm/common@45 -- $ pid=2161931 00:03:57.570 04:48:36 -- pm/common@52 -- $ sudo kill -TERM 2161931 00:03:57.570 04:48:36 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.570 04:48:36 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:03:57.570 04:48:36 -- pm/common@45 -- $ pid=2161932 00:03:57.570 04:48:36 -- pm/common@52 -- $ sudo kill -TERM 2161932 00:03:57.570 04:48:36 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.570 04:48:36 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:03:57.570 04:48:36 -- pm/common@45 -- $ pid=2161933 00:03:57.570 04:48:36 -- pm/common@52 -- $ sudo kill -TERM 2161933 00:03:57.828 04:48:36 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.828 04:48:36 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:03:57.828 04:48:36 -- pm/common@45 -- $ pid=2161934 00:03:57.828 04:48:36 -- pm/common@52 -- $ sudo kill -TERM 2161934 00:03:57.828 04:48:36 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:57.828 04:48:36 -- nvmf/common.sh@7 -- # uname -s 00:03:57.828 04:48:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:57.828 04:48:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:57.828 04:48:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:57.828 04:48:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:57.828 04:48:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:57.828 04:48:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:57.828 04:48:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:57.828 04:48:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:57.828 04:48:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:57.828 04:48:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:57.828 04:48:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:57.828 04:48:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:57.828 04:48:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:57.829 04:48:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:57.829 04:48:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:57.829 04:48:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:03:57.829 04:48:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:57.829 04:48:36 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:57.829 04:48:36 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:57.829 04:48:36 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:57.829 04:48:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:57.829 04:48:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:57.829 04:48:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:57.829 04:48:36 -- paths/export.sh@5 -- # export PATH 00:03:57.829 04:48:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:57.829 04:48:36 -- nvmf/common.sh@47 -- # : 0 00:03:57.829 04:48:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:03:57.829 04:48:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:03:57.829 04:48:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:03:57.829 04:48:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:57.829 04:48:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:57.829 04:48:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:03:57.829 04:48:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:03:57.829 04:48:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:03:57.829 04:48:36 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:57.829 04:48:36 -- spdk/autotest.sh@32 -- # uname -s 00:03:57.829 04:48:36 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:57.829 04:48:36 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:57.829 04:48:36 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:57.829 04:48:36 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:57.829 04:48:36 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:57.829 04:48:36 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:57.829 04:48:36 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:57.829 04:48:36 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:57.829 04:48:36 -- spdk/autotest.sh@48 -- # udevadm_pid=2239073 00:03:57.829 04:48:36 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:57.829 04:48:36 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:03:57.829 04:48:36 -- pm/common@17 -- # local monitor 00:03:57.829 04:48:36 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.829 04:48:36 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2239075 00:03:57.829 04:48:36 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.829 04:48:36 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2239078 00:03:57.829 04:48:36 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.829 04:48:36 -- pm/common@21 -- # date +%s 00:03:57.829 04:48:36 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2239080 00:03:57.829 04:48:36 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:57.829 04:48:36 -- pm/common@21 -- # date +%s 00:03:57.829 04:48:36 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2239083 00:03:57.829 04:48:36 -- pm/common@21 -- # date +%s 00:03:57.829 04:48:36 -- pm/common@26 -- # sleep 1 00:03:57.829 04:48:36 -- pm/common@21 -- # date +%s 00:03:57.829 04:48:36 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713840516 00:03:57.829 04:48:36 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713840516 00:03:57.829 04:48:36 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713840516 00:03:57.829 04:48:36 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713840516 00:03:57.829 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713840516_collect-vmstat.pm.log 00:03:57.829 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713840516_collect-bmc-pm.bmc.pm.log 00:03:57.829 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713840516_collect-cpu-load.pm.log 00:03:57.829 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713840516_collect-cpu-temp.pm.log 00:03:58.794 04:48:37 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:58.794 04:48:37 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:03:58.794 04:48:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:58.794 04:48:37 -- common/autotest_common.sh@10 -- # set +x 00:03:58.794 04:48:37 -- spdk/autotest.sh@59 -- # create_test_list 00:03:58.794 04:48:37 -- common/autotest_common.sh@734 -- # xtrace_disable 00:03:58.794 04:48:37 -- common/autotest_common.sh@10 -- # set +x 00:03:58.794 04:48:37 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:58.794 04:48:37 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:58.794 04:48:37 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:58.794 04:48:37 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:58.794 04:48:37 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:58.794 04:48:37 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:03:58.794 04:48:37 -- common/autotest_common.sh@1441 -- # uname 00:03:58.794 04:48:37 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:03:58.794 04:48:37 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:03:58.794 04:48:37 -- common/autotest_common.sh@1461 -- # uname 00:03:58.794 04:48:37 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:03:58.794 04:48:37 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:03:58.794 04:48:37 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:03:58.794 04:48:37 -- spdk/autotest.sh@72 -- # hash lcov 00:03:58.794 04:48:37 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:03:58.794 04:48:37 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:03:58.794 --rc lcov_branch_coverage=1 00:03:58.794 --rc lcov_function_coverage=1 00:03:58.794 --rc genhtml_branch_coverage=1 00:03:58.794 --rc genhtml_function_coverage=1 00:03:58.794 --rc genhtml_legend=1 00:03:58.794 --rc geninfo_all_blocks=1 00:03:58.794 ' 00:03:58.794 04:48:37 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:03:58.794 --rc lcov_branch_coverage=1 00:03:58.794 --rc lcov_function_coverage=1 00:03:58.794 --rc genhtml_branch_coverage=1 00:03:58.794 --rc genhtml_function_coverage=1 00:03:58.794 --rc genhtml_legend=1 00:03:58.794 --rc geninfo_all_blocks=1 00:03:58.794 ' 00:03:58.794 04:48:37 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:03:58.794 --rc lcov_branch_coverage=1 00:03:58.794 --rc lcov_function_coverage=1 00:03:58.794 --rc genhtml_branch_coverage=1 00:03:58.794 --rc genhtml_function_coverage=1 00:03:58.794 --rc genhtml_legend=1 00:03:58.794 --rc geninfo_all_blocks=1 00:03:58.794 --no-external' 00:03:58.794 04:48:37 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:03:58.794 --rc lcov_branch_coverage=1 00:03:58.794 --rc lcov_function_coverage=1 00:03:58.794 --rc genhtml_branch_coverage=1 00:03:58.794 --rc genhtml_function_coverage=1 00:03:58.794 --rc genhtml_legend=1 00:03:58.794 --rc geninfo_all_blocks=1 00:03:58.794 --no-external' 00:03:58.794 04:48:37 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:03:59.053 lcov: LCOV version 1.14 00:03:59.053 04:48:37 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:04:13.925 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:04:13.925 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:04:13.925 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:13.925 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:13.925 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:13.925 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:13.925 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:13.925 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:04:31.996 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:04:31.996 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:04:31.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:04:31.997 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:04:31.997 04:49:10 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:04:31.997 04:49:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:31.997 04:49:10 -- common/autotest_common.sh@10 -- # set +x 00:04:31.997 04:49:10 -- spdk/autotest.sh@91 -- # rm -f 00:04:31.997 04:49:10 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:32.930 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:32.930 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:32.930 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:32.930 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:32.930 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:32.930 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:32.930 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:32.930 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:32.930 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:32.930 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:32.930 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:32.930 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:32.930 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:32.930 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:32.930 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:32.930 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:32.930 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:33.187 04:49:12 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:04:33.187 04:49:12 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:33.187 04:49:12 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:33.187 04:49:12 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:33.187 04:49:12 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:33.187 04:49:12 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:33.187 04:49:12 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:33.187 04:49:12 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:33.187 04:49:12 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:33.187 04:49:12 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:04:33.187 04:49:12 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:04:33.187 04:49:12 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:04:33.187 04:49:12 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:04:33.187 04:49:12 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:04:33.187 04:49:12 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:33.187 No valid GPT data, bailing 00:04:33.187 04:49:12 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:33.187 04:49:12 -- scripts/common.sh@391 -- # pt= 00:04:33.187 04:49:12 -- scripts/common.sh@392 -- # return 1 00:04:33.187 04:49:12 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:33.187 1+0 records in 00:04:33.187 1+0 records out 00:04:33.187 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00184895 s, 567 MB/s 00:04:33.187 04:49:12 -- spdk/autotest.sh@118 -- # sync 00:04:33.187 04:49:12 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:33.187 04:49:12 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:33.187 04:49:12 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:35.085 04:49:13 -- spdk/autotest.sh@124 -- # uname -s 00:04:35.085 04:49:13 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:04:35.085 04:49:13 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:35.085 04:49:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.085 04:49:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.085 04:49:13 -- common/autotest_common.sh@10 -- # set +x 00:04:35.085 ************************************ 00:04:35.085 START TEST setup.sh 00:04:35.085 ************************************ 00:04:35.085 04:49:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:35.085 * Looking for test storage... 00:04:35.085 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:35.085 04:49:14 -- setup/test-setup.sh@10 -- # uname -s 00:04:35.085 04:49:14 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:35.085 04:49:14 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:35.085 04:49:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.085 04:49:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.085 04:49:14 -- common/autotest_common.sh@10 -- # set +x 00:04:35.085 ************************************ 00:04:35.085 START TEST acl 00:04:35.085 ************************************ 00:04:35.085 04:49:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:35.085 * Looking for test storage... 00:04:35.085 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:35.085 04:49:14 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:35.085 04:49:14 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:35.085 04:49:14 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:35.085 04:49:14 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:35.085 04:49:14 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:35.085 04:49:14 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:35.085 04:49:14 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:35.085 04:49:14 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:35.085 04:49:14 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:35.085 04:49:14 -- setup/acl.sh@12 -- # devs=() 00:04:35.085 04:49:14 -- setup/acl.sh@12 -- # declare -a devs 00:04:35.085 04:49:14 -- setup/acl.sh@13 -- # drivers=() 00:04:35.085 04:49:14 -- setup/acl.sh@13 -- # declare -A drivers 00:04:35.085 04:49:14 -- setup/acl.sh@51 -- # setup reset 00:04:35.085 04:49:14 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:35.085 04:49:14 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:36.457 04:49:15 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:36.457 04:49:15 -- setup/acl.sh@16 -- # local dev driver 00:04:36.457 04:49:15 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:36.457 04:49:15 -- setup/acl.sh@15 -- # setup output status 00:04:36.457 04:49:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:36.457 04:49:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:37.830 Hugepages 00:04:37.830 node hugesize free / total 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 00:04:37.830 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.830 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.830 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.830 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # continue 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:37.831 04:49:16 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:37.831 04:49:16 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:37.831 04:49:16 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:37.831 04:49:16 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.831 04:49:16 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:37.831 04:49:16 -- setup/acl.sh@54 -- # run_test denied denied 00:04:37.831 04:49:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.831 04:49:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.831 04:49:16 -- common/autotest_common.sh@10 -- # set +x 00:04:37.831 ************************************ 00:04:37.831 START TEST denied 00:04:37.831 ************************************ 00:04:37.831 04:49:16 -- common/autotest_common.sh@1111 -- # denied 00:04:37.831 04:49:16 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:37.831 04:49:16 -- setup/acl.sh@38 -- # setup output config 00:04:37.831 04:49:16 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:37.831 04:49:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:37.831 04:49:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:39.204 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:39.204 04:49:18 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:39.204 04:49:18 -- setup/acl.sh@28 -- # local dev driver 00:04:39.204 04:49:18 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:39.204 04:49:18 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:39.204 04:49:18 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:39.204 04:49:18 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:39.204 04:49:18 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:39.204 04:49:18 -- setup/acl.sh@41 -- # setup reset 00:04:39.204 04:49:18 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:39.204 04:49:18 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:41.732 00:04:41.732 real 0m3.448s 00:04:41.732 user 0m0.998s 00:04:41.732 sys 0m1.604s 00:04:41.732 04:49:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:41.732 04:49:20 -- common/autotest_common.sh@10 -- # set +x 00:04:41.732 ************************************ 00:04:41.732 END TEST denied 00:04:41.732 ************************************ 00:04:41.732 04:49:20 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:41.732 04:49:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.732 04:49:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.732 04:49:20 -- common/autotest_common.sh@10 -- # set +x 00:04:41.732 ************************************ 00:04:41.732 START TEST allowed 00:04:41.732 ************************************ 00:04:41.732 04:49:20 -- common/autotest_common.sh@1111 -- # allowed 00:04:41.733 04:49:20 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:41.733 04:49:20 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:41.733 04:49:20 -- setup/acl.sh@45 -- # setup output config 00:04:41.733 04:49:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:41.733 04:49:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:43.637 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:43.637 04:49:22 -- setup/acl.sh@47 -- # verify 00:04:43.637 04:49:22 -- setup/acl.sh@28 -- # local dev driver 00:04:43.637 04:49:22 -- setup/acl.sh@48 -- # setup reset 00:04:43.637 04:49:22 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:43.637 04:49:22 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:45.034 00:04:45.034 real 0m3.646s 00:04:45.034 user 0m0.918s 00:04:45.034 sys 0m1.567s 00:04:45.034 04:49:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:45.034 04:49:24 -- common/autotest_common.sh@10 -- # set +x 00:04:45.034 ************************************ 00:04:45.034 END TEST allowed 00:04:45.034 ************************************ 00:04:45.034 00:04:45.034 real 0m9.977s 00:04:45.034 user 0m3.062s 00:04:45.035 sys 0m4.967s 00:04:45.035 04:49:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:45.035 04:49:24 -- common/autotest_common.sh@10 -- # set +x 00:04:45.035 ************************************ 00:04:45.035 END TEST acl 00:04:45.035 ************************************ 00:04:45.035 04:49:24 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:45.035 04:49:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.035 04:49:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.035 04:49:24 -- common/autotest_common.sh@10 -- # set +x 00:04:45.293 ************************************ 00:04:45.293 START TEST hugepages 00:04:45.293 ************************************ 00:04:45.293 04:49:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:45.293 * Looking for test storage... 00:04:45.293 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:45.294 04:49:24 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:45.294 04:49:24 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:45.294 04:49:24 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:45.294 04:49:24 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:45.294 04:49:24 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:45.294 04:49:24 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:45.294 04:49:24 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:45.294 04:49:24 -- setup/common.sh@18 -- # local node= 00:04:45.294 04:49:24 -- setup/common.sh@19 -- # local var val 00:04:45.294 04:49:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.294 04:49:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.294 04:49:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.294 04:49:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.294 04:49:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.294 04:49:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 46927052 kB' 'MemAvailable: 47418232 kB' 'Buffers: 1308 kB' 'Cached: 12270852 kB' 'SwapCached: 0 kB' 'Active: 12419356 kB' 'Inactive: 333900 kB' 'Active(anon): 11853416 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484388 kB' 'Mapped: 194208 kB' 'Shmem: 11372320 kB' 'KReclaimable: 201348 kB' 'Slab: 569632 kB' 'SReclaimable: 201348 kB' 'SUnreclaim: 368284 kB' 'KernelStack: 12944 kB' 'PageTables: 9144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 39142792 kB' 'Committed_AS: 13035020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195944 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.294 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.294 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # continue 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 04:49:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 04:49:24 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.295 04:49:24 -- setup/common.sh@33 -- # echo 2048 00:04:45.295 04:49:24 -- setup/common.sh@33 -- # return 0 00:04:45.295 04:49:24 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:45.295 04:49:24 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:45.295 04:49:24 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:45.295 04:49:24 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:45.295 04:49:24 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:45.295 04:49:24 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:45.295 04:49:24 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:45.295 04:49:24 -- setup/hugepages.sh@207 -- # get_nodes 00:04:45.295 04:49:24 -- setup/hugepages.sh@27 -- # local node 00:04:45.295 04:49:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.295 04:49:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:45.295 04:49:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.295 04:49:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:45.295 04:49:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:45.295 04:49:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:45.295 04:49:24 -- setup/hugepages.sh@208 -- # clear_hp 00:04:45.295 04:49:24 -- setup/hugepages.sh@37 -- # local node hp 00:04:45.295 04:49:24 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:45.295 04:49:24 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.295 04:49:24 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.295 04:49:24 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.295 04:49:24 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.295 04:49:24 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:45.295 04:49:24 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.295 04:49:24 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.295 04:49:24 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.295 04:49:24 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.295 04:49:24 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:45.295 04:49:24 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:45.295 04:49:24 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:45.295 04:49:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.295 04:49:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.295 04:49:24 -- common/autotest_common.sh@10 -- # set +x 00:04:45.553 ************************************ 00:04:45.553 START TEST default_setup 00:04:45.553 ************************************ 00:04:45.553 04:49:24 -- common/autotest_common.sh@1111 -- # default_setup 00:04:45.553 04:49:24 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:45.553 04:49:24 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:45.553 04:49:24 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:45.553 04:49:24 -- setup/hugepages.sh@51 -- # shift 00:04:45.553 04:49:24 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:45.553 04:49:24 -- setup/hugepages.sh@52 -- # local node_ids 00:04:45.553 04:49:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.553 04:49:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:45.553 04:49:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:45.553 04:49:24 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:45.553 04:49:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.553 04:49:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:45.553 04:49:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.553 04:49:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.553 04:49:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.553 04:49:24 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:45.553 04:49:24 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:45.553 04:49:24 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:45.553 04:49:24 -- setup/hugepages.sh@73 -- # return 0 00:04:45.553 04:49:24 -- setup/hugepages.sh@137 -- # setup output 00:04:45.553 04:49:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.553 04:49:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:46.488 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:46.488 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:46.488 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:46.488 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:46.488 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:46.488 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:46.488 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:46.488 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:46.488 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:47.867 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:47.867 04:49:26 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:47.867 04:49:26 -- setup/hugepages.sh@89 -- # local node 00:04:47.867 04:49:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:47.867 04:49:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:47.867 04:49:26 -- setup/hugepages.sh@92 -- # local surp 00:04:47.867 04:49:26 -- setup/hugepages.sh@93 -- # local resv 00:04:47.867 04:49:26 -- setup/hugepages.sh@94 -- # local anon 00:04:47.867 04:49:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:47.867 04:49:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:47.867 04:49:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:47.867 04:49:26 -- setup/common.sh@18 -- # local node= 00:04:47.867 04:49:26 -- setup/common.sh@19 -- # local var val 00:04:47.867 04:49:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.867 04:49:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.867 04:49:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.867 04:49:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.867 04:49:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.867 04:49:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49042300 kB' 'MemAvailable: 49533416 kB' 'Buffers: 1308 kB' 'Cached: 12270948 kB' 'SwapCached: 0 kB' 'Active: 12439600 kB' 'Inactive: 333900 kB' 'Active(anon): 11873660 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504572 kB' 'Mapped: 194512 kB' 'Shmem: 11372416 kB' 'KReclaimable: 201220 kB' 'Slab: 569180 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 367960 kB' 'KernelStack: 13264 kB' 'PageTables: 10272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13057616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196072 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.867 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.867 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.868 04:49:26 -- setup/common.sh@33 -- # echo 0 00:04:47.868 04:49:26 -- setup/common.sh@33 -- # return 0 00:04:47.868 04:49:26 -- setup/hugepages.sh@97 -- # anon=0 00:04:47.868 04:49:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:47.868 04:49:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.868 04:49:26 -- setup/common.sh@18 -- # local node= 00:04:47.868 04:49:26 -- setup/common.sh@19 -- # local var val 00:04:47.868 04:49:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.868 04:49:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.868 04:49:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.868 04:49:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.868 04:49:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.868 04:49:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49047984 kB' 'MemAvailable: 49539100 kB' 'Buffers: 1308 kB' 'Cached: 12270952 kB' 'SwapCached: 0 kB' 'Active: 12438668 kB' 'Inactive: 333900 kB' 'Active(anon): 11872728 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503700 kB' 'Mapped: 194356 kB' 'Shmem: 11372420 kB' 'KReclaimable: 201220 kB' 'Slab: 569148 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 367928 kB' 'KernelStack: 12864 kB' 'PageTables: 9080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13057628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196056 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.868 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.868 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.869 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.869 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.870 04:49:26 -- setup/common.sh@33 -- # echo 0 00:04:47.870 04:49:26 -- setup/common.sh@33 -- # return 0 00:04:47.870 04:49:26 -- setup/hugepages.sh@99 -- # surp=0 00:04:47.870 04:49:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:47.870 04:49:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:47.870 04:49:26 -- setup/common.sh@18 -- # local node= 00:04:47.870 04:49:26 -- setup/common.sh@19 -- # local var val 00:04:47.870 04:49:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.870 04:49:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.870 04:49:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.870 04:49:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.870 04:49:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.870 04:49:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49048944 kB' 'MemAvailable: 49540060 kB' 'Buffers: 1308 kB' 'Cached: 12270964 kB' 'SwapCached: 0 kB' 'Active: 12437832 kB' 'Inactive: 333900 kB' 'Active(anon): 11871892 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502844 kB' 'Mapped: 194320 kB' 'Shmem: 11372432 kB' 'KReclaimable: 201220 kB' 'Slab: 569252 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 368032 kB' 'KernelStack: 12848 kB' 'PageTables: 8996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13057644 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196072 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.870 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.870 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.871 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.871 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.872 04:49:26 -- setup/common.sh@33 -- # echo 0 00:04:47.872 04:49:26 -- setup/common.sh@33 -- # return 0 00:04:47.872 04:49:26 -- setup/hugepages.sh@100 -- # resv=0 00:04:47.872 04:49:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:47.872 nr_hugepages=1024 00:04:47.872 04:49:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:47.872 resv_hugepages=0 00:04:47.872 04:49:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:47.872 surplus_hugepages=0 00:04:47.872 04:49:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:47.872 anon_hugepages=0 00:04:47.872 04:49:26 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.872 04:49:26 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:47.872 04:49:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:47.872 04:49:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:47.872 04:49:26 -- setup/common.sh@18 -- # local node= 00:04:47.872 04:49:26 -- setup/common.sh@19 -- # local var val 00:04:47.872 04:49:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.872 04:49:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.872 04:49:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.872 04:49:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.872 04:49:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.872 04:49:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49050892 kB' 'MemAvailable: 49542008 kB' 'Buffers: 1308 kB' 'Cached: 12270976 kB' 'SwapCached: 0 kB' 'Active: 12437748 kB' 'Inactive: 333900 kB' 'Active(anon): 11871808 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502692 kB' 'Mapped: 194324 kB' 'Shmem: 11372444 kB' 'KReclaimable: 201220 kB' 'Slab: 569316 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 368096 kB' 'KernelStack: 12800 kB' 'PageTables: 8900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13057656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196072 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.872 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.872 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.873 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.873 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.874 04:49:26 -- setup/common.sh@33 -- # echo 1024 00:04:47.874 04:49:26 -- setup/common.sh@33 -- # return 0 00:04:47.874 04:49:26 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.874 04:49:26 -- setup/hugepages.sh@112 -- # get_nodes 00:04:47.874 04:49:26 -- setup/hugepages.sh@27 -- # local node 00:04:47.874 04:49:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.874 04:49:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:47.874 04:49:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.874 04:49:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:47.874 04:49:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:47.874 04:49:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:47.874 04:49:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.874 04:49:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.874 04:49:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:47.874 04:49:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.874 04:49:26 -- setup/common.sh@18 -- # local node=0 00:04:47.874 04:49:26 -- setup/common.sh@19 -- # local var val 00:04:47.874 04:49:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.874 04:49:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.874 04:49:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:47.874 04:49:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:47.874 04:49:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.874 04:49:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876944 kB' 'MemFree: 22050732 kB' 'MemUsed: 10826212 kB' 'SwapCached: 0 kB' 'Active: 7420752 kB' 'Inactive: 144168 kB' 'Active(anon): 7227696 kB' 'Inactive(anon): 0 kB' 'Active(file): 193056 kB' 'Inactive(file): 144168 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7347108 kB' 'Mapped: 100544 kB' 'AnonPages: 221044 kB' 'Shmem: 7009884 kB' 'KernelStack: 7480 kB' 'PageTables: 4732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101852 kB' 'Slab: 338348 kB' 'SReclaimable: 101852 kB' 'SUnreclaim: 236496 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.874 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.874 04:49:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # continue 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.875 04:49:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.875 04:49:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.875 04:49:26 -- setup/common.sh@33 -- # echo 0 00:04:47.875 04:49:26 -- setup/common.sh@33 -- # return 0 00:04:47.875 04:49:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.875 04:49:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.875 04:49:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.875 04:49:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.875 04:49:26 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:47.875 node0=1024 expecting 1024 00:04:47.875 04:49:26 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:47.875 00:04:47.875 real 0m2.395s 00:04:47.875 user 0m0.606s 00:04:47.875 sys 0m0.740s 00:04:47.875 04:49:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:47.875 04:49:26 -- common/autotest_common.sh@10 -- # set +x 00:04:47.875 ************************************ 00:04:47.875 END TEST default_setup 00:04:47.875 ************************************ 00:04:47.875 04:49:26 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:47.875 04:49:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.875 04:49:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.875 04:49:26 -- common/autotest_common.sh@10 -- # set +x 00:04:47.875 ************************************ 00:04:47.875 START TEST per_node_1G_alloc 00:04:47.875 ************************************ 00:04:47.875 04:49:27 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:04:47.875 04:49:27 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:47.875 04:49:27 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:47.875 04:49:27 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:47.875 04:49:27 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:47.875 04:49:27 -- setup/hugepages.sh@51 -- # shift 00:04:47.875 04:49:27 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:47.875 04:49:27 -- setup/hugepages.sh@52 -- # local node_ids 00:04:47.875 04:49:27 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:47.875 04:49:27 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:47.875 04:49:27 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:47.875 04:49:27 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:47.875 04:49:27 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:47.875 04:49:27 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:47.875 04:49:27 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:47.875 04:49:27 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:47.875 04:49:27 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:47.875 04:49:27 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:47.875 04:49:27 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:47.875 04:49:27 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:47.875 04:49:27 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:47.875 04:49:27 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:47.875 04:49:27 -- setup/hugepages.sh@73 -- # return 0 00:04:47.875 04:49:27 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:47.875 04:49:27 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:47.875 04:49:27 -- setup/hugepages.sh@146 -- # setup output 00:04:47.875 04:49:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.875 04:49:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:49.254 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.254 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:49.254 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.254 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.254 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.254 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.254 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.254 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.254 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.254 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.254 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.254 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.254 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.254 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.254 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.254 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.254 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.254 04:49:28 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:49.254 04:49:28 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:49.254 04:49:28 -- setup/hugepages.sh@89 -- # local node 00:04:49.254 04:49:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:49.254 04:49:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:49.254 04:49:28 -- setup/hugepages.sh@92 -- # local surp 00:04:49.254 04:49:28 -- setup/hugepages.sh@93 -- # local resv 00:04:49.254 04:49:28 -- setup/hugepages.sh@94 -- # local anon 00:04:49.254 04:49:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:49.254 04:49:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:49.254 04:49:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:49.254 04:49:28 -- setup/common.sh@18 -- # local node= 00:04:49.254 04:49:28 -- setup/common.sh@19 -- # local var val 00:04:49.254 04:49:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.254 04:49:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.254 04:49:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.254 04:49:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.254 04:49:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.254 04:49:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49052636 kB' 'MemAvailable: 49543752 kB' 'Buffers: 1308 kB' 'Cached: 12271032 kB' 'SwapCached: 0 kB' 'Active: 12438164 kB' 'Inactive: 333900 kB' 'Active(anon): 11872224 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502796 kB' 'Mapped: 194396 kB' 'Shmem: 11372500 kB' 'KReclaimable: 201220 kB' 'Slab: 569464 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 368244 kB' 'KernelStack: 12752 kB' 'PageTables: 8768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13057600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196168 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.254 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.254 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.255 04:49:28 -- setup/common.sh@33 -- # echo 0 00:04:49.255 04:49:28 -- setup/common.sh@33 -- # return 0 00:04:49.255 04:49:28 -- setup/hugepages.sh@97 -- # anon=0 00:04:49.255 04:49:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:49.255 04:49:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.255 04:49:28 -- setup/common.sh@18 -- # local node= 00:04:49.255 04:49:28 -- setup/common.sh@19 -- # local var val 00:04:49.255 04:49:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.255 04:49:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.255 04:49:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.255 04:49:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.255 04:49:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.255 04:49:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49052468 kB' 'MemAvailable: 49543584 kB' 'Buffers: 1308 kB' 'Cached: 12271036 kB' 'SwapCached: 0 kB' 'Active: 12438948 kB' 'Inactive: 333900 kB' 'Active(anon): 11873008 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503668 kB' 'Mapped: 194492 kB' 'Shmem: 11372504 kB' 'KReclaimable: 201220 kB' 'Slab: 569480 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 368260 kB' 'KernelStack: 12784 kB' 'PageTables: 8888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13057980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196152 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.255 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.255 04:49:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.256 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.256 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.257 04:49:28 -- setup/common.sh@33 -- # echo 0 00:04:49.257 04:49:28 -- setup/common.sh@33 -- # return 0 00:04:49.257 04:49:28 -- setup/hugepages.sh@99 -- # surp=0 00:04:49.257 04:49:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:49.257 04:49:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:49.257 04:49:28 -- setup/common.sh@18 -- # local node= 00:04:49.257 04:49:28 -- setup/common.sh@19 -- # local var val 00:04:49.257 04:49:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.257 04:49:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.257 04:49:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.257 04:49:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.257 04:49:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.257 04:49:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49052216 kB' 'MemAvailable: 49543332 kB' 'Buffers: 1308 kB' 'Cached: 12271048 kB' 'SwapCached: 0 kB' 'Active: 12438464 kB' 'Inactive: 333900 kB' 'Active(anon): 11872524 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503128 kB' 'Mapped: 194348 kB' 'Shmem: 11372516 kB' 'KReclaimable: 201220 kB' 'Slab: 569484 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 368264 kB' 'KernelStack: 12816 kB' 'PageTables: 8884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13057992 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196152 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.257 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.257 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.258 04:49:28 -- setup/common.sh@33 -- # echo 0 00:04:49.258 04:49:28 -- setup/common.sh@33 -- # return 0 00:04:49.258 04:49:28 -- setup/hugepages.sh@100 -- # resv=0 00:04:49.258 04:49:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:49.258 nr_hugepages=1024 00:04:49.258 04:49:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:49.258 resv_hugepages=0 00:04:49.258 04:49:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:49.258 surplus_hugepages=0 00:04:49.258 04:49:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:49.258 anon_hugepages=0 00:04:49.258 04:49:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.258 04:49:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:49.258 04:49:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:49.258 04:49:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:49.258 04:49:28 -- setup/common.sh@18 -- # local node= 00:04:49.258 04:49:28 -- setup/common.sh@19 -- # local var val 00:04:49.258 04:49:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.258 04:49:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.258 04:49:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.258 04:49:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.258 04:49:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.258 04:49:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49052276 kB' 'MemAvailable: 49543392 kB' 'Buffers: 1308 kB' 'Cached: 12271068 kB' 'SwapCached: 0 kB' 'Active: 12438200 kB' 'Inactive: 333900 kB' 'Active(anon): 11872260 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502896 kB' 'Mapped: 194348 kB' 'Shmem: 11372536 kB' 'KReclaimable: 201220 kB' 'Slab: 569484 kB' 'SReclaimable: 201220 kB' 'SUnreclaim: 368264 kB' 'KernelStack: 12832 kB' 'PageTables: 8928 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13058008 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196152 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.258 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.258 04:49:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.259 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.259 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.260 04:49:28 -- setup/common.sh@33 -- # echo 1024 00:04:49.260 04:49:28 -- setup/common.sh@33 -- # return 0 00:04:49.260 04:49:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.260 04:49:28 -- setup/hugepages.sh@112 -- # get_nodes 00:04:49.260 04:49:28 -- setup/hugepages.sh@27 -- # local node 00:04:49.260 04:49:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.260 04:49:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:49.260 04:49:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.260 04:49:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:49.260 04:49:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:49.260 04:49:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:49.260 04:49:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.260 04:49:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.260 04:49:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:49.260 04:49:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.260 04:49:28 -- setup/common.sh@18 -- # local node=0 00:04:49.260 04:49:28 -- setup/common.sh@19 -- # local var val 00:04:49.260 04:49:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.260 04:49:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.260 04:49:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:49.260 04:49:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:49.260 04:49:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.260 04:49:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876944 kB' 'MemFree: 23095272 kB' 'MemUsed: 9781672 kB' 'SwapCached: 0 kB' 'Active: 7420324 kB' 'Inactive: 144168 kB' 'Active(anon): 7227268 kB' 'Inactive(anon): 0 kB' 'Active(file): 193056 kB' 'Inactive(file): 144168 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7347116 kB' 'Mapped: 100544 kB' 'AnonPages: 220448 kB' 'Shmem: 7009892 kB' 'KernelStack: 7496 kB' 'PageTables: 4736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101852 kB' 'Slab: 338292 kB' 'SReclaimable: 101852 kB' 'SUnreclaim: 236440 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.260 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.260 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@33 -- # echo 0 00:04:49.261 04:49:28 -- setup/common.sh@33 -- # return 0 00:04:49.261 04:49:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.261 04:49:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.261 04:49:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.261 04:49:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:49.261 04:49:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.261 04:49:28 -- setup/common.sh@18 -- # local node=1 00:04:49.261 04:49:28 -- setup/common.sh@19 -- # local var val 00:04:49.261 04:49:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.261 04:49:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.261 04:49:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:49.261 04:49:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:49.261 04:49:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.261 04:49:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825740 kB' 'MemFree: 25957004 kB' 'MemUsed: 6868736 kB' 'SwapCached: 0 kB' 'Active: 5017692 kB' 'Inactive: 189732 kB' 'Active(anon): 4644808 kB' 'Inactive(anon): 0 kB' 'Active(file): 372884 kB' 'Inactive(file): 189732 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4925284 kB' 'Mapped: 93804 kB' 'AnonPages: 282216 kB' 'Shmem: 4362668 kB' 'KernelStack: 5320 kB' 'PageTables: 4140 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99368 kB' 'Slab: 231192 kB' 'SReclaimable: 99368 kB' 'SUnreclaim: 131824 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.261 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.261 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # continue 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.262 04:49:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.262 04:49:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.262 04:49:28 -- setup/common.sh@33 -- # echo 0 00:04:49.262 04:49:28 -- setup/common.sh@33 -- # return 0 00:04:49.262 04:49:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.262 04:49:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.262 04:49:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.262 04:49:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.262 04:49:28 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:49.262 node0=512 expecting 512 00:04:49.262 04:49:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.262 04:49:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.262 04:49:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.262 04:49:28 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:49.262 node1=512 expecting 512 00:04:49.262 04:49:28 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:49.262 00:04:49.262 real 0m1.368s 00:04:49.262 user 0m0.561s 00:04:49.262 sys 0m0.768s 00:04:49.262 04:49:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:49.262 04:49:28 -- common/autotest_common.sh@10 -- # set +x 00:04:49.262 ************************************ 00:04:49.262 END TEST per_node_1G_alloc 00:04:49.262 ************************************ 00:04:49.262 04:49:28 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:49.262 04:49:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.262 04:49:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.262 04:49:28 -- common/autotest_common.sh@10 -- # set +x 00:04:49.520 ************************************ 00:04:49.520 START TEST even_2G_alloc 00:04:49.520 ************************************ 00:04:49.520 04:49:28 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:04:49.520 04:49:28 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:49.520 04:49:28 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:49.520 04:49:28 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:49.520 04:49:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:49.520 04:49:28 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:49.520 04:49:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:49.520 04:49:28 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:49.520 04:49:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:49.520 04:49:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:49.520 04:49:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:49.520 04:49:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:49.520 04:49:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:49.520 04:49:28 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:49.520 04:49:28 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:49.520 04:49:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.520 04:49:28 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:49.520 04:49:28 -- setup/hugepages.sh@83 -- # : 512 00:04:49.520 04:49:28 -- setup/hugepages.sh@84 -- # : 1 00:04:49.520 04:49:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.520 04:49:28 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:49.520 04:49:28 -- setup/hugepages.sh@83 -- # : 0 00:04:49.520 04:49:28 -- setup/hugepages.sh@84 -- # : 0 00:04:49.520 04:49:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.520 04:49:28 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:49.520 04:49:28 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:49.520 04:49:28 -- setup/hugepages.sh@153 -- # setup output 00:04:49.520 04:49:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:49.520 04:49:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.453 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.453 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:50.453 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.453 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.453 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.453 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.453 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.453 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.453 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.714 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.714 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.714 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.714 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.714 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.715 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.715 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.715 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.715 04:49:29 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:50.715 04:49:29 -- setup/hugepages.sh@89 -- # local node 00:04:50.715 04:49:29 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:50.715 04:49:29 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:50.715 04:49:29 -- setup/hugepages.sh@92 -- # local surp 00:04:50.715 04:49:29 -- setup/hugepages.sh@93 -- # local resv 00:04:50.715 04:49:29 -- setup/hugepages.sh@94 -- # local anon 00:04:50.715 04:49:29 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:50.715 04:49:29 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:50.715 04:49:29 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:50.715 04:49:29 -- setup/common.sh@18 -- # local node= 00:04:50.715 04:49:29 -- setup/common.sh@19 -- # local var val 00:04:50.715 04:49:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.715 04:49:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.715 04:49:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.715 04:49:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.715 04:49:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.715 04:49:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49056428 kB' 'MemAvailable: 49547516 kB' 'Buffers: 1308 kB' 'Cached: 12271140 kB' 'SwapCached: 0 kB' 'Active: 12431600 kB' 'Inactive: 333900 kB' 'Active(anon): 11865660 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496376 kB' 'Mapped: 193316 kB' 'Shmem: 11372608 kB' 'KReclaimable: 201164 kB' 'Slab: 569092 kB' 'SReclaimable: 201164 kB' 'SUnreclaim: 367928 kB' 'KernelStack: 12704 kB' 'PageTables: 8260 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13031364 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195960 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.715 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.715 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.716 04:49:29 -- setup/common.sh@33 -- # echo 0 00:04:50.716 04:49:29 -- setup/common.sh@33 -- # return 0 00:04:50.716 04:49:29 -- setup/hugepages.sh@97 -- # anon=0 00:04:50.716 04:49:29 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:50.716 04:49:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.716 04:49:29 -- setup/common.sh@18 -- # local node= 00:04:50.716 04:49:29 -- setup/common.sh@19 -- # local var val 00:04:50.716 04:49:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.716 04:49:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.716 04:49:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.716 04:49:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.716 04:49:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.716 04:49:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49056256 kB' 'MemAvailable: 49547344 kB' 'Buffers: 1308 kB' 'Cached: 12271140 kB' 'SwapCached: 0 kB' 'Active: 12431532 kB' 'Inactive: 333900 kB' 'Active(anon): 11865592 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496356 kB' 'Mapped: 193316 kB' 'Shmem: 11372608 kB' 'KReclaimable: 201164 kB' 'Slab: 569092 kB' 'SReclaimable: 201164 kB' 'SUnreclaim: 367928 kB' 'KernelStack: 12672 kB' 'PageTables: 8112 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13031376 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195928 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.716 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.716 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.717 04:49:29 -- setup/common.sh@33 -- # echo 0 00:04:50.717 04:49:29 -- setup/common.sh@33 -- # return 0 00:04:50.717 04:49:29 -- setup/hugepages.sh@99 -- # surp=0 00:04:50.717 04:49:29 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:50.717 04:49:29 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:50.717 04:49:29 -- setup/common.sh@18 -- # local node= 00:04:50.717 04:49:29 -- setup/common.sh@19 -- # local var val 00:04:50.717 04:49:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.717 04:49:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.717 04:49:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.717 04:49:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.717 04:49:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.717 04:49:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49054996 kB' 'MemAvailable: 49546084 kB' 'Buffers: 1308 kB' 'Cached: 12271152 kB' 'SwapCached: 0 kB' 'Active: 12431060 kB' 'Inactive: 333900 kB' 'Active(anon): 11865120 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495836 kB' 'Mapped: 193316 kB' 'Shmem: 11372620 kB' 'KReclaimable: 201164 kB' 'Slab: 569088 kB' 'SReclaimable: 201164 kB' 'SUnreclaim: 367924 kB' 'KernelStack: 12704 kB' 'PageTables: 8212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13031388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195928 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.717 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.717 04:49:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.718 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.718 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.719 04:49:29 -- setup/common.sh@33 -- # echo 0 00:04:50.719 04:49:29 -- setup/common.sh@33 -- # return 0 00:04:50.719 04:49:29 -- setup/hugepages.sh@100 -- # resv=0 00:04:50.719 04:49:29 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:50.719 nr_hugepages=1024 00:04:50.719 04:49:29 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:50.719 resv_hugepages=0 00:04:50.719 04:49:29 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:50.719 surplus_hugepages=0 00:04:50.719 04:49:29 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:50.719 anon_hugepages=0 00:04:50.719 04:49:29 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.719 04:49:29 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:50.719 04:49:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:50.719 04:49:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:50.719 04:49:29 -- setup/common.sh@18 -- # local node= 00:04:50.719 04:49:29 -- setup/common.sh@19 -- # local var val 00:04:50.719 04:49:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.719 04:49:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.719 04:49:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.719 04:49:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.719 04:49:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.719 04:49:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49053988 kB' 'MemAvailable: 49545076 kB' 'Buffers: 1308 kB' 'Cached: 12271168 kB' 'SwapCached: 0 kB' 'Active: 12431080 kB' 'Inactive: 333900 kB' 'Active(anon): 11865140 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495836 kB' 'Mapped: 193316 kB' 'Shmem: 11372636 kB' 'KReclaimable: 201164 kB' 'Slab: 569088 kB' 'SReclaimable: 201164 kB' 'SUnreclaim: 367924 kB' 'KernelStack: 12704 kB' 'PageTables: 8212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13031404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195928 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.719 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.719 04:49:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.720 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.720 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.720 04:49:29 -- setup/common.sh@33 -- # echo 1024 00:04:50.720 04:49:29 -- setup/common.sh@33 -- # return 0 00:04:50.720 04:49:29 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.720 04:49:29 -- setup/hugepages.sh@112 -- # get_nodes 00:04:50.720 04:49:29 -- setup/hugepages.sh@27 -- # local node 00:04:50.720 04:49:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.720 04:49:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:50.720 04:49:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.720 04:49:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:50.720 04:49:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:50.720 04:49:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:50.720 04:49:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.720 04:49:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.720 04:49:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:50.720 04:49:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.720 04:49:29 -- setup/common.sh@18 -- # local node=0 00:04:50.720 04:49:29 -- setup/common.sh@19 -- # local var val 00:04:50.980 04:49:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.980 04:49:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.980 04:49:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:50.980 04:49:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:50.980 04:49:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.980 04:49:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876944 kB' 'MemFree: 23085804 kB' 'MemUsed: 9791140 kB' 'SwapCached: 0 kB' 'Active: 7417644 kB' 'Inactive: 144168 kB' 'Active(anon): 7224588 kB' 'Inactive(anon): 0 kB' 'Active(file): 193056 kB' 'Inactive(file): 144168 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7347128 kB' 'Mapped: 99584 kB' 'AnonPages: 217880 kB' 'Shmem: 7009904 kB' 'KernelStack: 7528 kB' 'PageTables: 4688 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101820 kB' 'Slab: 338124 kB' 'SReclaimable: 101820 kB' 'SUnreclaim: 236304 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.980 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.980 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@33 -- # echo 0 00:04:50.981 04:49:29 -- setup/common.sh@33 -- # return 0 00:04:50.981 04:49:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.981 04:49:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.981 04:49:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.981 04:49:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:50.981 04:49:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.981 04:49:29 -- setup/common.sh@18 -- # local node=1 00:04:50.981 04:49:29 -- setup/common.sh@19 -- # local var val 00:04:50.981 04:49:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.981 04:49:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.981 04:49:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:50.981 04:49:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:50.981 04:49:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.981 04:49:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825740 kB' 'MemFree: 25968560 kB' 'MemUsed: 6857180 kB' 'SwapCached: 0 kB' 'Active: 5013188 kB' 'Inactive: 189732 kB' 'Active(anon): 4640304 kB' 'Inactive(anon): 0 kB' 'Active(file): 372884 kB' 'Inactive(file): 189732 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4925372 kB' 'Mapped: 93732 kB' 'AnonPages: 277660 kB' 'Shmem: 4362756 kB' 'KernelStack: 5144 kB' 'PageTables: 3416 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99344 kB' 'Slab: 230964 kB' 'SReclaimable: 99344 kB' 'SUnreclaim: 131620 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.981 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.981 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # continue 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.982 04:49:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.982 04:49:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.982 04:49:29 -- setup/common.sh@33 -- # echo 0 00:04:50.982 04:49:29 -- setup/common.sh@33 -- # return 0 00:04:50.982 04:49:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.982 04:49:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.982 04:49:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.982 04:49:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.982 04:49:29 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:50.982 node0=512 expecting 512 00:04:50.982 04:49:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.982 04:49:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.982 04:49:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.982 04:49:29 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:50.982 node1=512 expecting 512 00:04:50.982 04:49:29 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:50.982 00:04:50.982 real 0m1.423s 00:04:50.982 user 0m0.593s 00:04:50.982 sys 0m0.794s 00:04:50.982 04:49:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:50.982 04:49:29 -- common/autotest_common.sh@10 -- # set +x 00:04:50.982 ************************************ 00:04:50.982 END TEST even_2G_alloc 00:04:50.982 ************************************ 00:04:50.982 04:49:29 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:50.982 04:49:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.982 04:49:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.982 04:49:29 -- common/autotest_common.sh@10 -- # set +x 00:04:50.982 ************************************ 00:04:50.982 START TEST odd_alloc 00:04:50.982 ************************************ 00:04:50.982 04:49:30 -- common/autotest_common.sh@1111 -- # odd_alloc 00:04:50.982 04:49:30 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:50.982 04:49:30 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:50.982 04:49:30 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:50.982 04:49:30 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:50.982 04:49:30 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:50.982 04:49:30 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:50.982 04:49:30 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:50.982 04:49:30 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:50.982 04:49:30 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:50.982 04:49:30 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:50.982 04:49:30 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:50.982 04:49:30 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:50.982 04:49:30 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:50.982 04:49:30 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:50.982 04:49:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.982 04:49:30 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:50.982 04:49:30 -- setup/hugepages.sh@83 -- # : 513 00:04:50.982 04:49:30 -- setup/hugepages.sh@84 -- # : 1 00:04:50.983 04:49:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.983 04:49:30 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:50.983 04:49:30 -- setup/hugepages.sh@83 -- # : 0 00:04:50.983 04:49:30 -- setup/hugepages.sh@84 -- # : 0 00:04:50.983 04:49:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.983 04:49:30 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:50.983 04:49:30 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:50.983 04:49:30 -- setup/hugepages.sh@160 -- # setup output 00:04:50.983 04:49:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:50.983 04:49:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:52.361 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.361 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:52.361 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.361 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.361 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.361 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.361 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.361 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.361 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.361 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.361 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.361 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.361 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.361 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.361 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.361 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.361 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.361 04:49:31 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:52.361 04:49:31 -- setup/hugepages.sh@89 -- # local node 00:04:52.361 04:49:31 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:52.361 04:49:31 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:52.361 04:49:31 -- setup/hugepages.sh@92 -- # local surp 00:04:52.361 04:49:31 -- setup/hugepages.sh@93 -- # local resv 00:04:52.361 04:49:31 -- setup/hugepages.sh@94 -- # local anon 00:04:52.361 04:49:31 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:52.361 04:49:31 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:52.361 04:49:31 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:52.361 04:49:31 -- setup/common.sh@18 -- # local node= 00:04:52.361 04:49:31 -- setup/common.sh@19 -- # local var val 00:04:52.361 04:49:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.361 04:49:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.361 04:49:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.361 04:49:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.361 04:49:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.361 04:49:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49059720 kB' 'MemAvailable: 49550800 kB' 'Buffers: 1308 kB' 'Cached: 12271232 kB' 'SwapCached: 0 kB' 'Active: 12431692 kB' 'Inactive: 333900 kB' 'Active(anon): 11865752 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496144 kB' 'Mapped: 193352 kB' 'Shmem: 11372700 kB' 'KReclaimable: 201148 kB' 'Slab: 568744 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367596 kB' 'KernelStack: 12624 kB' 'PageTables: 7892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40190344 kB' 'Committed_AS: 13031456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196040 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 04:49:31 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.362 04:49:31 -- setup/common.sh@33 -- # echo 0 00:04:52.362 04:49:31 -- setup/common.sh@33 -- # return 0 00:04:52.362 04:49:31 -- setup/hugepages.sh@97 -- # anon=0 00:04:52.362 04:49:31 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:52.362 04:49:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.362 04:49:31 -- setup/common.sh@18 -- # local node= 00:04:52.362 04:49:31 -- setup/common.sh@19 -- # local var val 00:04:52.362 04:49:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.362 04:49:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.362 04:49:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.362 04:49:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.362 04:49:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.362 04:49:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 04:49:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49058800 kB' 'MemAvailable: 49549880 kB' 'Buffers: 1308 kB' 'Cached: 12271236 kB' 'SwapCached: 0 kB' 'Active: 12431028 kB' 'Inactive: 333900 kB' 'Active(anon): 11865088 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495584 kB' 'Mapped: 193420 kB' 'Shmem: 11372704 kB' 'KReclaimable: 201148 kB' 'Slab: 568744 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367596 kB' 'KernelStack: 12736 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40190344 kB' 'Committed_AS: 13031468 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196008 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:52.362 04:49:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 04:49:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.364 04:49:31 -- setup/common.sh@33 -- # echo 0 00:04:52.364 04:49:31 -- setup/common.sh@33 -- # return 0 00:04:52.364 04:49:31 -- setup/hugepages.sh@99 -- # surp=0 00:04:52.364 04:49:31 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:52.364 04:49:31 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:52.364 04:49:31 -- setup/common.sh@18 -- # local node= 00:04:52.364 04:49:31 -- setup/common.sh@19 -- # local var val 00:04:52.364 04:49:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.364 04:49:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.364 04:49:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.364 04:49:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.364 04:49:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.364 04:49:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49059060 kB' 'MemAvailable: 49550140 kB' 'Buffers: 1308 kB' 'Cached: 12271248 kB' 'SwapCached: 0 kB' 'Active: 12430792 kB' 'Inactive: 333900 kB' 'Active(anon): 11864852 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495332 kB' 'Mapped: 193344 kB' 'Shmem: 11372716 kB' 'KReclaimable: 201148 kB' 'Slab: 568740 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367592 kB' 'KernelStack: 12736 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40190344 kB' 'Committed_AS: 13031484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196008 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 04:49:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.365 04:49:31 -- setup/common.sh@33 -- # echo 0 00:04:52.365 04:49:31 -- setup/common.sh@33 -- # return 0 00:04:52.365 04:49:31 -- setup/hugepages.sh@100 -- # resv=0 00:04:52.365 04:49:31 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:52.365 nr_hugepages=1025 00:04:52.365 04:49:31 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:52.365 resv_hugepages=0 00:04:52.365 04:49:31 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:52.365 surplus_hugepages=0 00:04:52.365 04:49:31 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:52.365 anon_hugepages=0 00:04:52.365 04:49:31 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:52.365 04:49:31 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:52.365 04:49:31 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:52.365 04:49:31 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:52.365 04:49:31 -- setup/common.sh@18 -- # local node= 00:04:52.365 04:49:31 -- setup/common.sh@19 -- # local var val 00:04:52.365 04:49:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.365 04:49:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.365 04:49:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.365 04:49:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.365 04:49:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.365 04:49:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49059272 kB' 'MemAvailable: 49550352 kB' 'Buffers: 1308 kB' 'Cached: 12271260 kB' 'SwapCached: 0 kB' 'Active: 12430688 kB' 'Inactive: 333900 kB' 'Active(anon): 11864748 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495216 kB' 'Mapped: 193344 kB' 'Shmem: 11372728 kB' 'KReclaimable: 201148 kB' 'Slab: 568740 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367592 kB' 'KernelStack: 12720 kB' 'PageTables: 8148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40190344 kB' 'Committed_AS: 13031496 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195992 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.365 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.366 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.366 04:49:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.367 04:49:31 -- setup/common.sh@33 -- # echo 1025 00:04:52.367 04:49:31 -- setup/common.sh@33 -- # return 0 00:04:52.367 04:49:31 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:52.367 04:49:31 -- setup/hugepages.sh@112 -- # get_nodes 00:04:52.367 04:49:31 -- setup/hugepages.sh@27 -- # local node 00:04:52.367 04:49:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.367 04:49:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:52.367 04:49:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.367 04:49:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:52.367 04:49:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:52.367 04:49:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:52.367 04:49:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:52.367 04:49:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:52.367 04:49:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:52.367 04:49:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.367 04:49:31 -- setup/common.sh@18 -- # local node=0 00:04:52.367 04:49:31 -- setup/common.sh@19 -- # local var val 00:04:52.367 04:49:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.367 04:49:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.367 04:49:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:52.367 04:49:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:52.367 04:49:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.367 04:49:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876944 kB' 'MemFree: 23086280 kB' 'MemUsed: 9790664 kB' 'SwapCached: 0 kB' 'Active: 7417392 kB' 'Inactive: 144168 kB' 'Active(anon): 7224336 kB' 'Inactive(anon): 0 kB' 'Active(file): 193056 kB' 'Inactive(file): 144168 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7347188 kB' 'Mapped: 99584 kB' 'AnonPages: 217496 kB' 'Shmem: 7009964 kB' 'KernelStack: 7576 kB' 'PageTables: 4780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101804 kB' 'Slab: 337912 kB' 'SReclaimable: 101804 kB' 'SUnreclaim: 236108 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.367 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.367 04:49:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@33 -- # echo 0 00:04:52.368 04:49:31 -- setup/common.sh@33 -- # return 0 00:04:52.368 04:49:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:52.368 04:49:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:52.368 04:49:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:52.368 04:49:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:52.368 04:49:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.368 04:49:31 -- setup/common.sh@18 -- # local node=1 00:04:52.368 04:49:31 -- setup/common.sh@19 -- # local var val 00:04:52.368 04:49:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.368 04:49:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.368 04:49:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:52.368 04:49:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:52.368 04:49:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.368 04:49:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825740 kB' 'MemFree: 25972740 kB' 'MemUsed: 6853000 kB' 'SwapCached: 0 kB' 'Active: 5013284 kB' 'Inactive: 189732 kB' 'Active(anon): 4640400 kB' 'Inactive(anon): 0 kB' 'Active(file): 372884 kB' 'Inactive(file): 189732 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4925396 kB' 'Mapped: 93760 kB' 'AnonPages: 277676 kB' 'Shmem: 4362780 kB' 'KernelStack: 5160 kB' 'PageTables: 3420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99344 kB' 'Slab: 230828 kB' 'SReclaimable: 99344 kB' 'SUnreclaim: 131484 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.368 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.368 04:49:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # continue 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.369 04:49:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.369 04:49:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.369 04:49:31 -- setup/common.sh@33 -- # echo 0 00:04:52.369 04:49:31 -- setup/common.sh@33 -- # return 0 00:04:52.369 04:49:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:52.369 04:49:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:52.369 04:49:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:52.369 04:49:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:52.369 04:49:31 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:52.369 node0=512 expecting 513 00:04:52.369 04:49:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:52.369 04:49:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:52.369 04:49:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:52.369 04:49:31 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:52.369 node1=513 expecting 512 00:04:52.369 04:49:31 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:52.369 00:04:52.369 real 0m1.366s 00:04:52.369 user 0m0.554s 00:04:52.369 sys 0m0.775s 00:04:52.369 04:49:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:52.369 04:49:31 -- common/autotest_common.sh@10 -- # set +x 00:04:52.369 ************************************ 00:04:52.369 END TEST odd_alloc 00:04:52.369 ************************************ 00:04:52.369 04:49:31 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:52.369 04:49:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:52.369 04:49:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.369 04:49:31 -- common/autotest_common.sh@10 -- # set +x 00:04:52.628 ************************************ 00:04:52.628 START TEST custom_alloc 00:04:52.628 ************************************ 00:04:52.628 04:49:31 -- common/autotest_common.sh@1111 -- # custom_alloc 00:04:52.628 04:49:31 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:52.628 04:49:31 -- setup/hugepages.sh@169 -- # local node 00:04:52.628 04:49:31 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:52.628 04:49:31 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:52.628 04:49:31 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:52.628 04:49:31 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:52.628 04:49:31 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:52.628 04:49:31 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:52.628 04:49:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:52.628 04:49:31 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:52.628 04:49:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:52.628 04:49:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:52.628 04:49:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:52.628 04:49:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:52.628 04:49:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:52.628 04:49:31 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:52.628 04:49:31 -- setup/hugepages.sh@83 -- # : 256 00:04:52.628 04:49:31 -- setup/hugepages.sh@84 -- # : 1 00:04:52.628 04:49:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:52.628 04:49:31 -- setup/hugepages.sh@83 -- # : 0 00:04:52.628 04:49:31 -- setup/hugepages.sh@84 -- # : 0 00:04:52.628 04:49:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:52.628 04:49:31 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:52.628 04:49:31 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:52.628 04:49:31 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:52.628 04:49:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:52.628 04:49:31 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:52.628 04:49:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:52.628 04:49:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:52.628 04:49:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:52.628 04:49:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:52.628 04:49:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:52.628 04:49:31 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:52.628 04:49:31 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:52.628 04:49:31 -- setup/hugepages.sh@78 -- # return 0 00:04:52.628 04:49:31 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:52.628 04:49:31 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:52.628 04:49:31 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:52.628 04:49:31 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:52.628 04:49:31 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:52.628 04:49:31 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:52.628 04:49:31 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:52.628 04:49:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:52.628 04:49:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:52.628 04:49:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:52.628 04:49:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:52.628 04:49:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:52.628 04:49:31 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:52.628 04:49:31 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:52.628 04:49:31 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:52.628 04:49:31 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:52.628 04:49:31 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:52.628 04:49:31 -- setup/hugepages.sh@78 -- # return 0 00:04:52.628 04:49:31 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:52.628 04:49:31 -- setup/hugepages.sh@187 -- # setup output 00:04:52.628 04:49:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:52.628 04:49:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:53.564 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.564 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:53.564 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.564 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.564 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.564 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.564 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.564 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.564 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.564 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.564 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.564 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.564 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.564 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.564 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.564 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.564 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.564 04:49:32 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:53.564 04:49:32 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:53.564 04:49:32 -- setup/hugepages.sh@89 -- # local node 00:04:53.564 04:49:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:53.564 04:49:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:53.564 04:49:32 -- setup/hugepages.sh@92 -- # local surp 00:04:53.564 04:49:32 -- setup/hugepages.sh@93 -- # local resv 00:04:53.564 04:49:32 -- setup/hugepages.sh@94 -- # local anon 00:04:53.564 04:49:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:53.564 04:49:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:53.564 04:49:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:53.564 04:49:32 -- setup/common.sh@18 -- # local node= 00:04:53.564 04:49:32 -- setup/common.sh@19 -- # local var val 00:04:53.564 04:49:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.564 04:49:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.564 04:49:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.564 04:49:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.564 04:49:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.564 04:49:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.564 04:49:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 47999900 kB' 'MemAvailable: 48490996 kB' 'Buffers: 1308 kB' 'Cached: 12271336 kB' 'SwapCached: 0 kB' 'Active: 12430212 kB' 'Inactive: 333900 kB' 'Active(anon): 11864272 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494820 kB' 'Mapped: 193536 kB' 'Shmem: 11372804 kB' 'KReclaimable: 201180 kB' 'Slab: 568616 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367436 kB' 'KernelStack: 12752 kB' 'PageTables: 8248 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 39667080 kB' 'Committed_AS: 13031200 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196088 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.564 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.564 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.565 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.565 04:49:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.565 04:49:32 -- setup/common.sh@33 -- # echo 0 00:04:53.565 04:49:32 -- setup/common.sh@33 -- # return 0 00:04:53.565 04:49:32 -- setup/hugepages.sh@97 -- # anon=0 00:04:53.828 04:49:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:53.828 04:49:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.828 04:49:32 -- setup/common.sh@18 -- # local node= 00:04:53.828 04:49:32 -- setup/common.sh@19 -- # local var val 00:04:53.828 04:49:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.828 04:49:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.828 04:49:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.828 04:49:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.828 04:49:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.828 04:49:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 48001516 kB' 'MemAvailable: 48492612 kB' 'Buffers: 1308 kB' 'Cached: 12271336 kB' 'SwapCached: 0 kB' 'Active: 12430732 kB' 'Inactive: 333900 kB' 'Active(anon): 11864792 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495408 kB' 'Mapped: 193536 kB' 'Shmem: 11372804 kB' 'KReclaimable: 201180 kB' 'Slab: 568592 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367412 kB' 'KernelStack: 12720 kB' 'PageTables: 8116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 39667080 kB' 'Committed_AS: 13031212 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196056 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.829 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.829 04:49:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.830 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.830 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.831 04:49:32 -- setup/common.sh@33 -- # echo 0 00:04:53.831 04:49:32 -- setup/common.sh@33 -- # return 0 00:04:53.831 04:49:32 -- setup/hugepages.sh@99 -- # surp=0 00:04:53.831 04:49:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:53.831 04:49:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:53.831 04:49:32 -- setup/common.sh@18 -- # local node= 00:04:53.831 04:49:32 -- setup/common.sh@19 -- # local var val 00:04:53.831 04:49:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.831 04:49:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.831 04:49:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.831 04:49:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.831 04:49:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.831 04:49:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 48001880 kB' 'MemAvailable: 48492976 kB' 'Buffers: 1308 kB' 'Cached: 12271348 kB' 'SwapCached: 0 kB' 'Active: 12430536 kB' 'Inactive: 333900 kB' 'Active(anon): 11864596 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495148 kB' 'Mapped: 193520 kB' 'Shmem: 11372816 kB' 'KReclaimable: 201180 kB' 'Slab: 568592 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367412 kB' 'KernelStack: 12768 kB' 'PageTables: 8272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 39667080 kB' 'Committed_AS: 13031228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196056 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.831 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.831 04:49:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.832 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.832 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.833 04:49:32 -- setup/common.sh@33 -- # echo 0 00:04:53.833 04:49:32 -- setup/common.sh@33 -- # return 0 00:04:53.833 04:49:32 -- setup/hugepages.sh@100 -- # resv=0 00:04:53.833 04:49:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:53.833 nr_hugepages=1536 00:04:53.833 04:49:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:53.833 resv_hugepages=0 00:04:53.833 04:49:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:53.833 surplus_hugepages=0 00:04:53.833 04:49:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:53.833 anon_hugepages=0 00:04:53.833 04:49:32 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:53.833 04:49:32 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:53.833 04:49:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:53.833 04:49:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:53.833 04:49:32 -- setup/common.sh@18 -- # local node= 00:04:53.833 04:49:32 -- setup/common.sh@19 -- # local var val 00:04:53.833 04:49:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.833 04:49:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.833 04:49:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.833 04:49:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.833 04:49:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.833 04:49:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 48001788 kB' 'MemAvailable: 48492884 kB' 'Buffers: 1308 kB' 'Cached: 12271364 kB' 'SwapCached: 0 kB' 'Active: 12430328 kB' 'Inactive: 333900 kB' 'Active(anon): 11864388 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494928 kB' 'Mapped: 193444 kB' 'Shmem: 11372832 kB' 'KReclaimable: 201180 kB' 'Slab: 568616 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367436 kB' 'KernelStack: 12752 kB' 'PageTables: 8212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 39667080 kB' 'Committed_AS: 13031240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196056 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.833 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.833 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.834 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.834 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.835 04:49:32 -- setup/common.sh@33 -- # echo 1536 00:04:53.835 04:49:32 -- setup/common.sh@33 -- # return 0 00:04:53.835 04:49:32 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:53.835 04:49:32 -- setup/hugepages.sh@112 -- # get_nodes 00:04:53.835 04:49:32 -- setup/hugepages.sh@27 -- # local node 00:04:53.835 04:49:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:53.835 04:49:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:53.835 04:49:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:53.835 04:49:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:53.835 04:49:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:53.835 04:49:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:53.835 04:49:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:53.835 04:49:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:53.835 04:49:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:53.835 04:49:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.835 04:49:32 -- setup/common.sh@18 -- # local node=0 00:04:53.835 04:49:32 -- setup/common.sh@19 -- # local var val 00:04:53.835 04:49:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.835 04:49:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.835 04:49:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:53.835 04:49:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:53.835 04:49:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.835 04:49:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876944 kB' 'MemFree: 23068932 kB' 'MemUsed: 9808012 kB' 'SwapCached: 0 kB' 'Active: 7415892 kB' 'Inactive: 144168 kB' 'Active(anon): 7222836 kB' 'Inactive(anon): 0 kB' 'Active(file): 193056 kB' 'Inactive(file): 144168 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7347280 kB' 'Mapped: 99584 kB' 'AnonPages: 215884 kB' 'Shmem: 7010056 kB' 'KernelStack: 7560 kB' 'PageTables: 4572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101836 kB' 'Slab: 337920 kB' 'SReclaimable: 101836 kB' 'SUnreclaim: 236084 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.835 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.835 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@33 -- # echo 0 00:04:53.836 04:49:32 -- setup/common.sh@33 -- # return 0 00:04:53.836 04:49:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:53.836 04:49:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:53.836 04:49:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:53.836 04:49:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:53.836 04:49:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.836 04:49:32 -- setup/common.sh@18 -- # local node=1 00:04:53.836 04:49:32 -- setup/common.sh@19 -- # local var val 00:04:53.836 04:49:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.836 04:49:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.836 04:49:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:53.836 04:49:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:53.836 04:49:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.836 04:49:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825740 kB' 'MemFree: 24933292 kB' 'MemUsed: 7892448 kB' 'SwapCached: 0 kB' 'Active: 5014336 kB' 'Inactive: 189732 kB' 'Active(anon): 4641452 kB' 'Inactive(anon): 0 kB' 'Active(file): 372884 kB' 'Inactive(file): 189732 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4925404 kB' 'Mapped: 93860 kB' 'AnonPages: 278876 kB' 'Shmem: 4362788 kB' 'KernelStack: 5192 kB' 'PageTables: 3640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99344 kB' 'Slab: 230696 kB' 'SReclaimable: 99344 kB' 'SUnreclaim: 131352 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # continue 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 04:49:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 04:49:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 04:49:32 -- setup/common.sh@33 -- # echo 0 00:04:53.837 04:49:32 -- setup/common.sh@33 -- # return 0 00:04:53.837 04:49:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:53.837 04:49:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:53.837 04:49:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:53.837 04:49:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:53.837 04:49:32 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:53.837 node0=512 expecting 512 00:04:53.837 04:49:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:53.837 04:49:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:53.837 04:49:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:53.837 04:49:32 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:53.837 node1=1024 expecting 1024 00:04:53.837 04:49:32 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:53.837 00:04:53.837 real 0m1.327s 00:04:53.837 user 0m0.565s 00:04:53.837 sys 0m0.721s 00:04:53.837 04:49:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:53.837 04:49:32 -- common/autotest_common.sh@10 -- # set +x 00:04:53.837 ************************************ 00:04:53.837 END TEST custom_alloc 00:04:53.837 ************************************ 00:04:53.837 04:49:32 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:53.837 04:49:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.837 04:49:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.837 04:49:32 -- common/autotest_common.sh@10 -- # set +x 00:04:53.837 ************************************ 00:04:53.837 START TEST no_shrink_alloc 00:04:53.837 ************************************ 00:04:53.837 04:49:32 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:04:53.837 04:49:32 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:53.837 04:49:32 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:53.837 04:49:32 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:53.837 04:49:32 -- setup/hugepages.sh@51 -- # shift 00:04:53.837 04:49:32 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:53.837 04:49:32 -- setup/hugepages.sh@52 -- # local node_ids 00:04:53.837 04:49:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:53.837 04:49:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:53.837 04:49:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:53.837 04:49:32 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:53.837 04:49:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:53.837 04:49:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:53.837 04:49:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:53.837 04:49:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:53.837 04:49:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:53.837 04:49:32 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:53.837 04:49:32 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:53.837 04:49:32 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:53.837 04:49:32 -- setup/hugepages.sh@73 -- # return 0 00:04:53.837 04:49:32 -- setup/hugepages.sh@198 -- # setup output 00:04:53.837 04:49:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.837 04:49:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:55.216 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:55.216 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:55.216 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:55.216 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:55.216 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:55.216 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:55.216 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:55.216 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:55.216 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:55.216 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:55.216 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:55.216 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:55.216 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:55.216 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:55.216 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:55.216 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:55.216 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:55.216 04:49:34 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:55.216 04:49:34 -- setup/hugepages.sh@89 -- # local node 00:04:55.216 04:49:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:55.216 04:49:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:55.216 04:49:34 -- setup/hugepages.sh@92 -- # local surp 00:04:55.216 04:49:34 -- setup/hugepages.sh@93 -- # local resv 00:04:55.216 04:49:34 -- setup/hugepages.sh@94 -- # local anon 00:04:55.216 04:49:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:55.216 04:49:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:55.216 04:49:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:55.216 04:49:34 -- setup/common.sh@18 -- # local node= 00:04:55.216 04:49:34 -- setup/common.sh@19 -- # local var val 00:04:55.216 04:49:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.216 04:49:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.216 04:49:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.216 04:49:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.216 04:49:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.216 04:49:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.216 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.216 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.216 04:49:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49036224 kB' 'MemAvailable: 49527320 kB' 'Buffers: 1308 kB' 'Cached: 12271428 kB' 'SwapCached: 0 kB' 'Active: 12436896 kB' 'Inactive: 333900 kB' 'Active(anon): 11870956 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501296 kB' 'Mapped: 194224 kB' 'Shmem: 11372896 kB' 'KReclaimable: 201180 kB' 'Slab: 568484 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367304 kB' 'KernelStack: 12736 kB' 'PageTables: 8196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13038024 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196076 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.217 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.217 04:49:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.217 04:49:34 -- setup/common.sh@33 -- # echo 0 00:04:55.217 04:49:34 -- setup/common.sh@33 -- # return 0 00:04:55.217 04:49:34 -- setup/hugepages.sh@97 -- # anon=0 00:04:55.217 04:49:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:55.217 04:49:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.217 04:49:34 -- setup/common.sh@18 -- # local node= 00:04:55.218 04:49:34 -- setup/common.sh@19 -- # local var val 00:04:55.218 04:49:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.218 04:49:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.218 04:49:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.218 04:49:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.218 04:49:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.218 04:49:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49036416 kB' 'MemAvailable: 49527512 kB' 'Buffers: 1308 kB' 'Cached: 12271428 kB' 'SwapCached: 0 kB' 'Active: 12431756 kB' 'Inactive: 333900 kB' 'Active(anon): 11865816 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496204 kB' 'Mapped: 193868 kB' 'Shmem: 11372896 kB' 'KReclaimable: 201180 kB' 'Slab: 568484 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367304 kB' 'KernelStack: 12784 kB' 'PageTables: 8288 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13032936 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196056 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.218 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.218 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.219 04:49:34 -- setup/common.sh@33 -- # echo 0 00:04:55.219 04:49:34 -- setup/common.sh@33 -- # return 0 00:04:55.219 04:49:34 -- setup/hugepages.sh@99 -- # surp=0 00:04:55.219 04:49:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:55.219 04:49:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:55.219 04:49:34 -- setup/common.sh@18 -- # local node= 00:04:55.219 04:49:34 -- setup/common.sh@19 -- # local var val 00:04:55.219 04:49:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.219 04:49:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.219 04:49:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.219 04:49:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.219 04:49:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.219 04:49:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49032388 kB' 'MemAvailable: 49523484 kB' 'Buffers: 1308 kB' 'Cached: 12271444 kB' 'SwapCached: 0 kB' 'Active: 12433272 kB' 'Inactive: 333900 kB' 'Active(anon): 11867332 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 497688 kB' 'Mapped: 193944 kB' 'Shmem: 11372912 kB' 'KReclaimable: 201180 kB' 'Slab: 568484 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367304 kB' 'KernelStack: 12720 kB' 'PageTables: 8064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13035532 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196056 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.219 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.219 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.220 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.220 04:49:34 -- setup/common.sh@33 -- # echo 0 00:04:55.220 04:49:34 -- setup/common.sh@33 -- # return 0 00:04:55.220 04:49:34 -- setup/hugepages.sh@100 -- # resv=0 00:04:55.220 04:49:34 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:55.220 nr_hugepages=1024 00:04:55.220 04:49:34 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:55.220 resv_hugepages=0 00:04:55.220 04:49:34 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:55.220 surplus_hugepages=0 00:04:55.220 04:49:34 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:55.220 anon_hugepages=0 00:04:55.220 04:49:34 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:55.220 04:49:34 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:55.220 04:49:34 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:55.220 04:49:34 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:55.220 04:49:34 -- setup/common.sh@18 -- # local node= 00:04:55.220 04:49:34 -- setup/common.sh@19 -- # local var val 00:04:55.220 04:49:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.220 04:49:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.220 04:49:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.220 04:49:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.220 04:49:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.220 04:49:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.220 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49030876 kB' 'MemAvailable: 49521972 kB' 'Buffers: 1308 kB' 'Cached: 12271456 kB' 'SwapCached: 0 kB' 'Active: 12435744 kB' 'Inactive: 333900 kB' 'Active(anon): 11869804 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500044 kB' 'Mapped: 193868 kB' 'Shmem: 11372924 kB' 'KReclaimable: 201180 kB' 'Slab: 568500 kB' 'SReclaimable: 201180 kB' 'SUnreclaim: 367320 kB' 'KernelStack: 12688 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13038064 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196060 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.221 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.221 04:49:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.222 04:49:34 -- setup/common.sh@33 -- # echo 1024 00:04:55.222 04:49:34 -- setup/common.sh@33 -- # return 0 00:04:55.222 04:49:34 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:55.222 04:49:34 -- setup/hugepages.sh@112 -- # get_nodes 00:04:55.222 04:49:34 -- setup/hugepages.sh@27 -- # local node 00:04:55.222 04:49:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.222 04:49:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:55.222 04:49:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.222 04:49:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:55.222 04:49:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:55.222 04:49:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:55.222 04:49:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:55.222 04:49:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:55.222 04:49:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:55.222 04:49:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.222 04:49:34 -- setup/common.sh@18 -- # local node=0 00:04:55.222 04:49:34 -- setup/common.sh@19 -- # local var val 00:04:55.222 04:49:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.222 04:49:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.222 04:49:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:55.222 04:49:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:55.222 04:49:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.222 04:49:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876944 kB' 'MemFree: 22017836 kB' 'MemUsed: 10859108 kB' 'SwapCached: 0 kB' 'Active: 7416028 kB' 'Inactive: 144168 kB' 'Active(anon): 7222972 kB' 'Inactive(anon): 0 kB' 'Active(file): 193056 kB' 'Inactive(file): 144168 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7347360 kB' 'Mapped: 99736 kB' 'AnonPages: 215960 kB' 'Shmem: 7010136 kB' 'KernelStack: 7560 kB' 'PageTables: 4632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101836 kB' 'Slab: 337772 kB' 'SReclaimable: 101836 kB' 'SUnreclaim: 235936 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.222 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.222 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # continue 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.223 04:49:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.223 04:49:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.223 04:49:34 -- setup/common.sh@33 -- # echo 0 00:04:55.223 04:49:34 -- setup/common.sh@33 -- # return 0 00:04:55.223 04:49:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:55.223 04:49:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:55.223 04:49:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:55.223 04:49:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:55.223 04:49:34 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:55.223 node0=1024 expecting 1024 00:04:55.223 04:49:34 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:55.223 04:49:34 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:55.223 04:49:34 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:55.223 04:49:34 -- setup/hugepages.sh@202 -- # setup output 00:04:55.223 04:49:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.223 04:49:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:56.156 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:56.156 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:56.156 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:56.156 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:56.156 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:56.156 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:56.156 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:56.156 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:56.156 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:56.156 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:56.156 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:56.156 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:56.156 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:56.156 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:56.156 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:56.156 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:56.156 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:56.419 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:56.419 04:49:35 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:56.419 04:49:35 -- setup/hugepages.sh@89 -- # local node 00:04:56.419 04:49:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:56.419 04:49:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:56.419 04:49:35 -- setup/hugepages.sh@92 -- # local surp 00:04:56.419 04:49:35 -- setup/hugepages.sh@93 -- # local resv 00:04:56.419 04:49:35 -- setup/hugepages.sh@94 -- # local anon 00:04:56.419 04:49:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:56.419 04:49:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:56.419 04:49:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:56.419 04:49:35 -- setup/common.sh@18 -- # local node= 00:04:56.419 04:49:35 -- setup/common.sh@19 -- # local var val 00:04:56.419 04:49:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.419 04:49:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.419 04:49:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.419 04:49:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.419 04:49:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.419 04:49:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49015148 kB' 'MemAvailable: 49506228 kB' 'Buffers: 1308 kB' 'Cached: 12271500 kB' 'SwapCached: 0 kB' 'Active: 12436072 kB' 'Inactive: 333900 kB' 'Active(anon): 11870132 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500420 kB' 'Mapped: 194360 kB' 'Shmem: 11372968 kB' 'KReclaimable: 201148 kB' 'Slab: 568520 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367372 kB' 'KernelStack: 12784 kB' 'PageTables: 8288 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13037920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196076 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.419 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.419 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.420 04:49:35 -- setup/common.sh@33 -- # echo 0 00:04:56.420 04:49:35 -- setup/common.sh@33 -- # return 0 00:04:56.420 04:49:35 -- setup/hugepages.sh@97 -- # anon=0 00:04:56.420 04:49:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:56.420 04:49:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:56.420 04:49:35 -- setup/common.sh@18 -- # local node= 00:04:56.420 04:49:35 -- setup/common.sh@19 -- # local var val 00:04:56.420 04:49:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.420 04:49:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.420 04:49:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.420 04:49:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.420 04:49:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.420 04:49:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49017456 kB' 'MemAvailable: 49508536 kB' 'Buffers: 1308 kB' 'Cached: 12271500 kB' 'SwapCached: 0 kB' 'Active: 12431596 kB' 'Inactive: 333900 kB' 'Active(anon): 11865656 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496044 kB' 'Mapped: 194000 kB' 'Shmem: 11372968 kB' 'KReclaimable: 201148 kB' 'Slab: 568596 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367448 kB' 'KernelStack: 12800 kB' 'PageTables: 8348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13031812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196056 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.420 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.420 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.421 04:49:35 -- setup/common.sh@33 -- # echo 0 00:04:56.421 04:49:35 -- setup/common.sh@33 -- # return 0 00:04:56.421 04:49:35 -- setup/hugepages.sh@99 -- # surp=0 00:04:56.421 04:49:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:56.421 04:49:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:56.421 04:49:35 -- setup/common.sh@18 -- # local node= 00:04:56.421 04:49:35 -- setup/common.sh@19 -- # local var val 00:04:56.421 04:49:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.421 04:49:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.421 04:49:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.421 04:49:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.421 04:49:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.421 04:49:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49018108 kB' 'MemAvailable: 49509188 kB' 'Buffers: 1308 kB' 'Cached: 12271512 kB' 'SwapCached: 0 kB' 'Active: 12431088 kB' 'Inactive: 333900 kB' 'Active(anon): 11865148 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495420 kB' 'Mapped: 193444 kB' 'Shmem: 11372980 kB' 'KReclaimable: 201148 kB' 'Slab: 568616 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367468 kB' 'KernelStack: 12768 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13031828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196040 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.421 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.421 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.422 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.422 04:49:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.423 04:49:35 -- setup/common.sh@33 -- # echo 0 00:04:56.423 04:49:35 -- setup/common.sh@33 -- # return 0 00:04:56.423 04:49:35 -- setup/hugepages.sh@100 -- # resv=0 00:04:56.423 04:49:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:56.423 nr_hugepages=1024 00:04:56.423 04:49:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:56.423 resv_hugepages=0 00:04:56.423 04:49:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:56.423 surplus_hugepages=0 00:04:56.423 04:49:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:56.423 anon_hugepages=0 00:04:56.423 04:49:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:56.423 04:49:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:56.423 04:49:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:56.423 04:49:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:56.423 04:49:35 -- setup/common.sh@18 -- # local node= 00:04:56.423 04:49:35 -- setup/common.sh@19 -- # local var val 00:04:56.423 04:49:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.423 04:49:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.423 04:49:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.423 04:49:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.423 04:49:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.423 04:49:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65702684 kB' 'MemFree: 49018108 kB' 'MemAvailable: 49509188 kB' 'Buffers: 1308 kB' 'Cached: 12271528 kB' 'SwapCached: 0 kB' 'Active: 12430744 kB' 'Inactive: 333900 kB' 'Active(anon): 11864804 kB' 'Inactive(anon): 0 kB' 'Active(file): 565940 kB' 'Inactive(file): 333900 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495108 kB' 'Mapped: 193436 kB' 'Shmem: 11372996 kB' 'KReclaimable: 201148 kB' 'Slab: 568616 kB' 'SReclaimable: 201148 kB' 'SUnreclaim: 367468 kB' 'KernelStack: 12768 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 40191368 kB' 'Committed_AS: 13031840 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196040 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1760860 kB' 'DirectMap2M: 15984640 kB' 'DirectMap1G: 51380224 kB' 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.423 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.423 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.424 04:49:35 -- setup/common.sh@33 -- # echo 1024 00:04:56.424 04:49:35 -- setup/common.sh@33 -- # return 0 00:04:56.424 04:49:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:56.424 04:49:35 -- setup/hugepages.sh@112 -- # get_nodes 00:04:56.424 04:49:35 -- setup/hugepages.sh@27 -- # local node 00:04:56.424 04:49:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:56.424 04:49:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:56.424 04:49:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:56.424 04:49:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:56.424 04:49:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:56.424 04:49:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:56.424 04:49:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:56.424 04:49:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:56.424 04:49:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:56.424 04:49:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:56.424 04:49:35 -- setup/common.sh@18 -- # local node=0 00:04:56.424 04:49:35 -- setup/common.sh@19 -- # local var val 00:04:56.424 04:49:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.424 04:49:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.424 04:49:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:56.424 04:49:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:56.424 04:49:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.424 04:49:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876944 kB' 'MemFree: 22011492 kB' 'MemUsed: 10865452 kB' 'SwapCached: 0 kB' 'Active: 7416344 kB' 'Inactive: 144168 kB' 'Active(anon): 7223288 kB' 'Inactive(anon): 0 kB' 'Active(file): 193056 kB' 'Inactive(file): 144168 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7347360 kB' 'Mapped: 99584 kB' 'AnonPages: 216320 kB' 'Shmem: 7010136 kB' 'KernelStack: 7560 kB' 'PageTables: 4608 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101804 kB' 'Slab: 337812 kB' 'SReclaimable: 101804 kB' 'SUnreclaim: 236008 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.424 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.424 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # continue 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.425 04:49:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.425 04:49:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.425 04:49:35 -- setup/common.sh@33 -- # echo 0 00:04:56.425 04:49:35 -- setup/common.sh@33 -- # return 0 00:04:56.425 04:49:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:56.425 04:49:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:56.425 04:49:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:56.425 04:49:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:56.425 04:49:35 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:56.425 node0=1024 expecting 1024 00:04:56.425 04:49:35 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:56.425 00:04:56.425 real 0m2.578s 00:04:56.425 user 0m1.047s 00:04:56.425 sys 0m1.448s 00:04:56.425 04:49:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:56.425 04:49:35 -- common/autotest_common.sh@10 -- # set +x 00:04:56.425 ************************************ 00:04:56.425 END TEST no_shrink_alloc 00:04:56.425 ************************************ 00:04:56.425 04:49:35 -- setup/hugepages.sh@217 -- # clear_hp 00:04:56.425 04:49:35 -- setup/hugepages.sh@37 -- # local node hp 00:04:56.425 04:49:35 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:56.425 04:49:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.425 04:49:35 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.425 04:49:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.425 04:49:35 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.684 04:49:35 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:56.684 04:49:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.684 04:49:35 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.684 04:49:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.684 04:49:35 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.684 04:49:35 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:56.684 04:49:35 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:56.684 00:04:56.684 real 0m11.315s 00:04:56.684 user 0m4.245s 00:04:56.684 sys 0m5.734s 00:04:56.684 04:49:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:56.684 04:49:35 -- common/autotest_common.sh@10 -- # set +x 00:04:56.684 ************************************ 00:04:56.684 END TEST hugepages 00:04:56.684 ************************************ 00:04:56.684 04:49:35 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:56.684 04:49:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.684 04:49:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.684 04:49:35 -- common/autotest_common.sh@10 -- # set +x 00:04:56.684 ************************************ 00:04:56.684 START TEST driver 00:04:56.684 ************************************ 00:04:56.684 04:49:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:56.684 * Looking for test storage... 00:04:56.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:56.684 04:49:35 -- setup/driver.sh@68 -- # setup reset 00:04:56.684 04:49:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:56.684 04:49:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:59.215 04:49:38 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:59.215 04:49:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:59.215 04:49:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.215 04:49:38 -- common/autotest_common.sh@10 -- # set +x 00:04:59.215 ************************************ 00:04:59.215 START TEST guess_driver 00:04:59.215 ************************************ 00:04:59.215 04:49:38 -- common/autotest_common.sh@1111 -- # guess_driver 00:04:59.215 04:49:38 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:59.215 04:49:38 -- setup/driver.sh@47 -- # local fail=0 00:04:59.215 04:49:38 -- setup/driver.sh@49 -- # pick_driver 00:04:59.215 04:49:38 -- setup/driver.sh@36 -- # vfio 00:04:59.215 04:49:38 -- setup/driver.sh@21 -- # local iommu_grups 00:04:59.215 04:49:38 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:59.215 04:49:38 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:59.215 04:49:38 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:59.215 04:49:38 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:59.215 04:49:38 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:59.215 04:49:38 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:59.215 04:49:38 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:59.215 04:49:38 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:59.215 04:49:38 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:59.215 04:49:38 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:59.215 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:59.215 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:59.215 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:59.215 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:59.215 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:59.215 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:59.215 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:59.215 04:49:38 -- setup/driver.sh@30 -- # return 0 00:04:59.215 04:49:38 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:59.215 04:49:38 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:59.215 04:49:38 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:59.215 04:49:38 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:59.215 Looking for driver=vfio-pci 00:04:59.215 04:49:38 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:59.215 04:49:38 -- setup/driver.sh@45 -- # setup output config 00:04:59.215 04:49:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:59.215 04:49:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.148 04:49:39 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.148 04:49:39 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.148 04:49:39 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:01.521 04:49:40 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:01.521 04:49:40 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:01.521 04:49:40 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:01.521 04:49:40 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:05:01.521 04:49:40 -- setup/driver.sh@65 -- # setup reset 00:05:01.521 04:49:40 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:01.521 04:49:40 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:04.054 00:05:04.054 real 0m4.620s 00:05:04.054 user 0m1.003s 00:05:04.054 sys 0m1.731s 00:05:04.054 04:49:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:04.054 04:49:42 -- common/autotest_common.sh@10 -- # set +x 00:05:04.054 ************************************ 00:05:04.054 END TEST guess_driver 00:05:04.054 ************************************ 00:05:04.054 00:05:04.054 real 0m7.055s 00:05:04.054 user 0m1.578s 00:05:04.054 sys 0m2.727s 00:05:04.054 04:49:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:04.054 04:49:42 -- common/autotest_common.sh@10 -- # set +x 00:05:04.054 ************************************ 00:05:04.054 END TEST driver 00:05:04.054 ************************************ 00:05:04.054 04:49:42 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:04.054 04:49:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.054 04:49:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.054 04:49:42 -- common/autotest_common.sh@10 -- # set +x 00:05:04.054 ************************************ 00:05:04.054 START TEST devices 00:05:04.054 ************************************ 00:05:04.054 04:49:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:04.054 * Looking for test storage... 00:05:04.054 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:04.054 04:49:42 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:04.054 04:49:42 -- setup/devices.sh@192 -- # setup reset 00:05:04.055 04:49:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:04.055 04:49:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:05.426 04:49:44 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:05.426 04:49:44 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:05:05.426 04:49:44 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:05:05.426 04:49:44 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:05:05.426 04:49:44 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:05:05.426 04:49:44 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:05:05.426 04:49:44 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:05:05.426 04:49:44 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:05.426 04:49:44 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:05:05.426 04:49:44 -- setup/devices.sh@196 -- # blocks=() 00:05:05.426 04:49:44 -- setup/devices.sh@196 -- # declare -a blocks 00:05:05.426 04:49:44 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:05.426 04:49:44 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:05.426 04:49:44 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:05.426 04:49:44 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:05.426 04:49:44 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:05.426 04:49:44 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:05.426 04:49:44 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:05.426 04:49:44 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:05.426 04:49:44 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:05.426 04:49:44 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:05:05.426 04:49:44 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:05.426 No valid GPT data, bailing 00:05:05.426 04:49:44 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:05.426 04:49:44 -- scripts/common.sh@391 -- # pt= 00:05:05.426 04:49:44 -- scripts/common.sh@392 -- # return 1 00:05:05.426 04:49:44 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:05.426 04:49:44 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:05.426 04:49:44 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:05.426 04:49:44 -- setup/common.sh@80 -- # echo 1000204886016 00:05:05.426 04:49:44 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:05.426 04:49:44 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:05.426 04:49:44 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:05.426 04:49:44 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:05.426 04:49:44 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:05.426 04:49:44 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:05.426 04:49:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.426 04:49:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.426 04:49:44 -- common/autotest_common.sh@10 -- # set +x 00:05:05.426 ************************************ 00:05:05.426 START TEST nvme_mount 00:05:05.426 ************************************ 00:05:05.426 04:49:44 -- common/autotest_common.sh@1111 -- # nvme_mount 00:05:05.426 04:49:44 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:05.426 04:49:44 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:05.426 04:49:44 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.426 04:49:44 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:05.426 04:49:44 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:05.426 04:49:44 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:05.426 04:49:44 -- setup/common.sh@40 -- # local part_no=1 00:05:05.426 04:49:44 -- setup/common.sh@41 -- # local size=1073741824 00:05:05.426 04:49:44 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:05.426 04:49:44 -- setup/common.sh@44 -- # parts=() 00:05:05.426 04:49:44 -- setup/common.sh@44 -- # local parts 00:05:05.426 04:49:44 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:05.426 04:49:44 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.426 04:49:44 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.426 04:49:44 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.426 04:49:44 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.426 04:49:44 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:05.427 04:49:44 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:05.427 04:49:44 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:06.798 Creating new GPT entries in memory. 00:05:06.798 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:06.798 other utilities. 00:05:06.798 04:49:45 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:06.798 04:49:45 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.798 04:49:45 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:06.798 04:49:45 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:06.798 04:49:45 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:07.730 Creating new GPT entries in memory. 00:05:07.730 The operation has completed successfully. 00:05:07.730 04:49:46 -- setup/common.sh@57 -- # (( part++ )) 00:05:07.730 04:49:46 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:07.730 04:49:46 -- setup/common.sh@62 -- # wait 2259247 00:05:07.730 04:49:46 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.730 04:49:46 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:07.730 04:49:46 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.730 04:49:46 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:07.730 04:49:46 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:07.730 04:49:46 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.730 04:49:46 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.730 04:49:46 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:07.730 04:49:46 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:07.730 04:49:46 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.730 04:49:46 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.730 04:49:46 -- setup/devices.sh@53 -- # local found=0 00:05:07.730 04:49:46 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:07.730 04:49:46 -- setup/devices.sh@56 -- # : 00:05:07.730 04:49:46 -- setup/devices.sh@59 -- # local pci status 00:05:07.730 04:49:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.730 04:49:46 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:07.730 04:49:46 -- setup/devices.sh@47 -- # setup output config 00:05:07.730 04:49:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:07.730 04:49:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:08.723 04:49:47 -- setup/devices.sh@63 -- # found=1 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.723 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.723 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.724 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.724 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.724 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.724 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.724 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.724 04:49:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.724 04:49:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.724 04:49:47 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:08.724 04:49:47 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:08.724 04:49:47 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.724 04:49:47 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:08.724 04:49:47 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:08.724 04:49:47 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:08.724 04:49:47 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.724 04:49:47 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.724 04:49:47 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:08.724 04:49:47 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:08.724 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:08.724 04:49:47 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:08.724 04:49:47 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:08.981 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:08.981 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:08.981 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:08.981 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:08.981 04:49:48 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:08.981 04:49:48 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:08.981 04:49:48 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.981 04:49:48 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:08.981 04:49:48 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:09.238 04:49:48 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.238 04:49:48 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:09.238 04:49:48 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:09.238 04:49:48 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:09.238 04:49:48 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.238 04:49:48 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:09.238 04:49:48 -- setup/devices.sh@53 -- # local found=0 00:05:09.238 04:49:48 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:09.238 04:49:48 -- setup/devices.sh@56 -- # : 00:05:09.238 04:49:48 -- setup/devices.sh@59 -- # local pci status 00:05:09.238 04:49:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.238 04:49:48 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:09.239 04:49:48 -- setup/devices.sh@47 -- # setup output config 00:05:09.239 04:49:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.239 04:49:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:10.171 04:49:49 -- setup/devices.sh@63 -- # found=1 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.171 04:49:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.171 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.429 04:49:49 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:10.429 04:49:49 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:10.429 04:49:49 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:10.429 04:49:49 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:10.429 04:49:49 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:10.429 04:49:49 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:10.429 04:49:49 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:10.429 04:49:49 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:10.429 04:49:49 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:10.429 04:49:49 -- setup/devices.sh@50 -- # local mount_point= 00:05:10.429 04:49:49 -- setup/devices.sh@51 -- # local test_file= 00:05:10.430 04:49:49 -- setup/devices.sh@53 -- # local found=0 00:05:10.430 04:49:49 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:10.430 04:49:49 -- setup/devices.sh@59 -- # local pci status 00:05:10.430 04:49:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.430 04:49:49 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:10.430 04:49:49 -- setup/devices.sh@47 -- # setup output config 00:05:10.430 04:49:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:10.430 04:49:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:11.804 04:49:50 -- setup/devices.sh@63 -- # found=1 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.804 04:49:50 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:11.804 04:49:50 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:11.804 04:49:50 -- setup/devices.sh@68 -- # return 0 00:05:11.804 04:49:50 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:11.804 04:49:50 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.804 04:49:50 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:11.804 04:49:50 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:11.804 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:11.804 00:05:11.804 real 0m6.170s 00:05:11.804 user 0m1.491s 00:05:11.805 sys 0m2.247s 00:05:11.805 04:49:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:11.805 04:49:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.805 ************************************ 00:05:11.805 END TEST nvme_mount 00:05:11.805 ************************************ 00:05:11.805 04:49:50 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:11.805 04:49:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.805 04:49:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.805 04:49:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.805 ************************************ 00:05:11.805 START TEST dm_mount 00:05:11.805 ************************************ 00:05:11.805 04:49:50 -- common/autotest_common.sh@1111 -- # dm_mount 00:05:11.805 04:49:50 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:11.805 04:49:50 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:11.805 04:49:50 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:11.805 04:49:50 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:11.805 04:49:50 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:11.805 04:49:50 -- setup/common.sh@40 -- # local part_no=2 00:05:11.805 04:49:50 -- setup/common.sh@41 -- # local size=1073741824 00:05:11.805 04:49:50 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:11.805 04:49:50 -- setup/common.sh@44 -- # parts=() 00:05:11.805 04:49:50 -- setup/common.sh@44 -- # local parts 00:05:11.805 04:49:50 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:11.805 04:49:50 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:11.805 04:49:50 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:11.805 04:49:50 -- setup/common.sh@46 -- # (( part++ )) 00:05:11.805 04:49:50 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:11.805 04:49:50 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:11.805 04:49:50 -- setup/common.sh@46 -- # (( part++ )) 00:05:11.805 04:49:50 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:11.805 04:49:50 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:11.805 04:49:50 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:11.805 04:49:50 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:12.738 Creating new GPT entries in memory. 00:05:12.738 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:12.738 other utilities. 00:05:12.738 04:49:51 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:12.738 04:49:51 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:12.738 04:49:51 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:12.738 04:49:51 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:12.738 04:49:51 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:14.110 Creating new GPT entries in memory. 00:05:14.110 The operation has completed successfully. 00:05:14.110 04:49:52 -- setup/common.sh@57 -- # (( part++ )) 00:05:14.110 04:49:52 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:14.110 04:49:52 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:14.110 04:49:52 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:14.110 04:49:52 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:15.044 The operation has completed successfully. 00:05:15.044 04:49:53 -- setup/common.sh@57 -- # (( part++ )) 00:05:15.044 04:49:53 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:15.044 04:49:53 -- setup/common.sh@62 -- # wait 2261637 00:05:15.044 04:49:53 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:15.044 04:49:53 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.044 04:49:53 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.044 04:49:53 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:15.044 04:49:53 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:15.044 04:49:53 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:15.044 04:49:53 -- setup/devices.sh@161 -- # break 00:05:15.044 04:49:53 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:15.044 04:49:53 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:15.044 04:49:53 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:15.044 04:49:53 -- setup/devices.sh@166 -- # dm=dm-0 00:05:15.044 04:49:53 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:15.044 04:49:53 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:15.044 04:49:53 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.044 04:49:53 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:15.044 04:49:53 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.044 04:49:53 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:15.044 04:49:53 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:15.044 04:49:53 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.044 04:49:53 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.044 04:49:53 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:15.044 04:49:53 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:15.044 04:49:53 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.044 04:49:53 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.044 04:49:53 -- setup/devices.sh@53 -- # local found=0 00:05:15.044 04:49:53 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:15.044 04:49:53 -- setup/devices.sh@56 -- # : 00:05:15.044 04:49:53 -- setup/devices.sh@59 -- # local pci status 00:05:15.044 04:49:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.044 04:49:53 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:15.044 04:49:53 -- setup/devices.sh@47 -- # setup output config 00:05:15.044 04:49:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:15.044 04:49:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:15.978 04:49:55 -- setup/devices.sh@63 -- # found=1 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.978 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.978 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.979 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.979 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.979 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.979 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.979 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.979 04:49:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.979 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.237 04:49:55 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:16.237 04:49:55 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:16.237 04:49:55 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:16.237 04:49:55 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:16.237 04:49:55 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:16.237 04:49:55 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:16.237 04:49:55 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:16.237 04:49:55 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:16.237 04:49:55 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:16.237 04:49:55 -- setup/devices.sh@50 -- # local mount_point= 00:05:16.237 04:49:55 -- setup/devices.sh@51 -- # local test_file= 00:05:16.237 04:49:55 -- setup/devices.sh@53 -- # local found=0 00:05:16.237 04:49:55 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:16.237 04:49:55 -- setup/devices.sh@59 -- # local pci status 00:05:16.237 04:49:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.237 04:49:55 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:16.237 04:49:55 -- setup/devices.sh@47 -- # setup output config 00:05:16.237 04:49:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:16.237 04:49:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:17.172 04:49:56 -- setup/devices.sh@63 -- # found=1 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.172 04:49:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.172 04:49:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.430 04:49:56 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:17.430 04:49:56 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:17.430 04:49:56 -- setup/devices.sh@68 -- # return 0 00:05:17.430 04:49:56 -- setup/devices.sh@187 -- # cleanup_dm 00:05:17.430 04:49:56 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:17.431 04:49:56 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:17.431 04:49:56 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:17.431 04:49:56 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:17.431 04:49:56 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:17.431 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:17.431 04:49:56 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:17.431 04:49:56 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:17.431 00:05:17.431 real 0m5.628s 00:05:17.431 user 0m0.976s 00:05:17.431 sys 0m1.526s 00:05:17.431 04:49:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:17.431 04:49:56 -- common/autotest_common.sh@10 -- # set +x 00:05:17.431 ************************************ 00:05:17.431 END TEST dm_mount 00:05:17.431 ************************************ 00:05:17.431 04:49:56 -- setup/devices.sh@1 -- # cleanup 00:05:17.431 04:49:56 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:17.431 04:49:56 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:17.431 04:49:56 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:17.431 04:49:56 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:17.431 04:49:56 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:17.431 04:49:56 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:17.689 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:17.689 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:17.689 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:17.689 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:17.689 04:49:56 -- setup/devices.sh@12 -- # cleanup_dm 00:05:17.689 04:49:56 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:17.689 04:49:56 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:17.689 04:49:56 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:17.689 04:49:56 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:17.689 04:49:56 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:17.689 04:49:56 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:17.689 00:05:17.689 real 0m13.877s 00:05:17.689 user 0m3.197s 00:05:17.689 sys 0m4.864s 00:05:17.689 04:49:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:17.689 04:49:56 -- common/autotest_common.sh@10 -- # set +x 00:05:17.689 ************************************ 00:05:17.689 END TEST devices 00:05:17.689 ************************************ 00:05:17.689 00:05:17.689 real 0m42.770s 00:05:17.689 user 0m12.296s 00:05:17.689 sys 0m18.591s 00:05:17.689 04:49:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:17.689 04:49:56 -- common/autotest_common.sh@10 -- # set +x 00:05:17.689 ************************************ 00:05:17.689 END TEST setup.sh 00:05:17.689 ************************************ 00:05:17.689 04:49:56 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:19.063 Hugepages 00:05:19.063 node hugesize free / total 00:05:19.063 node0 1048576kB 0 / 0 00:05:19.063 node0 2048kB 2048 / 2048 00:05:19.063 node1 1048576kB 0 / 0 00:05:19.063 node1 2048kB 0 / 0 00:05:19.063 00:05:19.063 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:19.064 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:19.064 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:19.064 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:19.064 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:19.064 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:19.064 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:19.064 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:19.064 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:19.064 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:19.064 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:19.064 04:49:57 -- spdk/autotest.sh@130 -- # uname -s 00:05:19.064 04:49:57 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:05:19.064 04:49:57 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:05:19.064 04:49:57 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:19.998 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.998 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.998 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.998 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.998 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.998 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.998 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.998 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.998 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:20.931 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:21.189 04:50:00 -- common/autotest_common.sh@1518 -- # sleep 1 00:05:22.121 04:50:01 -- common/autotest_common.sh@1519 -- # bdfs=() 00:05:22.121 04:50:01 -- common/autotest_common.sh@1519 -- # local bdfs 00:05:22.121 04:50:01 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:05:22.121 04:50:01 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:05:22.122 04:50:01 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:22.122 04:50:01 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:22.122 04:50:01 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:22.122 04:50:01 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:22.122 04:50:01 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:22.379 04:50:01 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:22.379 04:50:01 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:88:00.0 00:05:22.379 04:50:01 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:23.321 Waiting for block devices as requested 00:05:23.321 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:23.321 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:23.592 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:23.592 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:23.592 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:23.592 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:23.592 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:23.851 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:23.851 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:23.851 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:23.851 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:24.110 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:24.110 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:24.110 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:24.369 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:24.369 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:24.369 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:24.369 04:50:03 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:05:24.369 04:50:03 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:24.369 04:50:03 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:05:24.369 04:50:03 -- common/autotest_common.sh@1488 -- # grep 0000:88:00.0/nvme/nvme 00:05:24.369 04:50:03 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:24.369 04:50:03 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:24.369 04:50:03 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:24.369 04:50:03 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:05:24.369 04:50:03 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:05:24.369 04:50:03 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:05:24.369 04:50:03 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:05:24.369 04:50:03 -- common/autotest_common.sh@1531 -- # grep oacs 00:05:24.369 04:50:03 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:05:24.627 04:50:03 -- common/autotest_common.sh@1531 -- # oacs=' 0xf' 00:05:24.627 04:50:03 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:05:24.627 04:50:03 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:05:24.627 04:50:03 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:24.627 04:50:03 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:05:24.627 04:50:03 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:24.627 04:50:03 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:05:24.627 04:50:03 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:05:24.627 04:50:03 -- common/autotest_common.sh@1543 -- # continue 00:05:24.627 04:50:03 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:05:24.628 04:50:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:24.628 04:50:03 -- common/autotest_common.sh@10 -- # set +x 00:05:24.628 04:50:03 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:05:24.628 04:50:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:24.628 04:50:03 -- common/autotest_common.sh@10 -- # set +x 00:05:24.628 04:50:03 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:25.564 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:25.564 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:25.564 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:25.564 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:25.564 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:25.564 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:25.564 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:25.564 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:25.564 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:26.501 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:26.761 04:50:05 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:05:26.761 04:50:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:26.761 04:50:05 -- common/autotest_common.sh@10 -- # set +x 00:05:26.761 04:50:05 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:05:26.761 04:50:05 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:05:26.761 04:50:05 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:05:26.761 04:50:05 -- common/autotest_common.sh@1563 -- # bdfs=() 00:05:26.761 04:50:05 -- common/autotest_common.sh@1563 -- # local bdfs 00:05:26.761 04:50:05 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:05:26.761 04:50:05 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:26.761 04:50:05 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:26.761 04:50:05 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:26.761 04:50:05 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:26.761 04:50:05 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:26.761 04:50:05 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:26.761 04:50:05 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:88:00.0 00:05:26.761 04:50:05 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:05:26.761 04:50:05 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:26.761 04:50:05 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:05:26.761 04:50:05 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:26.761 04:50:05 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:05:26.761 04:50:05 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:88:00.0 00:05:26.761 04:50:05 -- common/autotest_common.sh@1578 -- # [[ -z 0000:88:00.0 ]] 00:05:26.761 04:50:05 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=2266799 00:05:26.761 04:50:05 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:26.761 04:50:05 -- common/autotest_common.sh@1584 -- # waitforlisten 2266799 00:05:26.761 04:50:05 -- common/autotest_common.sh@817 -- # '[' -z 2266799 ']' 00:05:26.761 04:50:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.761 04:50:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:26.761 04:50:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.761 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.761 04:50:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:26.761 04:50:05 -- common/autotest_common.sh@10 -- # set +x 00:05:27.019 [2024-04-23 04:50:05.947377] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:05:27.019 [2024-04-23 04:50:05.947482] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2266799 ] 00:05:27.019 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.019 [2024-04-23 04:50:05.980266] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:05:27.019 [2024-04-23 04:50:06.006077] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.019 [2024-04-23 04:50:06.091513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.278 04:50:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:27.278 04:50:06 -- common/autotest_common.sh@850 -- # return 0 00:05:27.278 04:50:06 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:05:27.278 04:50:06 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:05:27.278 04:50:06 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:30.572 nvme0n1 00:05:30.572 04:50:09 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:30.572 [2024-04-23 04:50:09.639562] nvme_opal.c:2063:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:30.572 [2024-04-23 04:50:09.639611] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:30.572 request: 00:05:30.572 { 00:05:30.572 "nvme_ctrlr_name": "nvme0", 00:05:30.572 "password": "test", 00:05:30.572 "method": "bdev_nvme_opal_revert", 00:05:30.572 "req_id": 1 00:05:30.572 } 00:05:30.572 Got JSON-RPC error response 00:05:30.572 response: 00:05:30.572 { 00:05:30.572 "code": -32603, 00:05:30.572 "message": "Internal error" 00:05:30.572 } 00:05:30.572 04:50:09 -- common/autotest_common.sh@1590 -- # true 00:05:30.572 04:50:09 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:05:30.572 04:50:09 -- common/autotest_common.sh@1594 -- # killprocess 2266799 00:05:30.572 04:50:09 -- common/autotest_common.sh@936 -- # '[' -z 2266799 ']' 00:05:30.572 04:50:09 -- common/autotest_common.sh@940 -- # kill -0 2266799 00:05:30.572 04:50:09 -- common/autotest_common.sh@941 -- # uname 00:05:30.572 04:50:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:30.572 04:50:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2266799 00:05:30.572 04:50:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:30.572 04:50:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:30.572 04:50:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2266799' 00:05:30.572 killing process with pid 2266799 00:05:30.572 04:50:09 -- common/autotest_common.sh@955 -- # kill 2266799 00:05:30.572 04:50:09 -- common/autotest_common.sh@960 -- # wait 2266799 00:05:32.480 04:50:11 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:05:32.480 04:50:11 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:05:32.480 04:50:11 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:32.480 04:50:11 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:32.480 04:50:11 -- spdk/autotest.sh@162 -- # timing_enter lib 00:05:32.480 04:50:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:32.480 04:50:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.480 04:50:11 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:32.480 04:50:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.480 04:50:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.480 04:50:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.480 ************************************ 00:05:32.480 START TEST env 00:05:32.480 ************************************ 00:05:32.480 04:50:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:32.480 * Looking for test storage... 00:05:32.480 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:32.480 04:50:11 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:32.480 04:50:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.480 04:50:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.480 04:50:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.740 ************************************ 00:05:32.740 START TEST env_memory 00:05:32.740 ************************************ 00:05:32.740 04:50:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:32.740 00:05:32.740 00:05:32.740 CUnit - A unit testing framework for C - Version 2.1-3 00:05:32.740 http://cunit.sourceforge.net/ 00:05:32.740 00:05:32.740 00:05:32.740 Suite: memory 00:05:32.740 Test: alloc and free memory map ...[2024-04-23 04:50:11.763209] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:32.740 passed 00:05:32.740 Test: mem map translation ...[2024-04-23 04:50:11.783906] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:32.740 [2024-04-23 04:50:11.783930] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:32.740 [2024-04-23 04:50:11.783985] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:32.740 [2024-04-23 04:50:11.783997] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:32.740 passed 00:05:32.740 Test: mem map registration ...[2024-04-23 04:50:11.824569] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:32.740 [2024-04-23 04:50:11.824587] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:32.740 passed 00:05:32.740 Test: mem map adjacent registrations ...passed 00:05:32.740 00:05:32.740 Run Summary: Type Total Ran Passed Failed Inactive 00:05:32.740 suites 1 1 n/a 0 0 00:05:32.740 tests 4 4 4 0 0 00:05:32.740 asserts 152 152 152 0 n/a 00:05:32.740 00:05:32.740 Elapsed time = 0.141 seconds 00:05:32.740 00:05:32.740 real 0m0.148s 00:05:32.740 user 0m0.139s 00:05:32.740 sys 0m0.009s 00:05:32.740 04:50:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:32.740 04:50:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.740 ************************************ 00:05:32.740 END TEST env_memory 00:05:32.740 ************************************ 00:05:32.740 04:50:11 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:32.740 04:50:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.740 04:50:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.740 04:50:11 -- common/autotest_common.sh@10 -- # set +x 00:05:33.000 ************************************ 00:05:33.000 START TEST env_vtophys 00:05:33.000 ************************************ 00:05:33.000 04:50:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:33.000 EAL: lib.eal log level changed from notice to debug 00:05:33.000 EAL: Detected lcore 0 as core 0 on socket 0 00:05:33.000 EAL: Detected lcore 1 as core 1 on socket 0 00:05:33.000 EAL: Detected lcore 2 as core 2 on socket 0 00:05:33.000 EAL: Detected lcore 3 as core 3 on socket 0 00:05:33.000 EAL: Detected lcore 4 as core 4 on socket 0 00:05:33.000 EAL: Detected lcore 5 as core 5 on socket 0 00:05:33.000 EAL: Detected lcore 6 as core 8 on socket 0 00:05:33.000 EAL: Detected lcore 7 as core 9 on socket 0 00:05:33.000 EAL: Detected lcore 8 as core 10 on socket 0 00:05:33.000 EAL: Detected lcore 9 as core 11 on socket 0 00:05:33.000 EAL: Detected lcore 10 as core 12 on socket 0 00:05:33.000 EAL: Detected lcore 11 as core 13 on socket 0 00:05:33.000 EAL: Detected lcore 12 as core 0 on socket 1 00:05:33.000 EAL: Detected lcore 13 as core 1 on socket 1 00:05:33.000 EAL: Detected lcore 14 as core 2 on socket 1 00:05:33.000 EAL: Detected lcore 15 as core 3 on socket 1 00:05:33.000 EAL: Detected lcore 16 as core 4 on socket 1 00:05:33.000 EAL: Detected lcore 17 as core 5 on socket 1 00:05:33.000 EAL: Detected lcore 18 as core 8 on socket 1 00:05:33.000 EAL: Detected lcore 19 as core 9 on socket 1 00:05:33.000 EAL: Detected lcore 20 as core 10 on socket 1 00:05:33.000 EAL: Detected lcore 21 as core 11 on socket 1 00:05:33.000 EAL: Detected lcore 22 as core 12 on socket 1 00:05:33.000 EAL: Detected lcore 23 as core 13 on socket 1 00:05:33.000 EAL: Detected lcore 24 as core 0 on socket 0 00:05:33.000 EAL: Detected lcore 25 as core 1 on socket 0 00:05:33.000 EAL: Detected lcore 26 as core 2 on socket 0 00:05:33.000 EAL: Detected lcore 27 as core 3 on socket 0 00:05:33.000 EAL: Detected lcore 28 as core 4 on socket 0 00:05:33.000 EAL: Detected lcore 29 as core 5 on socket 0 00:05:33.000 EAL: Detected lcore 30 as core 8 on socket 0 00:05:33.000 EAL: Detected lcore 31 as core 9 on socket 0 00:05:33.000 EAL: Detected lcore 32 as core 10 on socket 0 00:05:33.000 EAL: Detected lcore 33 as core 11 on socket 0 00:05:33.000 EAL: Detected lcore 34 as core 12 on socket 0 00:05:33.000 EAL: Detected lcore 35 as core 13 on socket 0 00:05:33.000 EAL: Detected lcore 36 as core 0 on socket 1 00:05:33.000 EAL: Detected lcore 37 as core 1 on socket 1 00:05:33.000 EAL: Detected lcore 38 as core 2 on socket 1 00:05:33.000 EAL: Detected lcore 39 as core 3 on socket 1 00:05:33.000 EAL: Detected lcore 40 as core 4 on socket 1 00:05:33.000 EAL: Detected lcore 41 as core 5 on socket 1 00:05:33.000 EAL: Detected lcore 42 as core 8 on socket 1 00:05:33.000 EAL: Detected lcore 43 as core 9 on socket 1 00:05:33.000 EAL: Detected lcore 44 as core 10 on socket 1 00:05:33.000 EAL: Detected lcore 45 as core 11 on socket 1 00:05:33.000 EAL: Detected lcore 46 as core 12 on socket 1 00:05:33.000 EAL: Detected lcore 47 as core 13 on socket 1 00:05:33.000 EAL: Maximum logical cores by configuration: 128 00:05:33.000 EAL: Detected CPU lcores: 48 00:05:33.000 EAL: Detected NUMA nodes: 2 00:05:33.000 EAL: Checking presence of .so 'librte_eal.so.24.2' 00:05:33.000 EAL: Detected shared linkage of DPDK 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_pci.so.24.2 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_vdev.so.24.2 00:05:33.001 EAL: Registered [vdev] bus. 00:05:33.001 EAL: bus.vdev log level changed from disabled to notice 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_mempool_ring.so.24.2 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_net_i40e.so.24.2 00:05:33.001 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:33.001 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_pci.so 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_bus_vdev.so 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_mempool_ring.so 00:05:33.001 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.2/librte_net_i40e.so 00:05:33.001 EAL: No shared files mode enabled, IPC will be disabled 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Bus pci wants IOVA as 'DC' 00:05:33.001 EAL: Bus vdev wants IOVA as 'DC' 00:05:33.001 EAL: Buses did not request a specific IOVA mode. 00:05:33.001 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:33.001 EAL: Selected IOVA mode 'VA' 00:05:33.001 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.001 EAL: Probing VFIO support... 00:05:33.001 EAL: IOMMU type 1 (Type 1) is supported 00:05:33.001 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:33.001 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:33.001 EAL: VFIO support initialized 00:05:33.001 EAL: Ask a virtual area of 0x2e000 bytes 00:05:33.001 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:33.001 EAL: Setting up physically contiguous memory... 00:05:33.001 EAL: Setting maximum number of open files to 524288 00:05:33.001 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:33.001 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:33.001 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:33.001 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:33.001 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.001 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:33.001 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.001 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.001 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:33.001 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:33.001 EAL: Hugepages will be freed exactly as allocated. 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: TSC frequency is ~2700000 KHz 00:05:33.001 EAL: Main lcore 0 is ready (tid=7f8e4216ca00;cpuset=[0]) 00:05:33.001 EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.001 EAL: Restoring previous memory policy: 0 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was expanded by 2MB 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:33.001 EAL: Mem event callback 'spdk:(nil)' registered 00:05:33.001 00:05:33.001 00:05:33.001 CUnit - A unit testing framework for C - Version 2.1-3 00:05:33.001 http://cunit.sourceforge.net/ 00:05:33.001 00:05:33.001 00:05:33.001 Suite: components_suite 00:05:33.001 Test: vtophys_malloc_test ...passed 00:05:33.001 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.001 EAL: Restoring previous memory policy: 4 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was expanded by 4MB 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was shrunk by 4MB 00:05:33.001 EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.001 EAL: Restoring previous memory policy: 4 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was expanded by 6MB 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was shrunk by 6MB 00:05:33.001 EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.001 EAL: Restoring previous memory policy: 4 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was expanded by 10MB 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was shrunk by 10MB 00:05:33.001 EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.001 EAL: Restoring previous memory policy: 4 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was expanded by 18MB 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was shrunk by 18MB 00:05:33.001 EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.001 EAL: Restoring previous memory policy: 4 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was expanded by 34MB 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was shrunk by 34MB 00:05:33.001 EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.001 EAL: Restoring previous memory policy: 4 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was expanded by 66MB 00:05:33.001 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.001 EAL: request: mp_malloc_sync 00:05:33.001 EAL: No shared files mode enabled, IPC is disabled 00:05:33.001 EAL: Heap on socket 0 was shrunk by 66MB 00:05:33.001 EAL: Trying to obtain current memory policy. 00:05:33.001 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.262 EAL: Restoring previous memory policy: 4 00:05:33.262 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.262 EAL: request: mp_malloc_sync 00:05:33.262 EAL: No shared files mode enabled, IPC is disabled 00:05:33.262 EAL: Heap on socket 0 was expanded by 130MB 00:05:33.262 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.262 EAL: request: mp_malloc_sync 00:05:33.262 EAL: No shared files mode enabled, IPC is disabled 00:05:33.262 EAL: Heap on socket 0 was shrunk by 130MB 00:05:33.262 EAL: Trying to obtain current memory policy. 00:05:33.262 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.262 EAL: Restoring previous memory policy: 4 00:05:33.262 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.262 EAL: request: mp_malloc_sync 00:05:33.262 EAL: No shared files mode enabled, IPC is disabled 00:05:33.262 EAL: Heap on socket 0 was expanded by 258MB 00:05:33.262 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.262 EAL: request: mp_malloc_sync 00:05:33.262 EAL: No shared files mode enabled, IPC is disabled 00:05:33.262 EAL: Heap on socket 0 was shrunk by 258MB 00:05:33.262 EAL: Trying to obtain current memory policy. 00:05:33.262 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.521 EAL: Restoring previous memory policy: 4 00:05:33.521 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.521 EAL: request: mp_malloc_sync 00:05:33.521 EAL: No shared files mode enabled, IPC is disabled 00:05:33.521 EAL: Heap on socket 0 was expanded by 514MB 00:05:33.521 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.780 EAL: request: mp_malloc_sync 00:05:33.780 EAL: No shared files mode enabled, IPC is disabled 00:05:33.780 EAL: Heap on socket 0 was shrunk by 514MB 00:05:33.780 EAL: Trying to obtain current memory policy. 00:05:33.780 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.039 EAL: Restoring previous memory policy: 4 00:05:34.039 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.039 EAL: request: mp_malloc_sync 00:05:34.039 EAL: No shared files mode enabled, IPC is disabled 00:05:34.039 EAL: Heap on socket 0 was expanded by 1026MB 00:05:34.298 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.557 EAL: request: mp_malloc_sync 00:05:34.557 EAL: No shared files mode enabled, IPC is disabled 00:05:34.557 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:34.557 passed 00:05:34.557 00:05:34.557 Run Summary: Type Total Ran Passed Failed Inactive 00:05:34.557 suites 1 1 n/a 0 0 00:05:34.557 tests 2 2 2 0 0 00:05:34.557 asserts 497 497 497 0 n/a 00:05:34.557 00:05:34.557 Elapsed time = 1.371 seconds 00:05:34.557 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.557 EAL: request: mp_malloc_sync 00:05:34.557 EAL: No shared files mode enabled, IPC is disabled 00:05:34.557 EAL: Heap on socket 0 was shrunk by 2MB 00:05:34.557 EAL: No shared files mode enabled, IPC is disabled 00:05:34.557 EAL: No shared files mode enabled, IPC is disabled 00:05:34.557 EAL: No shared files mode enabled, IPC is disabled 00:05:34.557 00:05:34.557 real 0m1.498s 00:05:34.557 user 0m0.844s 00:05:34.557 sys 0m0.609s 00:05:34.557 04:50:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:34.557 04:50:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.557 ************************************ 00:05:34.557 END TEST env_vtophys 00:05:34.557 ************************************ 00:05:34.557 04:50:13 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:34.557 04:50:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.557 04:50:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.557 04:50:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.557 ************************************ 00:05:34.557 START TEST env_pci 00:05:34.557 ************************************ 00:05:34.557 04:50:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:34.557 00:05:34.557 00:05:34.557 CUnit - A unit testing framework for C - Version 2.1-3 00:05:34.557 http://cunit.sourceforge.net/ 00:05:34.557 00:05:34.557 00:05:34.557 Suite: pci 00:05:34.557 Test: pci_hook ...[2024-04-23 04:50:13.631034] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2267719 has claimed it 00:05:34.557 EAL: Cannot find device (10000:00:01.0) 00:05:34.557 EAL: Failed to attach device on primary process 00:05:34.557 passed 00:05:34.557 00:05:34.557 Run Summary: Type Total Ran Passed Failed Inactive 00:05:34.557 suites 1 1 n/a 0 0 00:05:34.557 tests 1 1 1 0 0 00:05:34.557 asserts 25 25 25 0 n/a 00:05:34.557 00:05:34.557 Elapsed time = 0.021 seconds 00:05:34.557 00:05:34.557 real 0m0.034s 00:05:34.557 user 0m0.011s 00:05:34.557 sys 0m0.023s 00:05:34.557 04:50:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:34.557 04:50:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.557 ************************************ 00:05:34.557 END TEST env_pci 00:05:34.557 ************************************ 00:05:34.557 04:50:13 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:34.557 04:50:13 -- env/env.sh@15 -- # uname 00:05:34.557 04:50:13 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:34.557 04:50:13 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:34.557 04:50:13 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:34.557 04:50:13 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:34.557 04:50:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.557 04:50:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.816 ************************************ 00:05:34.816 START TEST env_dpdk_post_init 00:05:34.816 ************************************ 00:05:34.816 04:50:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:34.816 EAL: Detected CPU lcores: 48 00:05:34.816 EAL: Detected NUMA nodes: 2 00:05:34.816 EAL: Detected shared linkage of DPDK 00:05:34.816 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:34.816 EAL: Selected IOVA mode 'VA' 00:05:34.817 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.817 EAL: VFIO support initialized 00:05:34.817 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:34.817 EAL: Using IOMMU type 1 (Type 1) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:34.817 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:35.076 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:36.014 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:39.305 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:39.305 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:39.305 Starting DPDK initialization... 00:05:39.305 Starting SPDK post initialization... 00:05:39.305 SPDK NVMe probe 00:05:39.305 Attaching to 0000:88:00.0 00:05:39.305 Attached to 0000:88:00.0 00:05:39.305 Cleaning up... 00:05:39.305 00:05:39.305 real 0m4.437s 00:05:39.305 user 0m3.278s 00:05:39.305 sys 0m0.213s 00:05:39.305 04:50:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.305 04:50:18 -- common/autotest_common.sh@10 -- # set +x 00:05:39.305 ************************************ 00:05:39.305 END TEST env_dpdk_post_init 00:05:39.305 ************************************ 00:05:39.305 04:50:18 -- env/env.sh@26 -- # uname 00:05:39.305 04:50:18 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:39.305 04:50:18 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:39.305 04:50:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.305 04:50:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.305 04:50:18 -- common/autotest_common.sh@10 -- # set +x 00:05:39.305 ************************************ 00:05:39.305 START TEST env_mem_callbacks 00:05:39.305 ************************************ 00:05:39.305 04:50:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:39.305 EAL: Detected CPU lcores: 48 00:05:39.305 EAL: Detected NUMA nodes: 2 00:05:39.305 EAL: Detected shared linkage of DPDK 00:05:39.305 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:39.305 EAL: Selected IOVA mode 'VA' 00:05:39.305 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.305 EAL: VFIO support initialized 00:05:39.305 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:39.305 00:05:39.305 00:05:39.305 CUnit - A unit testing framework for C - Version 2.1-3 00:05:39.305 http://cunit.sourceforge.net/ 00:05:39.305 00:05:39.305 00:05:39.305 Suite: memory 00:05:39.305 Test: test ... 00:05:39.305 register 0x200000200000 2097152 00:05:39.305 malloc 3145728 00:05:39.305 register 0x200000400000 4194304 00:05:39.305 buf 0x200000500000 len 3145728 PASSED 00:05:39.305 malloc 64 00:05:39.305 buf 0x2000004fff40 len 64 PASSED 00:05:39.305 malloc 4194304 00:05:39.305 register 0x200000800000 6291456 00:05:39.305 buf 0x200000a00000 len 4194304 PASSED 00:05:39.305 free 0x200000500000 3145728 00:05:39.305 free 0x2000004fff40 64 00:05:39.305 unregister 0x200000400000 4194304 PASSED 00:05:39.305 free 0x200000a00000 4194304 00:05:39.305 unregister 0x200000800000 6291456 PASSED 00:05:39.305 malloc 8388608 00:05:39.305 register 0x200000400000 10485760 00:05:39.305 buf 0x200000600000 len 8388608 PASSED 00:05:39.305 free 0x200000600000 8388608 00:05:39.305 unregister 0x200000400000 10485760 PASSED 00:05:39.305 passed 00:05:39.305 00:05:39.305 Run Summary: Type Total Ran Passed Failed Inactive 00:05:39.305 suites 1 1 n/a 0 0 00:05:39.305 tests 1 1 1 0 0 00:05:39.305 asserts 15 15 15 0 n/a 00:05:39.305 00:05:39.305 Elapsed time = 0.005 seconds 00:05:39.305 00:05:39.305 real 0m0.049s 00:05:39.305 user 0m0.016s 00:05:39.305 sys 0m0.032s 00:05:39.305 04:50:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.305 04:50:18 -- common/autotest_common.sh@10 -- # set +x 00:05:39.305 ************************************ 00:05:39.305 END TEST env_mem_callbacks 00:05:39.305 ************************************ 00:05:39.305 00:05:39.305 real 0m6.822s 00:05:39.305 user 0m4.508s 00:05:39.305 sys 0m1.280s 00:05:39.305 04:50:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.305 04:50:18 -- common/autotest_common.sh@10 -- # set +x 00:05:39.305 ************************************ 00:05:39.305 END TEST env 00:05:39.305 ************************************ 00:05:39.305 04:50:18 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:39.305 04:50:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.305 04:50:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.305 04:50:18 -- common/autotest_common.sh@10 -- # set +x 00:05:39.564 ************************************ 00:05:39.564 START TEST rpc 00:05:39.564 ************************************ 00:05:39.564 04:50:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:39.564 * Looking for test storage... 00:05:39.564 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:39.564 04:50:18 -- rpc/rpc.sh@65 -- # spdk_pid=2268518 00:05:39.564 04:50:18 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:39.564 04:50:18 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:39.564 04:50:18 -- rpc/rpc.sh@67 -- # waitforlisten 2268518 00:05:39.564 04:50:18 -- common/autotest_common.sh@817 -- # '[' -z 2268518 ']' 00:05:39.564 04:50:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:39.564 04:50:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:39.564 04:50:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:39.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:39.564 04:50:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:39.564 04:50:18 -- common/autotest_common.sh@10 -- # set +x 00:05:39.564 [2024-04-23 04:50:18.625695] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:05:39.564 [2024-04-23 04:50:18.625794] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2268518 ] 00:05:39.564 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.564 [2024-04-23 04:50:18.657271] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:05:39.564 [2024-04-23 04:50:18.683640] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.822 [2024-04-23 04:50:18.765897] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:39.822 [2024-04-23 04:50:18.765957] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2268518' to capture a snapshot of events at runtime. 00:05:39.822 [2024-04-23 04:50:18.765981] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:05:39.822 [2024-04-23 04:50:18.765992] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:05:39.823 [2024-04-23 04:50:18.766001] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2268518 for offline analysis/debug. 00:05:39.823 [2024-04-23 04:50:18.766028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.082 04:50:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:40.082 04:50:19 -- common/autotest_common.sh@850 -- # return 0 00:05:40.082 04:50:19 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:40.082 04:50:19 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:40.082 04:50:19 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:40.082 04:50:19 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:40.082 04:50:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.082 04:50:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.082 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.082 ************************************ 00:05:40.082 START TEST rpc_integrity 00:05:40.082 ************************************ 00:05:40.082 04:50:19 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:40.082 04:50:19 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:40.082 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.082 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.082 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.082 04:50:19 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:40.082 04:50:19 -- rpc/rpc.sh@13 -- # jq length 00:05:40.082 04:50:19 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:40.082 04:50:19 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:40.082 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.082 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.082 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.082 04:50:19 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:40.082 04:50:19 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:40.082 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.082 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.082 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.082 04:50:19 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:40.082 { 00:05:40.082 "name": "Malloc0", 00:05:40.082 "aliases": [ 00:05:40.082 "9bd1f55b-9b0a-4309-b599-4825a6cdf472" 00:05:40.082 ], 00:05:40.082 "product_name": "Malloc disk", 00:05:40.082 "block_size": 512, 00:05:40.082 "num_blocks": 16384, 00:05:40.082 "uuid": "9bd1f55b-9b0a-4309-b599-4825a6cdf472", 00:05:40.082 "assigned_rate_limits": { 00:05:40.082 "rw_ios_per_sec": 0, 00:05:40.082 "rw_mbytes_per_sec": 0, 00:05:40.082 "r_mbytes_per_sec": 0, 00:05:40.082 "w_mbytes_per_sec": 0 00:05:40.082 }, 00:05:40.082 "claimed": false, 00:05:40.082 "zoned": false, 00:05:40.082 "supported_io_types": { 00:05:40.082 "read": true, 00:05:40.082 "write": true, 00:05:40.082 "unmap": true, 00:05:40.082 "write_zeroes": true, 00:05:40.082 "flush": true, 00:05:40.082 "reset": true, 00:05:40.082 "compare": false, 00:05:40.082 "compare_and_write": false, 00:05:40.082 "abort": true, 00:05:40.082 "nvme_admin": false, 00:05:40.082 "nvme_io": false 00:05:40.082 }, 00:05:40.082 "memory_domains": [ 00:05:40.082 { 00:05:40.082 "dma_device_id": "system", 00:05:40.082 "dma_device_type": 1 00:05:40.082 }, 00:05:40.082 { 00:05:40.082 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.082 "dma_device_type": 2 00:05:40.082 } 00:05:40.082 ], 00:05:40.082 "driver_specific": {} 00:05:40.082 } 00:05:40.082 ]' 00:05:40.082 04:50:19 -- rpc/rpc.sh@17 -- # jq length 00:05:40.082 04:50:19 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:40.082 04:50:19 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:40.082 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.082 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.082 [2024-04-23 04:50:19.230712] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:40.082 [2024-04-23 04:50:19.230760] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:40.082 [2024-04-23 04:50:19.230784] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x12ae3c0 00:05:40.082 [2024-04-23 04:50:19.230816] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:40.082 [2024-04-23 04:50:19.232342] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:40.082 [2024-04-23 04:50:19.232371] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:40.082 Passthru0 00:05:40.082 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.082 04:50:19 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:40.082 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.082 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.342 04:50:19 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:40.342 { 00:05:40.342 "name": "Malloc0", 00:05:40.342 "aliases": [ 00:05:40.342 "9bd1f55b-9b0a-4309-b599-4825a6cdf472" 00:05:40.342 ], 00:05:40.342 "product_name": "Malloc disk", 00:05:40.342 "block_size": 512, 00:05:40.342 "num_blocks": 16384, 00:05:40.342 "uuid": "9bd1f55b-9b0a-4309-b599-4825a6cdf472", 00:05:40.342 "assigned_rate_limits": { 00:05:40.342 "rw_ios_per_sec": 0, 00:05:40.342 "rw_mbytes_per_sec": 0, 00:05:40.342 "r_mbytes_per_sec": 0, 00:05:40.342 "w_mbytes_per_sec": 0 00:05:40.342 }, 00:05:40.342 "claimed": true, 00:05:40.342 "claim_type": "exclusive_write", 00:05:40.342 "zoned": false, 00:05:40.342 "supported_io_types": { 00:05:40.342 "read": true, 00:05:40.342 "write": true, 00:05:40.342 "unmap": true, 00:05:40.342 "write_zeroes": true, 00:05:40.342 "flush": true, 00:05:40.342 "reset": true, 00:05:40.342 "compare": false, 00:05:40.342 "compare_and_write": false, 00:05:40.342 "abort": true, 00:05:40.342 "nvme_admin": false, 00:05:40.342 "nvme_io": false 00:05:40.342 }, 00:05:40.342 "memory_domains": [ 00:05:40.342 { 00:05:40.342 "dma_device_id": "system", 00:05:40.342 "dma_device_type": 1 00:05:40.342 }, 00:05:40.342 { 00:05:40.342 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.342 "dma_device_type": 2 00:05:40.342 } 00:05:40.342 ], 00:05:40.342 "driver_specific": {} 00:05:40.342 }, 00:05:40.342 { 00:05:40.342 "name": "Passthru0", 00:05:40.342 "aliases": [ 00:05:40.342 "5fb0cb20-4b86-5b59-bf8d-94bc0adb03b0" 00:05:40.342 ], 00:05:40.342 "product_name": "passthru", 00:05:40.342 "block_size": 512, 00:05:40.342 "num_blocks": 16384, 00:05:40.342 "uuid": "5fb0cb20-4b86-5b59-bf8d-94bc0adb03b0", 00:05:40.342 "assigned_rate_limits": { 00:05:40.342 "rw_ios_per_sec": 0, 00:05:40.342 "rw_mbytes_per_sec": 0, 00:05:40.342 "r_mbytes_per_sec": 0, 00:05:40.342 "w_mbytes_per_sec": 0 00:05:40.342 }, 00:05:40.342 "claimed": false, 00:05:40.342 "zoned": false, 00:05:40.342 "supported_io_types": { 00:05:40.342 "read": true, 00:05:40.342 "write": true, 00:05:40.342 "unmap": true, 00:05:40.342 "write_zeroes": true, 00:05:40.342 "flush": true, 00:05:40.342 "reset": true, 00:05:40.342 "compare": false, 00:05:40.342 "compare_and_write": false, 00:05:40.342 "abort": true, 00:05:40.342 "nvme_admin": false, 00:05:40.342 "nvme_io": false 00:05:40.342 }, 00:05:40.342 "memory_domains": [ 00:05:40.342 { 00:05:40.342 "dma_device_id": "system", 00:05:40.342 "dma_device_type": 1 00:05:40.342 }, 00:05:40.342 { 00:05:40.342 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.342 "dma_device_type": 2 00:05:40.342 } 00:05:40.342 ], 00:05:40.342 "driver_specific": { 00:05:40.342 "passthru": { 00:05:40.342 "name": "Passthru0", 00:05:40.342 "base_bdev_name": "Malloc0" 00:05:40.342 } 00:05:40.342 } 00:05:40.342 } 00:05:40.342 ]' 00:05:40.342 04:50:19 -- rpc/rpc.sh@21 -- # jq length 00:05:40.342 04:50:19 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:40.342 04:50:19 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:40.342 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.342 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.342 04:50:19 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:40.342 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.342 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.342 04:50:19 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:40.342 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.342 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.342 04:50:19 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:40.342 04:50:19 -- rpc/rpc.sh@26 -- # jq length 00:05:40.342 04:50:19 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:40.342 00:05:40.342 real 0m0.224s 00:05:40.342 user 0m0.149s 00:05:40.342 sys 0m0.021s 00:05:40.342 04:50:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.342 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 ************************************ 00:05:40.342 END TEST rpc_integrity 00:05:40.342 ************************************ 00:05:40.342 04:50:19 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:40.342 04:50:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.342 04:50:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.342 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 ************************************ 00:05:40.342 START TEST rpc_plugins 00:05:40.342 ************************************ 00:05:40.342 04:50:19 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:05:40.342 04:50:19 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:40.342 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.342 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.342 04:50:19 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:40.342 04:50:19 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:40.342 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.342 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.342 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.342 04:50:19 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:40.342 { 00:05:40.342 "name": "Malloc1", 00:05:40.342 "aliases": [ 00:05:40.342 "46bdb168-51d3-40b7-8757-9004ffd556b0" 00:05:40.342 ], 00:05:40.342 "product_name": "Malloc disk", 00:05:40.342 "block_size": 4096, 00:05:40.342 "num_blocks": 256, 00:05:40.342 "uuid": "46bdb168-51d3-40b7-8757-9004ffd556b0", 00:05:40.342 "assigned_rate_limits": { 00:05:40.342 "rw_ios_per_sec": 0, 00:05:40.342 "rw_mbytes_per_sec": 0, 00:05:40.342 "r_mbytes_per_sec": 0, 00:05:40.342 "w_mbytes_per_sec": 0 00:05:40.342 }, 00:05:40.342 "claimed": false, 00:05:40.342 "zoned": false, 00:05:40.342 "supported_io_types": { 00:05:40.342 "read": true, 00:05:40.342 "write": true, 00:05:40.342 "unmap": true, 00:05:40.342 "write_zeroes": true, 00:05:40.342 "flush": true, 00:05:40.342 "reset": true, 00:05:40.342 "compare": false, 00:05:40.342 "compare_and_write": false, 00:05:40.342 "abort": true, 00:05:40.342 "nvme_admin": false, 00:05:40.342 "nvme_io": false 00:05:40.342 }, 00:05:40.342 "memory_domains": [ 00:05:40.342 { 00:05:40.342 "dma_device_id": "system", 00:05:40.342 "dma_device_type": 1 00:05:40.342 }, 00:05:40.342 { 00:05:40.342 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.342 "dma_device_type": 2 00:05:40.342 } 00:05:40.342 ], 00:05:40.342 "driver_specific": {} 00:05:40.342 } 00:05:40.342 ]' 00:05:40.342 04:50:19 -- rpc/rpc.sh@32 -- # jq length 00:05:40.602 04:50:19 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:40.602 04:50:19 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:40.602 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.602 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.602 04:50:19 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:40.602 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.602 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.602 04:50:19 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:40.602 04:50:19 -- rpc/rpc.sh@36 -- # jq length 00:05:40.602 04:50:19 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:40.602 00:05:40.602 real 0m0.114s 00:05:40.602 user 0m0.073s 00:05:40.602 sys 0m0.011s 00:05:40.602 04:50:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.602 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 ************************************ 00:05:40.602 END TEST rpc_plugins 00:05:40.602 ************************************ 00:05:40.602 04:50:19 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:40.602 04:50:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.602 04:50:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.602 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 ************************************ 00:05:40.602 START TEST rpc_trace_cmd_test 00:05:40.602 ************************************ 00:05:40.602 04:50:19 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:05:40.602 04:50:19 -- rpc/rpc.sh@40 -- # local info 00:05:40.602 04:50:19 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:40.602 04:50:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.602 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 04:50:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.602 04:50:19 -- rpc/rpc.sh@42 -- # info='{ 00:05:40.603 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2268518", 00:05:40.603 "tpoint_group_mask": "0x8", 00:05:40.603 "iscsi_conn": { 00:05:40.603 "mask": "0x2", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "scsi": { 00:05:40.603 "mask": "0x4", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "bdev": { 00:05:40.603 "mask": "0x8", 00:05:40.603 "tpoint_mask": "0xffffffffffffffff" 00:05:40.603 }, 00:05:40.603 "nvmf_rdma": { 00:05:40.603 "mask": "0x10", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "nvmf_tcp": { 00:05:40.603 "mask": "0x20", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "ftl": { 00:05:40.603 "mask": "0x40", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "blobfs": { 00:05:40.603 "mask": "0x80", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "dsa": { 00:05:40.603 "mask": "0x200", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "thread": { 00:05:40.603 "mask": "0x400", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "nvme_pcie": { 00:05:40.603 "mask": "0x800", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "iaa": { 00:05:40.603 "mask": "0x1000", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "nvme_tcp": { 00:05:40.603 "mask": "0x2000", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "bdev_nvme": { 00:05:40.603 "mask": "0x4000", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 }, 00:05:40.603 "sock": { 00:05:40.603 "mask": "0x8000", 00:05:40.603 "tpoint_mask": "0x0" 00:05:40.603 } 00:05:40.603 }' 00:05:40.603 04:50:19 -- rpc/rpc.sh@43 -- # jq length 00:05:40.603 04:50:19 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:05:40.603 04:50:19 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:40.861 04:50:19 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:40.861 04:50:19 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:40.861 04:50:19 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:40.861 04:50:19 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:40.861 04:50:19 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:40.861 04:50:19 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:40.861 04:50:19 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:40.861 00:05:40.861 real 0m0.196s 00:05:40.861 user 0m0.172s 00:05:40.861 sys 0m0.014s 00:05:40.861 04:50:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.861 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.861 ************************************ 00:05:40.861 END TEST rpc_trace_cmd_test 00:05:40.861 ************************************ 00:05:40.861 04:50:19 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:40.861 04:50:19 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:40.861 04:50:19 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:40.861 04:50:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.861 04:50:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.861 04:50:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.861 ************************************ 00:05:40.861 START TEST rpc_daemon_integrity 00:05:40.861 ************************************ 00:05:40.861 04:50:20 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:40.861 04:50:20 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:40.861 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.861 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.119 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.119 04:50:20 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:41.119 04:50:20 -- rpc/rpc.sh@13 -- # jq length 00:05:41.119 04:50:20 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:41.119 04:50:20 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:41.119 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.119 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.119 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.119 04:50:20 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:41.119 04:50:20 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:41.119 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.119 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.119 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.119 04:50:20 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:41.119 { 00:05:41.119 "name": "Malloc2", 00:05:41.119 "aliases": [ 00:05:41.119 "dc48b967-0e89-42b6-9d89-06b7dd0f71c2" 00:05:41.119 ], 00:05:41.119 "product_name": "Malloc disk", 00:05:41.119 "block_size": 512, 00:05:41.120 "num_blocks": 16384, 00:05:41.120 "uuid": "dc48b967-0e89-42b6-9d89-06b7dd0f71c2", 00:05:41.120 "assigned_rate_limits": { 00:05:41.120 "rw_ios_per_sec": 0, 00:05:41.120 "rw_mbytes_per_sec": 0, 00:05:41.120 "r_mbytes_per_sec": 0, 00:05:41.120 "w_mbytes_per_sec": 0 00:05:41.120 }, 00:05:41.120 "claimed": false, 00:05:41.120 "zoned": false, 00:05:41.120 "supported_io_types": { 00:05:41.120 "read": true, 00:05:41.120 "write": true, 00:05:41.120 "unmap": true, 00:05:41.120 "write_zeroes": true, 00:05:41.120 "flush": true, 00:05:41.120 "reset": true, 00:05:41.120 "compare": false, 00:05:41.120 "compare_and_write": false, 00:05:41.120 "abort": true, 00:05:41.120 "nvme_admin": false, 00:05:41.120 "nvme_io": false 00:05:41.120 }, 00:05:41.120 "memory_domains": [ 00:05:41.120 { 00:05:41.120 "dma_device_id": "system", 00:05:41.120 "dma_device_type": 1 00:05:41.120 }, 00:05:41.120 { 00:05:41.120 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.120 "dma_device_type": 2 00:05:41.120 } 00:05:41.120 ], 00:05:41.120 "driver_specific": {} 00:05:41.120 } 00:05:41.120 ]' 00:05:41.120 04:50:20 -- rpc/rpc.sh@17 -- # jq length 00:05:41.120 04:50:20 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:41.120 04:50:20 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:41.120 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.120 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.120 [2024-04-23 04:50:20.134172] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:41.120 [2024-04-23 04:50:20.134224] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:41.120 [2024-04-23 04:50:20.134251] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x12af770 00:05:41.120 [2024-04-23 04:50:20.134265] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:41.120 [2024-04-23 04:50:20.135654] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:41.120 [2024-04-23 04:50:20.135687] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:41.120 Passthru0 00:05:41.120 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.120 04:50:20 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:41.120 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.120 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.120 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.120 04:50:20 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:41.120 { 00:05:41.120 "name": "Malloc2", 00:05:41.120 "aliases": [ 00:05:41.120 "dc48b967-0e89-42b6-9d89-06b7dd0f71c2" 00:05:41.120 ], 00:05:41.120 "product_name": "Malloc disk", 00:05:41.120 "block_size": 512, 00:05:41.120 "num_blocks": 16384, 00:05:41.120 "uuid": "dc48b967-0e89-42b6-9d89-06b7dd0f71c2", 00:05:41.120 "assigned_rate_limits": { 00:05:41.120 "rw_ios_per_sec": 0, 00:05:41.120 "rw_mbytes_per_sec": 0, 00:05:41.120 "r_mbytes_per_sec": 0, 00:05:41.120 "w_mbytes_per_sec": 0 00:05:41.120 }, 00:05:41.120 "claimed": true, 00:05:41.120 "claim_type": "exclusive_write", 00:05:41.120 "zoned": false, 00:05:41.120 "supported_io_types": { 00:05:41.120 "read": true, 00:05:41.120 "write": true, 00:05:41.120 "unmap": true, 00:05:41.120 "write_zeroes": true, 00:05:41.120 "flush": true, 00:05:41.120 "reset": true, 00:05:41.120 "compare": false, 00:05:41.120 "compare_and_write": false, 00:05:41.120 "abort": true, 00:05:41.120 "nvme_admin": false, 00:05:41.120 "nvme_io": false 00:05:41.120 }, 00:05:41.120 "memory_domains": [ 00:05:41.120 { 00:05:41.120 "dma_device_id": "system", 00:05:41.120 "dma_device_type": 1 00:05:41.120 }, 00:05:41.120 { 00:05:41.120 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.120 "dma_device_type": 2 00:05:41.120 } 00:05:41.120 ], 00:05:41.120 "driver_specific": {} 00:05:41.120 }, 00:05:41.120 { 00:05:41.120 "name": "Passthru0", 00:05:41.120 "aliases": [ 00:05:41.120 "91380e89-d189-5c25-b9cf-0ed7333d6e2d" 00:05:41.120 ], 00:05:41.120 "product_name": "passthru", 00:05:41.120 "block_size": 512, 00:05:41.120 "num_blocks": 16384, 00:05:41.120 "uuid": "91380e89-d189-5c25-b9cf-0ed7333d6e2d", 00:05:41.120 "assigned_rate_limits": { 00:05:41.120 "rw_ios_per_sec": 0, 00:05:41.120 "rw_mbytes_per_sec": 0, 00:05:41.120 "r_mbytes_per_sec": 0, 00:05:41.120 "w_mbytes_per_sec": 0 00:05:41.120 }, 00:05:41.120 "claimed": false, 00:05:41.120 "zoned": false, 00:05:41.120 "supported_io_types": { 00:05:41.120 "read": true, 00:05:41.120 "write": true, 00:05:41.120 "unmap": true, 00:05:41.120 "write_zeroes": true, 00:05:41.120 "flush": true, 00:05:41.120 "reset": true, 00:05:41.120 "compare": false, 00:05:41.120 "compare_and_write": false, 00:05:41.120 "abort": true, 00:05:41.120 "nvme_admin": false, 00:05:41.120 "nvme_io": false 00:05:41.120 }, 00:05:41.120 "memory_domains": [ 00:05:41.120 { 00:05:41.120 "dma_device_id": "system", 00:05:41.120 "dma_device_type": 1 00:05:41.120 }, 00:05:41.120 { 00:05:41.120 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.120 "dma_device_type": 2 00:05:41.120 } 00:05:41.120 ], 00:05:41.120 "driver_specific": { 00:05:41.120 "passthru": { 00:05:41.120 "name": "Passthru0", 00:05:41.120 "base_bdev_name": "Malloc2" 00:05:41.120 } 00:05:41.120 } 00:05:41.120 } 00:05:41.120 ]' 00:05:41.120 04:50:20 -- rpc/rpc.sh@21 -- # jq length 00:05:41.120 04:50:20 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:41.120 04:50:20 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:41.120 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.120 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.120 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.120 04:50:20 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:41.120 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.120 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.120 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.120 04:50:20 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:41.120 04:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.120 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.120 04:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.120 04:50:20 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:41.120 04:50:20 -- rpc/rpc.sh@26 -- # jq length 00:05:41.120 04:50:20 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:41.120 00:05:41.120 real 0m0.227s 00:05:41.120 user 0m0.156s 00:05:41.120 sys 0m0.014s 00:05:41.120 04:50:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:41.120 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.120 ************************************ 00:05:41.120 END TEST rpc_daemon_integrity 00:05:41.120 ************************************ 00:05:41.120 04:50:20 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:41.120 04:50:20 -- rpc/rpc.sh@84 -- # killprocess 2268518 00:05:41.120 04:50:20 -- common/autotest_common.sh@936 -- # '[' -z 2268518 ']' 00:05:41.120 04:50:20 -- common/autotest_common.sh@940 -- # kill -0 2268518 00:05:41.120 04:50:20 -- common/autotest_common.sh@941 -- # uname 00:05:41.120 04:50:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:41.120 04:50:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2268518 00:05:41.380 04:50:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:41.380 04:50:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:41.380 04:50:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2268518' 00:05:41.380 killing process with pid 2268518 00:05:41.380 04:50:20 -- common/autotest_common.sh@955 -- # kill 2268518 00:05:41.380 04:50:20 -- common/autotest_common.sh@960 -- # wait 2268518 00:05:41.639 00:05:41.639 real 0m2.181s 00:05:41.639 user 0m2.770s 00:05:41.639 sys 0m0.704s 00:05:41.639 04:50:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:41.639 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.639 ************************************ 00:05:41.639 END TEST rpc 00:05:41.639 ************************************ 00:05:41.639 04:50:20 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:41.639 04:50:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.639 04:50:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.639 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.897 ************************************ 00:05:41.897 START TEST skip_rpc 00:05:41.897 ************************************ 00:05:41.897 04:50:20 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:41.897 * Looking for test storage... 00:05:41.897 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:41.897 04:50:20 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:05:41.897 04:50:20 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:05:41.897 04:50:20 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:05:41.897 04:50:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.897 04:50:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.897 04:50:20 -- common/autotest_common.sh@10 -- # set +x 00:05:41.897 ************************************ 00:05:41.897 START TEST skip_rpc 00:05:41.897 ************************************ 00:05:41.897 04:50:20 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:05:41.897 04:50:20 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=2268999 00:05:41.897 04:50:20 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:05:41.897 04:50:20 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:41.897 04:50:20 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:05:41.897 [2024-04-23 04:50:21.024243] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:05:41.897 [2024-04-23 04:50:21.024308] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2268999 ] 00:05:41.897 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.897 [2024-04-23 04:50:21.055169] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:05:42.156 [2024-04-23 04:50:21.086050] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.156 [2024-04-23 04:50:21.176428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.430 04:50:25 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:05:47.430 04:50:25 -- common/autotest_common.sh@638 -- # local es=0 00:05:47.430 04:50:25 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:05:47.430 04:50:25 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:05:47.430 04:50:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:47.430 04:50:25 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:05:47.430 04:50:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:47.430 04:50:25 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:05:47.430 04:50:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.430 04:50:25 -- common/autotest_common.sh@10 -- # set +x 00:05:47.430 04:50:25 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:47.430 04:50:25 -- common/autotest_common.sh@641 -- # es=1 00:05:47.430 04:50:25 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:47.430 04:50:25 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:47.430 04:50:25 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:47.430 04:50:25 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:05:47.430 04:50:25 -- rpc/skip_rpc.sh@23 -- # killprocess 2268999 00:05:47.430 04:50:25 -- common/autotest_common.sh@936 -- # '[' -z 2268999 ']' 00:05:47.430 04:50:25 -- common/autotest_common.sh@940 -- # kill -0 2268999 00:05:47.430 04:50:25 -- common/autotest_common.sh@941 -- # uname 00:05:47.430 04:50:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:47.430 04:50:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2268999 00:05:47.431 04:50:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:47.431 04:50:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:47.431 04:50:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2268999' 00:05:47.431 killing process with pid 2268999 00:05:47.431 04:50:26 -- common/autotest_common.sh@955 -- # kill 2268999 00:05:47.431 04:50:26 -- common/autotest_common.sh@960 -- # wait 2268999 00:05:47.431 00:05:47.431 real 0m5.436s 00:05:47.431 user 0m5.109s 00:05:47.431 sys 0m0.324s 00:05:47.431 04:50:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:47.431 04:50:26 -- common/autotest_common.sh@10 -- # set +x 00:05:47.431 ************************************ 00:05:47.431 END TEST skip_rpc 00:05:47.431 ************************************ 00:05:47.431 04:50:26 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:05:47.431 04:50:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:47.431 04:50:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.431 04:50:26 -- common/autotest_common.sh@10 -- # set +x 00:05:47.431 ************************************ 00:05:47.431 START TEST skip_rpc_with_json 00:05:47.431 ************************************ 00:05:47.431 04:50:26 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:05:47.431 04:50:26 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:05:47.431 04:50:26 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=2269700 00:05:47.431 04:50:26 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:47.431 04:50:26 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:47.431 04:50:26 -- rpc/skip_rpc.sh@31 -- # waitforlisten 2269700 00:05:47.431 04:50:26 -- common/autotest_common.sh@817 -- # '[' -z 2269700 ']' 00:05:47.431 04:50:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:47.431 04:50:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:47.431 04:50:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:47.431 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:47.431 04:50:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:47.431 04:50:26 -- common/autotest_common.sh@10 -- # set +x 00:05:47.431 [2024-04-23 04:50:26.578955] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:05:47.431 [2024-04-23 04:50:26.579045] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2269700 ] 00:05:47.690 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.690 [2024-04-23 04:50:26.611585] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:05:47.690 [2024-04-23 04:50:26.638719] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.690 [2024-04-23 04:50:26.724560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.949 04:50:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:47.949 04:50:26 -- common/autotest_common.sh@850 -- # return 0 00:05:47.949 04:50:26 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:05:47.949 04:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.949 04:50:26 -- common/autotest_common.sh@10 -- # set +x 00:05:47.949 [2024-04-23 04:50:26.976107] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:05:47.949 request: 00:05:47.949 { 00:05:47.949 "trtype": "tcp", 00:05:47.949 "method": "nvmf_get_transports", 00:05:47.949 "req_id": 1 00:05:47.949 } 00:05:47.949 Got JSON-RPC error response 00:05:47.949 response: 00:05:47.949 { 00:05:47.949 "code": -19, 00:05:47.949 "message": "No such device" 00:05:47.949 } 00:05:47.949 04:50:26 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:47.949 04:50:26 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:05:47.949 04:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.949 04:50:26 -- common/autotest_common.sh@10 -- # set +x 00:05:47.949 [2024-04-23 04:50:26.984234] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:47.949 04:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:47.949 04:50:26 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:05:47.949 04:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.949 04:50:26 -- common/autotest_common.sh@10 -- # set +x 00:05:48.210 04:50:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:48.210 04:50:27 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:05:48.210 { 00:05:48.210 "subsystems": [ 00:05:48.210 { 00:05:48.210 "subsystem": "vfio_user_target", 00:05:48.210 "config": null 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "keyring", 00:05:48.210 "config": [] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "iobuf", 00:05:48.210 "config": [ 00:05:48.210 { 00:05:48.210 "method": "iobuf_set_options", 00:05:48.210 "params": { 00:05:48.210 "small_pool_count": 8192, 00:05:48.210 "large_pool_count": 1024, 00:05:48.210 "small_bufsize": 8192, 00:05:48.210 "large_bufsize": 135168 00:05:48.210 } 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "sock", 00:05:48.210 "config": [ 00:05:48.210 { 00:05:48.210 "method": "sock_impl_set_options", 00:05:48.210 "params": { 00:05:48.210 "impl_name": "posix", 00:05:48.210 "recv_buf_size": 2097152, 00:05:48.210 "send_buf_size": 2097152, 00:05:48.210 "enable_recv_pipe": true, 00:05:48.210 "enable_quickack": false, 00:05:48.210 "enable_placement_id": 0, 00:05:48.210 "enable_zerocopy_send_server": true, 00:05:48.210 "enable_zerocopy_send_client": false, 00:05:48.210 "zerocopy_threshold": 0, 00:05:48.210 "tls_version": 0, 00:05:48.210 "enable_ktls": false 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "sock_impl_set_options", 00:05:48.210 "params": { 00:05:48.210 "impl_name": "ssl", 00:05:48.210 "recv_buf_size": 4096, 00:05:48.210 "send_buf_size": 4096, 00:05:48.210 "enable_recv_pipe": true, 00:05:48.210 "enable_quickack": false, 00:05:48.210 "enable_placement_id": 0, 00:05:48.210 "enable_zerocopy_send_server": true, 00:05:48.210 "enable_zerocopy_send_client": false, 00:05:48.210 "zerocopy_threshold": 0, 00:05:48.210 "tls_version": 0, 00:05:48.210 "enable_ktls": false 00:05:48.210 } 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "vmd", 00:05:48.210 "config": [] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "accel", 00:05:48.210 "config": [ 00:05:48.210 { 00:05:48.210 "method": "accel_set_options", 00:05:48.210 "params": { 00:05:48.210 "small_cache_size": 128, 00:05:48.210 "large_cache_size": 16, 00:05:48.210 "task_count": 2048, 00:05:48.210 "sequence_count": 2048, 00:05:48.210 "buf_count": 2048 00:05:48.210 } 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "bdev", 00:05:48.210 "config": [ 00:05:48.210 { 00:05:48.210 "method": "bdev_set_options", 00:05:48.210 "params": { 00:05:48.210 "bdev_io_pool_size": 65535, 00:05:48.210 "bdev_io_cache_size": 256, 00:05:48.210 "bdev_auto_examine": true, 00:05:48.210 "iobuf_small_cache_size": 128, 00:05:48.210 "iobuf_large_cache_size": 16 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "bdev_raid_set_options", 00:05:48.210 "params": { 00:05:48.210 "process_window_size_kb": 1024 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "bdev_iscsi_set_options", 00:05:48.210 "params": { 00:05:48.210 "timeout_sec": 30 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "bdev_nvme_set_options", 00:05:48.210 "params": { 00:05:48.210 "action_on_timeout": "none", 00:05:48.210 "timeout_us": 0, 00:05:48.210 "timeout_admin_us": 0, 00:05:48.210 "keep_alive_timeout_ms": 10000, 00:05:48.210 "arbitration_burst": 0, 00:05:48.210 "low_priority_weight": 0, 00:05:48.210 "medium_priority_weight": 0, 00:05:48.210 "high_priority_weight": 0, 00:05:48.210 "nvme_adminq_poll_period_us": 10000, 00:05:48.210 "nvme_ioq_poll_period_us": 0, 00:05:48.210 "io_queue_requests": 0, 00:05:48.210 "delay_cmd_submit": true, 00:05:48.210 "transport_retry_count": 4, 00:05:48.210 "bdev_retry_count": 3, 00:05:48.210 "transport_ack_timeout": 0, 00:05:48.210 "ctrlr_loss_timeout_sec": 0, 00:05:48.210 "reconnect_delay_sec": 0, 00:05:48.210 "fast_io_fail_timeout_sec": 0, 00:05:48.210 "disable_auto_failback": false, 00:05:48.210 "generate_uuids": false, 00:05:48.210 "transport_tos": 0, 00:05:48.210 "nvme_error_stat": false, 00:05:48.210 "rdma_srq_size": 0, 00:05:48.210 "io_path_stat": false, 00:05:48.210 "allow_accel_sequence": false, 00:05:48.210 "rdma_max_cq_size": 0, 00:05:48.210 "rdma_cm_event_timeout_ms": 0, 00:05:48.210 "dhchap_digests": [ 00:05:48.210 "sha256", 00:05:48.210 "sha384", 00:05:48.210 "sha512" 00:05:48.210 ], 00:05:48.210 "dhchap_dhgroups": [ 00:05:48.210 "null", 00:05:48.210 "ffdhe2048", 00:05:48.210 "ffdhe3072", 00:05:48.210 "ffdhe4096", 00:05:48.210 "ffdhe6144", 00:05:48.210 "ffdhe8192" 00:05:48.210 ] 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "bdev_nvme_set_hotplug", 00:05:48.210 "params": { 00:05:48.210 "period_us": 100000, 00:05:48.210 "enable": false 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "bdev_wait_for_examine" 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "scsi", 00:05:48.210 "config": null 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "scheduler", 00:05:48.210 "config": [ 00:05:48.210 { 00:05:48.210 "method": "framework_set_scheduler", 00:05:48.210 "params": { 00:05:48.210 "name": "static" 00:05:48.210 } 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "vhost_scsi", 00:05:48.210 "config": [] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "vhost_blk", 00:05:48.210 "config": [] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "ublk", 00:05:48.210 "config": [] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "nbd", 00:05:48.210 "config": [] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "nvmf", 00:05:48.210 "config": [ 00:05:48.210 { 00:05:48.210 "method": "nvmf_set_config", 00:05:48.210 "params": { 00:05:48.210 "discovery_filter": "match_any", 00:05:48.210 "admin_cmd_passthru": { 00:05:48.210 "identify_ctrlr": false 00:05:48.210 } 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "nvmf_set_max_subsystems", 00:05:48.210 "params": { 00:05:48.210 "max_subsystems": 1024 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "nvmf_set_crdt", 00:05:48.210 "params": { 00:05:48.210 "crdt1": 0, 00:05:48.210 "crdt2": 0, 00:05:48.210 "crdt3": 0 00:05:48.210 } 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "method": "nvmf_create_transport", 00:05:48.210 "params": { 00:05:48.210 "trtype": "TCP", 00:05:48.210 "max_queue_depth": 128, 00:05:48.210 "max_io_qpairs_per_ctrlr": 127, 00:05:48.210 "in_capsule_data_size": 4096, 00:05:48.210 "max_io_size": 131072, 00:05:48.210 "io_unit_size": 131072, 00:05:48.210 "max_aq_depth": 128, 00:05:48.210 "num_shared_buffers": 511, 00:05:48.210 "buf_cache_size": 4294967295, 00:05:48.210 "dif_insert_or_strip": false, 00:05:48.210 "zcopy": false, 00:05:48.210 "c2h_success": true, 00:05:48.210 "sock_priority": 0, 00:05:48.210 "abort_timeout_sec": 1, 00:05:48.210 "ack_timeout": 0, 00:05:48.210 "data_wr_pool_size": 0 00:05:48.210 } 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 }, 00:05:48.210 { 00:05:48.210 "subsystem": "iscsi", 00:05:48.210 "config": [ 00:05:48.210 { 00:05:48.210 "method": "iscsi_set_options", 00:05:48.210 "params": { 00:05:48.210 "node_base": "iqn.2016-06.io.spdk", 00:05:48.210 "max_sessions": 128, 00:05:48.210 "max_connections_per_session": 2, 00:05:48.210 "max_queue_depth": 64, 00:05:48.210 "default_time2wait": 2, 00:05:48.210 "default_time2retain": 20, 00:05:48.210 "first_burst_length": 8192, 00:05:48.210 "immediate_data": true, 00:05:48.210 "allow_duplicated_isid": false, 00:05:48.210 "error_recovery_level": 0, 00:05:48.210 "nop_timeout": 60, 00:05:48.210 "nop_in_interval": 30, 00:05:48.210 "disable_chap": false, 00:05:48.210 "require_chap": false, 00:05:48.210 "mutual_chap": false, 00:05:48.210 "chap_group": 0, 00:05:48.210 "max_large_datain_per_connection": 64, 00:05:48.210 "max_r2t_per_connection": 4, 00:05:48.210 "pdu_pool_size": 36864, 00:05:48.210 "immediate_data_pool_size": 16384, 00:05:48.210 "data_out_pool_size": 2048 00:05:48.210 } 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 } 00:05:48.210 ] 00:05:48.210 } 00:05:48.210 04:50:27 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:05:48.210 04:50:27 -- rpc/skip_rpc.sh@40 -- # killprocess 2269700 00:05:48.210 04:50:27 -- common/autotest_common.sh@936 -- # '[' -z 2269700 ']' 00:05:48.210 04:50:27 -- common/autotest_common.sh@940 -- # kill -0 2269700 00:05:48.210 04:50:27 -- common/autotest_common.sh@941 -- # uname 00:05:48.211 04:50:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:48.211 04:50:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2269700 00:05:48.211 04:50:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:48.211 04:50:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:48.211 04:50:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2269700' 00:05:48.211 killing process with pid 2269700 00:05:48.211 04:50:27 -- common/autotest_common.sh@955 -- # kill 2269700 00:05:48.211 04:50:27 -- common/autotest_common.sh@960 -- # wait 2269700 00:05:48.471 04:50:27 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=2269840 00:05:48.471 04:50:27 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:05:48.471 04:50:27 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:05:53.751 04:50:32 -- rpc/skip_rpc.sh@50 -- # killprocess 2269840 00:05:53.751 04:50:32 -- common/autotest_common.sh@936 -- # '[' -z 2269840 ']' 00:05:53.751 04:50:32 -- common/autotest_common.sh@940 -- # kill -0 2269840 00:05:53.751 04:50:32 -- common/autotest_common.sh@941 -- # uname 00:05:53.751 04:50:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:53.751 04:50:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2269840 00:05:53.751 04:50:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:53.751 04:50:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:53.751 04:50:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2269840' 00:05:53.751 killing process with pid 2269840 00:05:53.751 04:50:32 -- common/autotest_common.sh@955 -- # kill 2269840 00:05:53.751 04:50:32 -- common/autotest_common.sh@960 -- # wait 2269840 00:05:54.012 04:50:32 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:05:54.012 04:50:32 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:05:54.012 00:05:54.012 real 0m6.467s 00:05:54.012 user 0m6.059s 00:05:54.012 sys 0m0.686s 00:05:54.012 04:50:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:54.012 04:50:32 -- common/autotest_common.sh@10 -- # set +x 00:05:54.012 ************************************ 00:05:54.012 END TEST skip_rpc_with_json 00:05:54.012 ************************************ 00:05:54.012 04:50:33 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:05:54.012 04:50:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.012 04:50:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.012 04:50:33 -- common/autotest_common.sh@10 -- # set +x 00:05:54.012 ************************************ 00:05:54.012 START TEST skip_rpc_with_delay 00:05:54.012 ************************************ 00:05:54.012 04:50:33 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:05:54.012 04:50:33 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:54.012 04:50:33 -- common/autotest_common.sh@638 -- # local es=0 00:05:54.012 04:50:33 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:54.012 04:50:33 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.012 04:50:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.012 04:50:33 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.012 04:50:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.012 04:50:33 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.012 04:50:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.012 04:50:33 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.012 04:50:33 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:54.012 04:50:33 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:54.012 [2024-04-23 04:50:33.161019] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:05:54.012 [2024-04-23 04:50:33.161134] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:05:54.012 04:50:33 -- common/autotest_common.sh@641 -- # es=1 00:05:54.012 04:50:33 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:54.012 04:50:33 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:54.012 04:50:33 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:54.012 00:05:54.012 real 0m0.064s 00:05:54.012 user 0m0.041s 00:05:54.012 sys 0m0.023s 00:05:54.012 04:50:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:54.012 04:50:33 -- common/autotest_common.sh@10 -- # set +x 00:05:54.012 ************************************ 00:05:54.012 END TEST skip_rpc_with_delay 00:05:54.012 ************************************ 00:05:54.271 04:50:33 -- rpc/skip_rpc.sh@77 -- # uname 00:05:54.271 04:50:33 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:05:54.271 04:50:33 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:05:54.271 04:50:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.271 04:50:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.271 04:50:33 -- common/autotest_common.sh@10 -- # set +x 00:05:54.271 ************************************ 00:05:54.271 START TEST exit_on_failed_rpc_init 00:05:54.271 ************************************ 00:05:54.271 04:50:33 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:05:54.271 04:50:33 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=2270570 00:05:54.271 04:50:33 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:54.271 04:50:33 -- rpc/skip_rpc.sh@63 -- # waitforlisten 2270570 00:05:54.271 04:50:33 -- common/autotest_common.sh@817 -- # '[' -z 2270570 ']' 00:05:54.271 04:50:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:54.271 04:50:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:54.271 04:50:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:54.271 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:54.271 04:50:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:54.272 04:50:33 -- common/autotest_common.sh@10 -- # set +x 00:05:54.272 [2024-04-23 04:50:33.342197] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:05:54.272 [2024-04-23 04:50:33.342289] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2270570 ] 00:05:54.272 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.272 [2024-04-23 04:50:33.374291] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:05:54.272 [2024-04-23 04:50:33.399776] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.531 [2024-04-23 04:50:33.485555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.789 04:50:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:54.789 04:50:33 -- common/autotest_common.sh@850 -- # return 0 00:05:54.789 04:50:33 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:54.789 04:50:33 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:54.789 04:50:33 -- common/autotest_common.sh@638 -- # local es=0 00:05:54.789 04:50:33 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:54.789 04:50:33 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.789 04:50:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.789 04:50:33 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.789 04:50:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.790 04:50:33 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.790 04:50:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.790 04:50:33 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.790 04:50:33 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:54.790 04:50:33 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:54.790 [2024-04-23 04:50:33.781558] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:05:54.790 [2024-04-23 04:50:33.781639] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2270582 ] 00:05:54.790 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.790 [2024-04-23 04:50:33.813437] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:05:54.790 [2024-04-23 04:50:33.843405] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.790 [2024-04-23 04:50:33.934747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:54.790 [2024-04-23 04:50:33.934902] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:05:54.790 [2024-04-23 04:50:33.934924] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:05:54.790 [2024-04-23 04:50:33.934937] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:55.048 04:50:34 -- common/autotest_common.sh@641 -- # es=234 00:05:55.048 04:50:34 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:55.048 04:50:34 -- common/autotest_common.sh@650 -- # es=106 00:05:55.048 04:50:34 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:55.048 04:50:34 -- common/autotest_common.sh@658 -- # es=1 00:05:55.048 04:50:34 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:55.048 04:50:34 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:05:55.048 04:50:34 -- rpc/skip_rpc.sh@70 -- # killprocess 2270570 00:05:55.048 04:50:34 -- common/autotest_common.sh@936 -- # '[' -z 2270570 ']' 00:05:55.048 04:50:34 -- common/autotest_common.sh@940 -- # kill -0 2270570 00:05:55.048 04:50:34 -- common/autotest_common.sh@941 -- # uname 00:05:55.048 04:50:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:55.048 04:50:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2270570 00:05:55.048 04:50:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:55.048 04:50:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:55.048 04:50:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2270570' 00:05:55.048 killing process with pid 2270570 00:05:55.048 04:50:34 -- common/autotest_common.sh@955 -- # kill 2270570 00:05:55.048 04:50:34 -- common/autotest_common.sh@960 -- # wait 2270570 00:05:55.308 00:05:55.308 real 0m1.167s 00:05:55.308 user 0m1.280s 00:05:55.308 sys 0m0.433s 00:05:55.308 04:50:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.308 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.308 ************************************ 00:05:55.308 END TEST exit_on_failed_rpc_init 00:05:55.308 ************************************ 00:05:55.566 04:50:34 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:05:55.566 00:05:55.566 real 0m13.654s 00:05:55.567 user 0m12.685s 00:05:55.567 sys 0m1.758s 00:05:55.567 04:50:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.567 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.567 ************************************ 00:05:55.567 END TEST skip_rpc 00:05:55.567 ************************************ 00:05:55.567 04:50:34 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:55.567 04:50:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:55.567 04:50:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.567 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.567 ************************************ 00:05:55.567 START TEST rpc_client 00:05:55.567 ************************************ 00:05:55.567 04:50:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:55.567 * Looking for test storage... 00:05:55.567 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:55.567 04:50:34 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:55.567 OK 00:05:55.567 04:50:34 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:55.567 00:05:55.567 real 0m0.071s 00:05:55.567 user 0m0.032s 00:05:55.567 sys 0m0.044s 00:05:55.567 04:50:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.567 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.567 ************************************ 00:05:55.567 END TEST rpc_client 00:05:55.567 ************************************ 00:05:55.567 04:50:34 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:55.567 04:50:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:55.567 04:50:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.567 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.825 ************************************ 00:05:55.825 START TEST json_config 00:05:55.825 ************************************ 00:05:55.825 04:50:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:55.825 04:50:34 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:55.825 04:50:34 -- nvmf/common.sh@7 -- # uname -s 00:05:55.826 04:50:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:55.826 04:50:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:55.826 04:50:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:55.826 04:50:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:55.826 04:50:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:55.826 04:50:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:55.826 04:50:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:55.826 04:50:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:55.826 04:50:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:55.826 04:50:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:55.826 04:50:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:55.826 04:50:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:55.826 04:50:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:55.826 04:50:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:55.826 04:50:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:55.826 04:50:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:55.826 04:50:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:55.826 04:50:34 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:55.826 04:50:34 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:55.826 04:50:34 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:55.826 04:50:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.826 04:50:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.826 04:50:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.826 04:50:34 -- paths/export.sh@5 -- # export PATH 00:05:55.826 04:50:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.826 04:50:34 -- nvmf/common.sh@47 -- # : 0 00:05:55.826 04:50:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:05:55.826 04:50:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:05:55.826 04:50:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:55.826 04:50:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:55.826 04:50:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:55.826 04:50:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:05:55.826 04:50:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:05:55.826 04:50:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:05:55.826 04:50:34 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/common.sh 00:05:55.826 04:50:34 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:05:55.826 04:50:34 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:05:55.826 04:50:34 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:05:55.826 04:50:34 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:55.826 04:50:34 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:05:55.826 04:50:34 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:05:55.826 04:50:34 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:55.826 04:50:34 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:05:55.826 04:50:34 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:55.826 04:50:34 -- json_config/json_config.sh@33 -- # declare -A app_params 00:05:55.826 04:50:34 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:55.826 04:50:34 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:05:55.826 04:50:34 -- json_config/json_config.sh@40 -- # last_event_id=0 00:05:55.826 04:50:34 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:55.826 04:50:34 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:05:55.826 INFO: JSON configuration test init 00:05:55.826 04:50:34 -- json_config/json_config.sh@357 -- # json_config_test_init 00:05:55.826 04:50:34 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:05:55.826 04:50:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:55.826 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.826 04:50:34 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:05:55.826 04:50:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:55.826 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.826 04:50:34 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:05:55.826 04:50:34 -- json_config/common.sh@9 -- # local app=target 00:05:55.826 04:50:34 -- json_config/common.sh@10 -- # shift 00:05:55.826 04:50:34 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:55.826 04:50:34 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:55.826 04:50:34 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:55.826 04:50:34 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:55.826 04:50:34 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:55.826 04:50:34 -- json_config/common.sh@22 -- # app_pid["$app"]=2270838 00:05:55.826 04:50:34 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:55.826 04:50:34 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:55.826 Waiting for target to run... 00:05:55.826 04:50:34 -- json_config/common.sh@25 -- # waitforlisten 2270838 /var/tmp/spdk_tgt.sock 00:05:55.826 04:50:34 -- common/autotest_common.sh@817 -- # '[' -z 2270838 ']' 00:05:55.826 04:50:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:55.826 04:50:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:55.826 04:50:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:55.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:55.826 04:50:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:55.826 04:50:34 -- common/autotest_common.sh@10 -- # set +x 00:05:55.826 [2024-04-23 04:50:34.902588] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:05:55.826 [2024-04-23 04:50:34.902711] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2270838 ] 00:05:55.826 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.085 [2024-04-23 04:50:35.203252] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:05:56.085 [2024-04-23 04:50:35.236452] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.345 [2024-04-23 04:50:35.297449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.913 04:50:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:56.913 04:50:35 -- common/autotest_common.sh@850 -- # return 0 00:05:56.913 04:50:35 -- json_config/common.sh@26 -- # echo '' 00:05:56.913 00:05:56.913 04:50:35 -- json_config/json_config.sh@269 -- # create_accel_config 00:05:56.913 04:50:35 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:05:56.913 04:50:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:56.914 04:50:35 -- common/autotest_common.sh@10 -- # set +x 00:05:56.914 04:50:35 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:05:56.914 04:50:35 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:05:56.914 04:50:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:56.914 04:50:35 -- common/autotest_common.sh@10 -- # set +x 00:05:56.914 04:50:35 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:56.914 04:50:35 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:05:56.914 04:50:35 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:00.206 04:50:38 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:06:00.206 04:50:38 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:06:00.206 04:50:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:00.206 04:50:38 -- common/autotest_common.sh@10 -- # set +x 00:06:00.206 04:50:38 -- json_config/json_config.sh@45 -- # local ret=0 00:06:00.206 04:50:38 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:00.206 04:50:38 -- json_config/json_config.sh@46 -- # local enabled_types 00:06:00.206 04:50:38 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:06:00.206 04:50:38 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:00.206 04:50:38 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:06:00.206 04:50:39 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:06:00.206 04:50:39 -- json_config/json_config.sh@48 -- # local get_types 00:06:00.206 04:50:39 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:06:00.206 04:50:39 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:06:00.206 04:50:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:00.206 04:50:39 -- common/autotest_common.sh@10 -- # set +x 00:06:00.206 04:50:39 -- json_config/json_config.sh@55 -- # return 0 00:06:00.206 04:50:39 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:06:00.206 04:50:39 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:06:00.206 04:50:39 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:06:00.206 04:50:39 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:06:00.206 04:50:39 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:06:00.206 04:50:39 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:06:00.206 04:50:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:00.206 04:50:39 -- common/autotest_common.sh@10 -- # set +x 00:06:00.206 04:50:39 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:00.206 04:50:39 -- json_config/json_config.sh@233 -- # [[ tcp == \r\d\m\a ]] 00:06:00.206 04:50:39 -- json_config/json_config.sh@237 -- # [[ -z 127.0.0.1 ]] 00:06:00.206 04:50:39 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:00.206 04:50:39 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:00.465 MallocForNvmf0 00:06:00.465 04:50:39 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:00.465 04:50:39 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:00.722 MallocForNvmf1 00:06:00.722 04:50:39 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:06:00.722 04:50:39 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:06:00.980 [2024-04-23 04:50:40.003397] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:00.980 04:50:40 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:00.980 04:50:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:01.237 04:50:40 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:01.237 04:50:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:01.496 04:50:40 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:01.496 04:50:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:01.754 04:50:40 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:01.754 04:50:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:02.012 [2024-04-23 04:50:40.974543] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:02.012 04:50:40 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:06:02.012 04:50:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:02.012 04:50:40 -- common/autotest_common.sh@10 -- # set +x 00:06:02.012 04:50:41 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:06:02.012 04:50:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:02.012 04:50:41 -- common/autotest_common.sh@10 -- # set +x 00:06:02.012 04:50:41 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:06:02.012 04:50:41 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:02.012 04:50:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:02.271 MallocBdevForConfigChangeCheck 00:06:02.271 04:50:41 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:06:02.271 04:50:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:02.271 04:50:41 -- common/autotest_common.sh@10 -- # set +x 00:06:02.271 04:50:41 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:06:02.271 04:50:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:02.530 04:50:41 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:06:02.530 INFO: shutting down applications... 00:06:02.530 04:50:41 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:06:02.530 04:50:41 -- json_config/json_config.sh@368 -- # json_config_clear target 00:06:02.530 04:50:41 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:06:02.530 04:50:41 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:04.439 Calling clear_iscsi_subsystem 00:06:04.439 Calling clear_nvmf_subsystem 00:06:04.439 Calling clear_nbd_subsystem 00:06:04.439 Calling clear_ublk_subsystem 00:06:04.439 Calling clear_vhost_blk_subsystem 00:06:04.439 Calling clear_vhost_scsi_subsystem 00:06:04.439 Calling clear_bdev_subsystem 00:06:04.439 04:50:43 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:06:04.439 04:50:43 -- json_config/json_config.sh@343 -- # count=100 00:06:04.439 04:50:43 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:06:04.439 04:50:43 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:04.439 04:50:43 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:04.439 04:50:43 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:04.699 04:50:43 -- json_config/json_config.sh@345 -- # break 00:06:04.699 04:50:43 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:06:04.699 04:50:43 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:06:04.699 04:50:43 -- json_config/common.sh@31 -- # local app=target 00:06:04.699 04:50:43 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:04.699 04:50:43 -- json_config/common.sh@35 -- # [[ -n 2270838 ]] 00:06:04.699 04:50:43 -- json_config/common.sh@38 -- # kill -SIGINT 2270838 00:06:04.699 04:50:43 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:04.699 04:50:43 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:04.699 04:50:43 -- json_config/common.sh@41 -- # kill -0 2270838 00:06:04.699 04:50:43 -- json_config/common.sh@45 -- # sleep 0.5 00:06:05.267 04:50:44 -- json_config/common.sh@40 -- # (( i++ )) 00:06:05.267 04:50:44 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:05.267 04:50:44 -- json_config/common.sh@41 -- # kill -0 2270838 00:06:05.267 04:50:44 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:05.267 04:50:44 -- json_config/common.sh@43 -- # break 00:06:05.267 04:50:44 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:05.267 04:50:44 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:05.267 SPDK target shutdown done 00:06:05.267 04:50:44 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:06:05.267 INFO: relaunching applications... 00:06:05.267 04:50:44 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:05.267 04:50:44 -- json_config/common.sh@9 -- # local app=target 00:06:05.267 04:50:44 -- json_config/common.sh@10 -- # shift 00:06:05.267 04:50:44 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:05.267 04:50:44 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:05.267 04:50:44 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:05.267 04:50:44 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:05.267 04:50:44 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:05.267 04:50:44 -- json_config/common.sh@22 -- # app_pid["$app"]=2272145 00:06:05.267 04:50:44 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:05.267 04:50:44 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:05.267 Waiting for target to run... 00:06:05.267 04:50:44 -- json_config/common.sh@25 -- # waitforlisten 2272145 /var/tmp/spdk_tgt.sock 00:06:05.267 04:50:44 -- common/autotest_common.sh@817 -- # '[' -z 2272145 ']' 00:06:05.267 04:50:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:05.267 04:50:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:05.267 04:50:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:05.267 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:05.267 04:50:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:05.267 04:50:44 -- common/autotest_common.sh@10 -- # set +x 00:06:05.267 [2024-04-23 04:50:44.253134] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:05.267 [2024-04-23 04:50:44.253244] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2272145 ] 00:06:05.267 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.527 [2024-04-23 04:50:44.599620] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:05.527 [2024-04-23 04:50:44.628629] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.527 [2024-04-23 04:50:44.684848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.822 [2024-04-23 04:50:47.704417] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:08.822 [2024-04-23 04:50:47.736907] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:08.822 04:50:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:08.822 04:50:47 -- common/autotest_common.sh@850 -- # return 0 00:06:08.822 04:50:47 -- json_config/common.sh@26 -- # echo '' 00:06:08.822 00:06:08.822 04:50:47 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:06:08.822 04:50:47 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:08.822 INFO: Checking if target configuration is the same... 00:06:08.822 04:50:47 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:08.822 04:50:47 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:06:08.822 04:50:47 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:08.822 + '[' 2 -ne 2 ']' 00:06:08.822 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:08.822 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:08.822 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:08.822 +++ basename /dev/fd/62 00:06:08.822 ++ mktemp /tmp/62.XXX 00:06:08.822 + tmp_file_1=/tmp/62.ztx 00:06:08.822 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:08.822 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:08.822 + tmp_file_2=/tmp/spdk_tgt_config.json.hU3 00:06:08.822 + ret=0 00:06:08.822 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:09.082 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:09.082 + diff -u /tmp/62.ztx /tmp/spdk_tgt_config.json.hU3 00:06:09.082 + echo 'INFO: JSON config files are the same' 00:06:09.082 INFO: JSON config files are the same 00:06:09.082 + rm /tmp/62.ztx /tmp/spdk_tgt_config.json.hU3 00:06:09.082 + exit 0 00:06:09.082 04:50:48 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:06:09.082 04:50:48 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:09.082 INFO: changing configuration and checking if this can be detected... 00:06:09.082 04:50:48 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:09.082 04:50:48 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:09.340 04:50:48 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:09.340 04:50:48 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:06:09.340 04:50:48 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:09.340 + '[' 2 -ne 2 ']' 00:06:09.340 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:09.340 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:09.340 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:09.340 +++ basename /dev/fd/62 00:06:09.340 ++ mktemp /tmp/62.XXX 00:06:09.340 + tmp_file_1=/tmp/62.kHR 00:06:09.340 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:09.340 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:09.340 + tmp_file_2=/tmp/spdk_tgt_config.json.f7d 00:06:09.340 + ret=0 00:06:09.340 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:09.909 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:09.909 + diff -u /tmp/62.kHR /tmp/spdk_tgt_config.json.f7d 00:06:09.909 + ret=1 00:06:09.909 + echo '=== Start of file: /tmp/62.kHR ===' 00:06:09.909 + cat /tmp/62.kHR 00:06:09.909 + echo '=== End of file: /tmp/62.kHR ===' 00:06:09.909 + echo '' 00:06:09.909 + echo '=== Start of file: /tmp/spdk_tgt_config.json.f7d ===' 00:06:09.909 + cat /tmp/spdk_tgt_config.json.f7d 00:06:09.909 + echo '=== End of file: /tmp/spdk_tgt_config.json.f7d ===' 00:06:09.909 + echo '' 00:06:09.909 + rm /tmp/62.kHR /tmp/spdk_tgt_config.json.f7d 00:06:09.909 + exit 1 00:06:09.909 04:50:48 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:06:09.909 INFO: configuration change detected. 00:06:09.909 04:50:48 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:06:09.909 04:50:48 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:06:09.909 04:50:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:09.909 04:50:48 -- common/autotest_common.sh@10 -- # set +x 00:06:09.909 04:50:48 -- json_config/json_config.sh@307 -- # local ret=0 00:06:09.909 04:50:48 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:06:09.909 04:50:48 -- json_config/json_config.sh@317 -- # [[ -n 2272145 ]] 00:06:09.909 04:50:48 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:06:09.909 04:50:48 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:06:09.909 04:50:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:09.909 04:50:48 -- common/autotest_common.sh@10 -- # set +x 00:06:09.909 04:50:48 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:06:09.909 04:50:48 -- json_config/json_config.sh@193 -- # uname -s 00:06:09.909 04:50:48 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:06:09.909 04:50:48 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:06:09.909 04:50:48 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:06:09.909 04:50:48 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:06:09.909 04:50:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:09.909 04:50:48 -- common/autotest_common.sh@10 -- # set +x 00:06:09.909 04:50:48 -- json_config/json_config.sh@323 -- # killprocess 2272145 00:06:09.909 04:50:48 -- common/autotest_common.sh@936 -- # '[' -z 2272145 ']' 00:06:09.909 04:50:48 -- common/autotest_common.sh@940 -- # kill -0 2272145 00:06:09.909 04:50:48 -- common/autotest_common.sh@941 -- # uname 00:06:09.909 04:50:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:09.909 04:50:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2272145 00:06:09.909 04:50:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:09.909 04:50:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:09.909 04:50:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2272145' 00:06:09.909 killing process with pid 2272145 00:06:09.910 04:50:48 -- common/autotest_common.sh@955 -- # kill 2272145 00:06:09.910 04:50:48 -- common/autotest_common.sh@960 -- # wait 2272145 00:06:11.816 04:50:50 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:11.816 04:50:50 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:06:11.816 04:50:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:11.816 04:50:50 -- common/autotest_common.sh@10 -- # set +x 00:06:11.816 04:50:50 -- json_config/json_config.sh@328 -- # return 0 00:06:11.816 04:50:50 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:06:11.816 INFO: Success 00:06:11.816 00:06:11.816 real 0m15.840s 00:06:11.816 user 0m17.754s 00:06:11.816 sys 0m1.834s 00:06:11.816 04:50:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:11.816 04:50:50 -- common/autotest_common.sh@10 -- # set +x 00:06:11.816 ************************************ 00:06:11.816 END TEST json_config 00:06:11.816 ************************************ 00:06:11.816 04:50:50 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:11.816 04:50:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:11.816 04:50:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.816 04:50:50 -- common/autotest_common.sh@10 -- # set +x 00:06:11.816 ************************************ 00:06:11.816 START TEST json_config_extra_key 00:06:11.816 ************************************ 00:06:11.816 04:50:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:11.816 04:50:50 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:11.816 04:50:50 -- nvmf/common.sh@7 -- # uname -s 00:06:11.816 04:50:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:11.816 04:50:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:11.816 04:50:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:11.816 04:50:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:11.817 04:50:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:11.817 04:50:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:11.817 04:50:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:11.817 04:50:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:11.817 04:50:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:11.817 04:50:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:11.817 04:50:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:11.817 04:50:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:11.817 04:50:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:11.817 04:50:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:11.817 04:50:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:11.817 04:50:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:11.817 04:50:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:11.817 04:50:50 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:11.817 04:50:50 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:11.817 04:50:50 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:11.817 04:50:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.817 04:50:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.817 04:50:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.817 04:50:50 -- paths/export.sh@5 -- # export PATH 00:06:11.817 04:50:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.817 04:50:50 -- nvmf/common.sh@47 -- # : 0 00:06:11.817 04:50:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:11.817 04:50:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:11.817 04:50:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:11.817 04:50:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:11.817 04:50:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:11.817 04:50:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:11.817 04:50:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:11.817 04:50:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/common.sh 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:06:11.817 INFO: launching applications... 00:06:11.817 04:50:50 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:11.817 04:50:50 -- json_config/common.sh@9 -- # local app=target 00:06:11.817 04:50:50 -- json_config/common.sh@10 -- # shift 00:06:11.817 04:50:50 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:11.817 04:50:50 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:11.817 04:50:50 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:11.817 04:50:50 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:11.817 04:50:50 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:11.817 04:50:50 -- json_config/common.sh@22 -- # app_pid["$app"]=2273035 00:06:11.817 04:50:50 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:11.817 04:50:50 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:11.817 Waiting for target to run... 00:06:11.817 04:50:50 -- json_config/common.sh@25 -- # waitforlisten 2273035 /var/tmp/spdk_tgt.sock 00:06:11.817 04:50:50 -- common/autotest_common.sh@817 -- # '[' -z 2273035 ']' 00:06:11.817 04:50:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:11.817 04:50:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:11.817 04:50:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:11.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:11.817 04:50:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:11.817 04:50:50 -- common/autotest_common.sh@10 -- # set +x 00:06:11.817 [2024-04-23 04:50:50.869880] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:11.817 [2024-04-23 04:50:50.869979] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2273035 ] 00:06:11.817 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.076 [2024-04-23 04:50:51.210669] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:12.336 [2024-04-23 04:50:51.244578] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.336 [2024-04-23 04:50:51.305666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.904 04:50:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:12.904 04:50:51 -- common/autotest_common.sh@850 -- # return 0 00:06:12.904 04:50:51 -- json_config/common.sh@26 -- # echo '' 00:06:12.904 00:06:12.904 04:50:51 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:06:12.904 INFO: shutting down applications... 00:06:12.904 04:50:51 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:06:12.904 04:50:51 -- json_config/common.sh@31 -- # local app=target 00:06:12.904 04:50:51 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:12.904 04:50:51 -- json_config/common.sh@35 -- # [[ -n 2273035 ]] 00:06:12.904 04:50:51 -- json_config/common.sh@38 -- # kill -SIGINT 2273035 00:06:12.904 04:50:51 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:12.904 04:50:51 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:12.904 04:50:51 -- json_config/common.sh@41 -- # kill -0 2273035 00:06:12.904 04:50:51 -- json_config/common.sh@45 -- # sleep 0.5 00:06:13.163 04:50:52 -- json_config/common.sh@40 -- # (( i++ )) 00:06:13.163 04:50:52 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:13.163 04:50:52 -- json_config/common.sh@41 -- # kill -0 2273035 00:06:13.163 04:50:52 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:13.163 04:50:52 -- json_config/common.sh@43 -- # break 00:06:13.163 04:50:52 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:13.163 04:50:52 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:13.163 SPDK target shutdown done 00:06:13.163 04:50:52 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:06:13.163 Success 00:06:13.163 00:06:13.163 real 0m1.559s 00:06:13.163 user 0m1.476s 00:06:13.163 sys 0m0.450s 00:06:13.163 04:50:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:13.163 04:50:52 -- common/autotest_common.sh@10 -- # set +x 00:06:13.163 ************************************ 00:06:13.163 END TEST json_config_extra_key 00:06:13.163 ************************************ 00:06:13.421 04:50:52 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:13.421 04:50:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:13.421 04:50:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.421 04:50:52 -- common/autotest_common.sh@10 -- # set +x 00:06:13.421 ************************************ 00:06:13.421 START TEST alias_rpc 00:06:13.421 ************************************ 00:06:13.422 04:50:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:13.422 * Looking for test storage... 00:06:13.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:13.422 04:50:52 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:13.422 04:50:52 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2273269 00:06:13.422 04:50:52 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:13.422 04:50:52 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2273269 00:06:13.422 04:50:52 -- common/autotest_common.sh@817 -- # '[' -z 2273269 ']' 00:06:13.422 04:50:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.422 04:50:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:13.422 04:50:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.422 04:50:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:13.422 04:50:52 -- common/autotest_common.sh@10 -- # set +x 00:06:13.422 [2024-04-23 04:50:52.548389] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:13.422 [2024-04-23 04:50:52.548479] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2273269 ] 00:06:13.422 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.422 [2024-04-23 04:50:52.582343] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:13.681 [2024-04-23 04:50:52.610046] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.681 [2024-04-23 04:50:52.692009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.940 04:50:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:13.940 04:50:52 -- common/autotest_common.sh@850 -- # return 0 00:06:13.940 04:50:52 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:14.200 04:50:53 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2273269 00:06:14.200 04:50:53 -- common/autotest_common.sh@936 -- # '[' -z 2273269 ']' 00:06:14.200 04:50:53 -- common/autotest_common.sh@940 -- # kill -0 2273269 00:06:14.200 04:50:53 -- common/autotest_common.sh@941 -- # uname 00:06:14.200 04:50:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.200 04:50:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2273269 00:06:14.200 04:50:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.200 04:50:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.200 04:50:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2273269' 00:06:14.200 killing process with pid 2273269 00:06:14.200 04:50:53 -- common/autotest_common.sh@955 -- # kill 2273269 00:06:14.200 04:50:53 -- common/autotest_common.sh@960 -- # wait 2273269 00:06:14.769 00:06:14.769 real 0m1.225s 00:06:14.769 user 0m1.286s 00:06:14.769 sys 0m0.428s 00:06:14.769 04:50:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.769 04:50:53 -- common/autotest_common.sh@10 -- # set +x 00:06:14.769 ************************************ 00:06:14.769 END TEST alias_rpc 00:06:14.769 ************************************ 00:06:14.769 04:50:53 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:06:14.769 04:50:53 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:14.769 04:50:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.769 04:50:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.769 04:50:53 -- common/autotest_common.sh@10 -- # set +x 00:06:14.769 ************************************ 00:06:14.769 START TEST spdkcli_tcp 00:06:14.769 ************************************ 00:06:14.769 04:50:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:14.769 * Looking for test storage... 00:06:14.769 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:14.769 04:50:53 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:14.769 04:50:53 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:14.769 04:50:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:14.769 04:50:53 -- common/autotest_common.sh@10 -- # set +x 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2273463 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:14.769 04:50:53 -- spdkcli/tcp.sh@27 -- # waitforlisten 2273463 00:06:14.769 04:50:53 -- common/autotest_common.sh@817 -- # '[' -z 2273463 ']' 00:06:14.769 04:50:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:14.769 04:50:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:14.769 04:50:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:14.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:14.769 04:50:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:14.769 04:50:53 -- common/autotest_common.sh@10 -- # set +x 00:06:14.769 [2024-04-23 04:50:53.900940] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:14.769 [2024-04-23 04:50:53.901023] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2273463 ] 00:06:14.769 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.769 [2024-04-23 04:50:53.932349] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:15.028 [2024-04-23 04:50:53.959129] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:15.028 [2024-04-23 04:50:54.041589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.028 [2024-04-23 04:50:54.041593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.293 04:50:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:15.294 04:50:54 -- common/autotest_common.sh@850 -- # return 0 00:06:15.294 04:50:54 -- spdkcli/tcp.sh@31 -- # socat_pid=2273584 00:06:15.294 04:50:54 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:15.294 04:50:54 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:15.556 [ 00:06:15.556 "bdev_malloc_delete", 00:06:15.556 "bdev_malloc_create", 00:06:15.556 "bdev_null_resize", 00:06:15.556 "bdev_null_delete", 00:06:15.556 "bdev_null_create", 00:06:15.556 "bdev_nvme_cuse_unregister", 00:06:15.556 "bdev_nvme_cuse_register", 00:06:15.556 "bdev_opal_new_user", 00:06:15.556 "bdev_opal_set_lock_state", 00:06:15.556 "bdev_opal_delete", 00:06:15.556 "bdev_opal_get_info", 00:06:15.556 "bdev_opal_create", 00:06:15.556 "bdev_nvme_opal_revert", 00:06:15.556 "bdev_nvme_opal_init", 00:06:15.556 "bdev_nvme_send_cmd", 00:06:15.556 "bdev_nvme_get_path_iostat", 00:06:15.556 "bdev_nvme_get_mdns_discovery_info", 00:06:15.556 "bdev_nvme_stop_mdns_discovery", 00:06:15.556 "bdev_nvme_start_mdns_discovery", 00:06:15.556 "bdev_nvme_set_multipath_policy", 00:06:15.556 "bdev_nvme_set_preferred_path", 00:06:15.556 "bdev_nvme_get_io_paths", 00:06:15.556 "bdev_nvme_remove_error_injection", 00:06:15.556 "bdev_nvme_add_error_injection", 00:06:15.556 "bdev_nvme_get_discovery_info", 00:06:15.556 "bdev_nvme_stop_discovery", 00:06:15.556 "bdev_nvme_start_discovery", 00:06:15.556 "bdev_nvme_get_controller_health_info", 00:06:15.556 "bdev_nvme_disable_controller", 00:06:15.556 "bdev_nvme_enable_controller", 00:06:15.556 "bdev_nvme_reset_controller", 00:06:15.556 "bdev_nvme_get_transport_statistics", 00:06:15.556 "bdev_nvme_apply_firmware", 00:06:15.556 "bdev_nvme_detach_controller", 00:06:15.556 "bdev_nvme_get_controllers", 00:06:15.556 "bdev_nvme_attach_controller", 00:06:15.556 "bdev_nvme_set_hotplug", 00:06:15.556 "bdev_nvme_set_options", 00:06:15.556 "bdev_passthru_delete", 00:06:15.556 "bdev_passthru_create", 00:06:15.556 "bdev_lvol_grow_lvstore", 00:06:15.556 "bdev_lvol_get_lvols", 00:06:15.556 "bdev_lvol_get_lvstores", 00:06:15.556 "bdev_lvol_delete", 00:06:15.556 "bdev_lvol_set_read_only", 00:06:15.556 "bdev_lvol_resize", 00:06:15.556 "bdev_lvol_decouple_parent", 00:06:15.557 "bdev_lvol_inflate", 00:06:15.557 "bdev_lvol_rename", 00:06:15.557 "bdev_lvol_clone_bdev", 00:06:15.557 "bdev_lvol_clone", 00:06:15.557 "bdev_lvol_snapshot", 00:06:15.557 "bdev_lvol_create", 00:06:15.557 "bdev_lvol_delete_lvstore", 00:06:15.557 "bdev_lvol_rename_lvstore", 00:06:15.557 "bdev_lvol_create_lvstore", 00:06:15.557 "bdev_raid_set_options", 00:06:15.557 "bdev_raid_remove_base_bdev", 00:06:15.557 "bdev_raid_add_base_bdev", 00:06:15.557 "bdev_raid_delete", 00:06:15.557 "bdev_raid_create", 00:06:15.557 "bdev_raid_get_bdevs", 00:06:15.557 "bdev_error_inject_error", 00:06:15.557 "bdev_error_delete", 00:06:15.557 "bdev_error_create", 00:06:15.557 "bdev_split_delete", 00:06:15.557 "bdev_split_create", 00:06:15.557 "bdev_delay_delete", 00:06:15.557 "bdev_delay_create", 00:06:15.557 "bdev_delay_update_latency", 00:06:15.557 "bdev_zone_block_delete", 00:06:15.557 "bdev_zone_block_create", 00:06:15.557 "blobfs_create", 00:06:15.557 "blobfs_detect", 00:06:15.557 "blobfs_set_cache_size", 00:06:15.557 "bdev_aio_delete", 00:06:15.557 "bdev_aio_rescan", 00:06:15.557 "bdev_aio_create", 00:06:15.557 "bdev_ftl_set_property", 00:06:15.557 "bdev_ftl_get_properties", 00:06:15.557 "bdev_ftl_get_stats", 00:06:15.557 "bdev_ftl_unmap", 00:06:15.557 "bdev_ftl_unload", 00:06:15.557 "bdev_ftl_delete", 00:06:15.557 "bdev_ftl_load", 00:06:15.557 "bdev_ftl_create", 00:06:15.557 "bdev_virtio_attach_controller", 00:06:15.557 "bdev_virtio_scsi_get_devices", 00:06:15.557 "bdev_virtio_detach_controller", 00:06:15.557 "bdev_virtio_blk_set_hotplug", 00:06:15.557 "bdev_iscsi_delete", 00:06:15.557 "bdev_iscsi_create", 00:06:15.557 "bdev_iscsi_set_options", 00:06:15.557 "accel_error_inject_error", 00:06:15.557 "ioat_scan_accel_module", 00:06:15.557 "dsa_scan_accel_module", 00:06:15.557 "iaa_scan_accel_module", 00:06:15.557 "vfu_virtio_create_scsi_endpoint", 00:06:15.557 "vfu_virtio_scsi_remove_target", 00:06:15.557 "vfu_virtio_scsi_add_target", 00:06:15.557 "vfu_virtio_create_blk_endpoint", 00:06:15.557 "vfu_virtio_delete_endpoint", 00:06:15.557 "keyring_file_remove_key", 00:06:15.557 "keyring_file_add_key", 00:06:15.557 "iscsi_get_histogram", 00:06:15.557 "iscsi_enable_histogram", 00:06:15.557 "iscsi_set_options", 00:06:15.557 "iscsi_get_auth_groups", 00:06:15.557 "iscsi_auth_group_remove_secret", 00:06:15.557 "iscsi_auth_group_add_secret", 00:06:15.557 "iscsi_delete_auth_group", 00:06:15.557 "iscsi_create_auth_group", 00:06:15.557 "iscsi_set_discovery_auth", 00:06:15.557 "iscsi_get_options", 00:06:15.557 "iscsi_target_node_request_logout", 00:06:15.557 "iscsi_target_node_set_redirect", 00:06:15.557 "iscsi_target_node_set_auth", 00:06:15.557 "iscsi_target_node_add_lun", 00:06:15.557 "iscsi_get_stats", 00:06:15.557 "iscsi_get_connections", 00:06:15.557 "iscsi_portal_group_set_auth", 00:06:15.557 "iscsi_start_portal_group", 00:06:15.557 "iscsi_delete_portal_group", 00:06:15.557 "iscsi_create_portal_group", 00:06:15.557 "iscsi_get_portal_groups", 00:06:15.557 "iscsi_delete_target_node", 00:06:15.557 "iscsi_target_node_remove_pg_ig_maps", 00:06:15.557 "iscsi_target_node_add_pg_ig_maps", 00:06:15.557 "iscsi_create_target_node", 00:06:15.557 "iscsi_get_target_nodes", 00:06:15.557 "iscsi_delete_initiator_group", 00:06:15.557 "iscsi_initiator_group_remove_initiators", 00:06:15.557 "iscsi_initiator_group_add_initiators", 00:06:15.557 "iscsi_create_initiator_group", 00:06:15.557 "iscsi_get_initiator_groups", 00:06:15.557 "nvmf_set_crdt", 00:06:15.557 "nvmf_set_config", 00:06:15.557 "nvmf_set_max_subsystems", 00:06:15.557 "nvmf_subsystem_get_listeners", 00:06:15.557 "nvmf_subsystem_get_qpairs", 00:06:15.557 "nvmf_subsystem_get_controllers", 00:06:15.557 "nvmf_get_stats", 00:06:15.557 "nvmf_get_transports", 00:06:15.557 "nvmf_create_transport", 00:06:15.557 "nvmf_get_targets", 00:06:15.557 "nvmf_delete_target", 00:06:15.557 "nvmf_create_target", 00:06:15.557 "nvmf_subsystem_allow_any_host", 00:06:15.557 "nvmf_subsystem_remove_host", 00:06:15.557 "nvmf_subsystem_add_host", 00:06:15.557 "nvmf_ns_remove_host", 00:06:15.557 "nvmf_ns_add_host", 00:06:15.557 "nvmf_subsystem_remove_ns", 00:06:15.557 "nvmf_subsystem_add_ns", 00:06:15.557 "nvmf_subsystem_listener_set_ana_state", 00:06:15.557 "nvmf_discovery_get_referrals", 00:06:15.557 "nvmf_discovery_remove_referral", 00:06:15.557 "nvmf_discovery_add_referral", 00:06:15.557 "nvmf_subsystem_remove_listener", 00:06:15.557 "nvmf_subsystem_add_listener", 00:06:15.557 "nvmf_delete_subsystem", 00:06:15.557 "nvmf_create_subsystem", 00:06:15.557 "nvmf_get_subsystems", 00:06:15.557 "env_dpdk_get_mem_stats", 00:06:15.557 "nbd_get_disks", 00:06:15.557 "nbd_stop_disk", 00:06:15.557 "nbd_start_disk", 00:06:15.557 "ublk_recover_disk", 00:06:15.557 "ublk_get_disks", 00:06:15.557 "ublk_stop_disk", 00:06:15.557 "ublk_start_disk", 00:06:15.557 "ublk_destroy_target", 00:06:15.557 "ublk_create_target", 00:06:15.557 "virtio_blk_create_transport", 00:06:15.557 "virtio_blk_get_transports", 00:06:15.557 "vhost_controller_set_coalescing", 00:06:15.557 "vhost_get_controllers", 00:06:15.557 "vhost_delete_controller", 00:06:15.557 "vhost_create_blk_controller", 00:06:15.557 "vhost_scsi_controller_remove_target", 00:06:15.557 "vhost_scsi_controller_add_target", 00:06:15.557 "vhost_start_scsi_controller", 00:06:15.557 "vhost_create_scsi_controller", 00:06:15.557 "thread_set_cpumask", 00:06:15.557 "framework_get_scheduler", 00:06:15.557 "framework_set_scheduler", 00:06:15.557 "framework_get_reactors", 00:06:15.557 "thread_get_io_channels", 00:06:15.557 "thread_get_pollers", 00:06:15.557 "thread_get_stats", 00:06:15.557 "framework_monitor_context_switch", 00:06:15.557 "spdk_kill_instance", 00:06:15.557 "log_enable_timestamps", 00:06:15.557 "log_get_flags", 00:06:15.557 "log_clear_flag", 00:06:15.557 "log_set_flag", 00:06:15.557 "log_get_level", 00:06:15.557 "log_set_level", 00:06:15.557 "log_get_print_level", 00:06:15.557 "log_set_print_level", 00:06:15.557 "framework_enable_cpumask_locks", 00:06:15.557 "framework_disable_cpumask_locks", 00:06:15.557 "framework_wait_init", 00:06:15.557 "framework_start_init", 00:06:15.557 "scsi_get_devices", 00:06:15.557 "bdev_get_histogram", 00:06:15.557 "bdev_enable_histogram", 00:06:15.557 "bdev_set_qos_limit", 00:06:15.557 "bdev_set_qd_sampling_period", 00:06:15.557 "bdev_get_bdevs", 00:06:15.557 "bdev_reset_iostat", 00:06:15.557 "bdev_get_iostat", 00:06:15.557 "bdev_examine", 00:06:15.557 "bdev_wait_for_examine", 00:06:15.557 "bdev_set_options", 00:06:15.557 "notify_get_notifications", 00:06:15.557 "notify_get_types", 00:06:15.557 "accel_get_stats", 00:06:15.557 "accel_set_options", 00:06:15.557 "accel_set_driver", 00:06:15.557 "accel_crypto_key_destroy", 00:06:15.557 "accel_crypto_keys_get", 00:06:15.557 "accel_crypto_key_create", 00:06:15.557 "accel_assign_opc", 00:06:15.557 "accel_get_module_info", 00:06:15.557 "accel_get_opc_assignments", 00:06:15.557 "vmd_rescan", 00:06:15.557 "vmd_remove_device", 00:06:15.557 "vmd_enable", 00:06:15.557 "sock_set_default_impl", 00:06:15.557 "sock_impl_set_options", 00:06:15.557 "sock_impl_get_options", 00:06:15.557 "iobuf_get_stats", 00:06:15.557 "iobuf_set_options", 00:06:15.557 "keyring_get_keys", 00:06:15.557 "framework_get_pci_devices", 00:06:15.557 "framework_get_config", 00:06:15.557 "framework_get_subsystems", 00:06:15.557 "vfu_tgt_set_base_path", 00:06:15.557 "trace_get_info", 00:06:15.557 "trace_get_tpoint_group_mask", 00:06:15.557 "trace_disable_tpoint_group", 00:06:15.557 "trace_enable_tpoint_group", 00:06:15.557 "trace_clear_tpoint_mask", 00:06:15.557 "trace_set_tpoint_mask", 00:06:15.557 "spdk_get_version", 00:06:15.557 "rpc_get_methods" 00:06:15.557 ] 00:06:15.557 04:50:54 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:15.557 04:50:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:15.557 04:50:54 -- common/autotest_common.sh@10 -- # set +x 00:06:15.557 04:50:54 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:15.557 04:50:54 -- spdkcli/tcp.sh@38 -- # killprocess 2273463 00:06:15.557 04:50:54 -- common/autotest_common.sh@936 -- # '[' -z 2273463 ']' 00:06:15.557 04:50:54 -- common/autotest_common.sh@940 -- # kill -0 2273463 00:06:15.557 04:50:54 -- common/autotest_common.sh@941 -- # uname 00:06:15.557 04:50:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:15.557 04:50:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2273463 00:06:15.557 04:50:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:15.557 04:50:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:15.557 04:50:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2273463' 00:06:15.557 killing process with pid 2273463 00:06:15.557 04:50:54 -- common/autotest_common.sh@955 -- # kill 2273463 00:06:15.557 04:50:54 -- common/autotest_common.sh@960 -- # wait 2273463 00:06:16.126 00:06:16.126 real 0m1.199s 00:06:16.126 user 0m2.132s 00:06:16.126 sys 0m0.435s 00:06:16.126 04:50:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:16.126 04:50:54 -- common/autotest_common.sh@10 -- # set +x 00:06:16.126 ************************************ 00:06:16.126 END TEST spdkcli_tcp 00:06:16.126 ************************************ 00:06:16.126 04:50:55 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:16.126 04:50:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:16.126 04:50:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.126 04:50:55 -- common/autotest_common.sh@10 -- # set +x 00:06:16.126 ************************************ 00:06:16.126 START TEST dpdk_mem_utility 00:06:16.126 ************************************ 00:06:16.126 04:50:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:16.126 * Looking for test storage... 00:06:16.126 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:16.126 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:16.126 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2273670 00:06:16.126 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:16.126 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2273670 00:06:16.126 04:50:55 -- common/autotest_common.sh@817 -- # '[' -z 2273670 ']' 00:06:16.126 04:50:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:16.126 04:50:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:16.126 04:50:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:16.126 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:16.126 04:50:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:16.126 04:50:55 -- common/autotest_common.sh@10 -- # set +x 00:06:16.126 [2024-04-23 04:50:55.210168] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:16.126 [2024-04-23 04:50:55.210257] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2273670 ] 00:06:16.126 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.126 [2024-04-23 04:50:55.244361] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:16.126 [2024-04-23 04:50:55.276934] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.385 [2024-04-23 04:50:55.369698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.644 04:50:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:16.644 04:50:55 -- common/autotest_common.sh@850 -- # return 0 00:06:16.644 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:16.644 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:16.645 04:50:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:16.645 04:50:55 -- common/autotest_common.sh@10 -- # set +x 00:06:16.645 { 00:06:16.645 "filename": "/tmp/spdk_mem_dump.txt" 00:06:16.645 } 00:06:16.645 04:50:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:16.645 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:16.645 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:16.645 1 heaps totaling size 814.000000 MiB 00:06:16.645 size: 814.000000 MiB heap id: 0 00:06:16.645 end heaps---------- 00:06:16.645 8 mempools totaling size 598.116089 MiB 00:06:16.645 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:16.645 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:16.645 size: 84.521057 MiB name: bdev_io_2273670 00:06:16.645 size: 51.011292 MiB name: evtpool_2273670 00:06:16.645 size: 50.003479 MiB name: msgpool_2273670 00:06:16.645 size: 21.763794 MiB name: PDU_Pool 00:06:16.645 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:16.645 size: 0.026123 MiB name: Session_Pool 00:06:16.645 end mempools------- 00:06:16.645 6 memzones totaling size 4.142822 MiB 00:06:16.645 size: 1.000366 MiB name: RG_ring_0_2273670 00:06:16.645 size: 1.000366 MiB name: RG_ring_1_2273670 00:06:16.645 size: 1.000366 MiB name: RG_ring_4_2273670 00:06:16.645 size: 1.000366 MiB name: RG_ring_5_2273670 00:06:16.645 size: 0.125366 MiB name: RG_ring_2_2273670 00:06:16.645 size: 0.015991 MiB name: RG_ring_3_2273670 00:06:16.645 end memzones------- 00:06:16.645 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:16.645 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:16.645 list of free elements. size: 12.519348 MiB 00:06:16.645 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:16.645 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:16.645 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:16.645 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:16.645 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:16.645 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:16.645 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:16.645 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:16.645 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:16.645 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:16.645 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:16.645 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:16.645 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:16.645 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:16.645 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:16.645 list of standard malloc elements. size: 199.218079 MiB 00:06:16.645 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:16.645 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:16.645 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:16.645 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:16.645 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:16.645 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:16.645 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:16.645 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:16.645 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:16.645 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:16.645 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:16.645 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:16.645 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:16.645 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:16.645 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:16.645 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:16.645 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:16.645 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:16.645 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:16.645 list of memzone associated elements. size: 602.262573 MiB 00:06:16.645 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:16.645 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:16.645 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:16.645 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:16.645 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:16.645 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2273670_0 00:06:16.645 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:16.645 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2273670_0 00:06:16.645 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:16.645 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2273670_0 00:06:16.645 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:16.645 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:16.645 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:16.645 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:16.645 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:16.645 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2273670 00:06:16.645 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:16.645 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2273670 00:06:16.645 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:16.645 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2273670 00:06:16.645 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:16.645 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:16.645 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:16.645 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:16.645 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:16.645 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:16.645 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:16.645 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:16.645 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:16.645 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2273670 00:06:16.645 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:16.645 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2273670 00:06:16.645 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:16.645 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2273670 00:06:16.645 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:16.645 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2273670 00:06:16.645 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:16.645 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2273670 00:06:16.645 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:16.645 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:16.645 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:16.645 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:16.645 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:16.645 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:16.645 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:16.645 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2273670 00:06:16.645 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:16.645 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:16.645 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:16.645 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:16.646 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:16.646 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2273670 00:06:16.646 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:16.646 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:16.646 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:16.646 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2273670 00:06:16.646 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:16.646 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2273670 00:06:16.646 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:16.646 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:16.646 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:16.646 04:50:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2273670 00:06:16.646 04:50:55 -- common/autotest_common.sh@936 -- # '[' -z 2273670 ']' 00:06:16.646 04:50:55 -- common/autotest_common.sh@940 -- # kill -0 2273670 00:06:16.646 04:50:55 -- common/autotest_common.sh@941 -- # uname 00:06:16.646 04:50:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:16.646 04:50:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2273670 00:06:16.646 04:50:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:16.646 04:50:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:16.646 04:50:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2273670' 00:06:16.646 killing process with pid 2273670 00:06:16.646 04:50:55 -- common/autotest_common.sh@955 -- # kill 2273670 00:06:16.646 04:50:55 -- common/autotest_common.sh@960 -- # wait 2273670 00:06:17.214 00:06:17.214 real 0m1.082s 00:06:17.214 user 0m1.035s 00:06:17.214 sys 0m0.402s 00:06:17.214 04:50:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:17.214 04:50:56 -- common/autotest_common.sh@10 -- # set +x 00:06:17.214 ************************************ 00:06:17.214 END TEST dpdk_mem_utility 00:06:17.214 ************************************ 00:06:17.214 04:50:56 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:17.214 04:50:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:17.214 04:50:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.214 04:50:56 -- common/autotest_common.sh@10 -- # set +x 00:06:17.214 ************************************ 00:06:17.214 START TEST event 00:06:17.214 ************************************ 00:06:17.214 04:50:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:17.214 * Looking for test storage... 00:06:17.214 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:17.214 04:50:56 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:17.214 04:50:56 -- bdev/nbd_common.sh@6 -- # set -e 00:06:17.214 04:50:56 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:17.214 04:50:56 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:17.214 04:50:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.214 04:50:56 -- common/autotest_common.sh@10 -- # set +x 00:06:17.472 ************************************ 00:06:17.472 START TEST event_perf 00:06:17.472 ************************************ 00:06:17.472 04:50:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:17.472 Running I/O for 1 seconds...[2024-04-23 04:50:56.463111] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:17.472 [2024-04-23 04:50:56.463175] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2273982 ] 00:06:17.472 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.472 [2024-04-23 04:50:56.495947] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:17.472 [2024-04-23 04:50:56.526121] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:17.472 [2024-04-23 04:50:56.617406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:17.472 [2024-04-23 04:50:56.617462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:17.472 [2024-04-23 04:50:56.617581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:17.472 [2024-04-23 04:50:56.617584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.848 Running I/O for 1 seconds... 00:06:18.848 lcore 0: 240133 00:06:18.848 lcore 1: 240134 00:06:18.848 lcore 2: 240133 00:06:18.848 lcore 3: 240133 00:06:18.848 done. 00:06:18.848 00:06:18.848 real 0m1.250s 00:06:18.848 user 0m4.162s 00:06:18.848 sys 0m0.084s 00:06:18.848 04:50:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:18.848 04:50:57 -- common/autotest_common.sh@10 -- # set +x 00:06:18.848 ************************************ 00:06:18.848 END TEST event_perf 00:06:18.848 ************************************ 00:06:18.848 04:50:57 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:18.848 04:50:57 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:18.848 04:50:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.848 04:50:57 -- common/autotest_common.sh@10 -- # set +x 00:06:18.848 ************************************ 00:06:18.848 START TEST event_reactor 00:06:18.848 ************************************ 00:06:18.848 04:50:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:18.848 [2024-04-23 04:50:57.827234] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:18.848 [2024-04-23 04:50:57.827297] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2274162 ] 00:06:18.848 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.848 [2024-04-23 04:50:57.862822] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:18.848 [2024-04-23 04:50:57.892636] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.848 [2024-04-23 04:50:57.983247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.228 test_start 00:06:20.228 oneshot 00:06:20.228 tick 100 00:06:20.228 tick 100 00:06:20.228 tick 250 00:06:20.228 tick 100 00:06:20.228 tick 100 00:06:20.228 tick 100 00:06:20.228 tick 250 00:06:20.228 tick 500 00:06:20.228 tick 100 00:06:20.228 tick 100 00:06:20.228 tick 250 00:06:20.228 tick 100 00:06:20.228 tick 100 00:06:20.228 test_end 00:06:20.228 00:06:20.228 real 0m1.249s 00:06:20.228 user 0m1.149s 00:06:20.228 sys 0m0.095s 00:06:20.228 04:50:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:20.228 04:50:59 -- common/autotest_common.sh@10 -- # set +x 00:06:20.228 ************************************ 00:06:20.228 END TEST event_reactor 00:06:20.228 ************************************ 00:06:20.228 04:50:59 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:20.228 04:50:59 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:20.228 04:50:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.228 04:50:59 -- common/autotest_common.sh@10 -- # set +x 00:06:20.228 ************************************ 00:06:20.228 START TEST event_reactor_perf 00:06:20.228 ************************************ 00:06:20.228 04:50:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:20.228 [2024-04-23 04:50:59.193838] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:20.228 [2024-04-23 04:50:59.193904] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2274328 ] 00:06:20.228 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.228 [2024-04-23 04:50:59.229082] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:20.228 [2024-04-23 04:50:59.258611] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.228 [2024-04-23 04:50:59.349266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.607 test_start 00:06:21.607 test_end 00:06:21.607 Performance: 353860 events per second 00:06:21.607 00:06:21.607 real 0m1.248s 00:06:21.607 user 0m1.151s 00:06:21.607 sys 0m0.091s 00:06:21.607 04:51:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:21.607 04:51:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.607 ************************************ 00:06:21.607 END TEST event_reactor_perf 00:06:21.607 ************************************ 00:06:21.607 04:51:00 -- event/event.sh@49 -- # uname -s 00:06:21.607 04:51:00 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:21.607 04:51:00 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:21.607 04:51:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.607 04:51:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.607 04:51:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.607 ************************************ 00:06:21.607 START TEST event_scheduler 00:06:21.607 ************************************ 00:06:21.607 04:51:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:21.607 * Looking for test storage... 00:06:21.607 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:21.607 04:51:00 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:21.607 04:51:00 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2274563 00:06:21.607 04:51:00 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:21.607 04:51:00 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:21.607 04:51:00 -- scheduler/scheduler.sh@37 -- # waitforlisten 2274563 00:06:21.607 04:51:00 -- common/autotest_common.sh@817 -- # '[' -z 2274563 ']' 00:06:21.607 04:51:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.607 04:51:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:21.607 04:51:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.607 04:51:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:21.607 04:51:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.607 [2024-04-23 04:51:00.644072] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:21.607 [2024-04-23 04:51:00.644168] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2274563 ] 00:06:21.607 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.607 [2024-04-23 04:51:00.677951] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:21.607 [2024-04-23 04:51:00.707736] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:21.866 [2024-04-23 04:51:00.794991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.866 [2024-04-23 04:51:00.795074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:21.866 [2024-04-23 04:51:00.795077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.866 [2024-04-23 04:51:00.795019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.866 04:51:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:21.866 04:51:00 -- common/autotest_common.sh@850 -- # return 0 00:06:21.866 04:51:00 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:21.866 04:51:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:21.866 04:51:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.866 POWER: Env isn't set yet! 00:06:21.866 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:21.866 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:21.866 POWER: Cannot get available frequencies of lcore 0 00:06:21.867 POWER: Attempting to initialise PSTAT power management... 00:06:21.867 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:21.867 POWER: Initialized successfully for lcore 0 power management 00:06:21.867 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:21.867 POWER: Initialized successfully for lcore 1 power management 00:06:21.867 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:21.867 POWER: Initialized successfully for lcore 2 power management 00:06:21.867 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:21.867 POWER: Initialized successfully for lcore 3 power management 00:06:21.867 04:51:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:21.867 04:51:00 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:21.867 04:51:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:21.867 04:51:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.867 [2024-04-23 04:51:01.000369] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:21.867 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:21.867 04:51:01 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:21.867 04:51:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.867 04:51:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.867 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 ************************************ 00:06:22.126 START TEST scheduler_create_thread 00:06:22.126 ************************************ 00:06:22.126 04:51:01 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 2 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 3 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 4 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 5 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 6 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 7 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 8 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 9 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 10 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.126 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:22.126 04:51:01 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:22.126 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.126 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.693 04:51:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.693 04:51:01 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:22.693 04:51:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.693 04:51:01 -- common/autotest_common.sh@10 -- # set +x 00:06:24.073 04:51:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:24.073 04:51:03 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:24.073 04:51:03 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:24.073 04:51:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:24.073 04:51:03 -- common/autotest_common.sh@10 -- # set +x 00:06:25.450 04:51:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:25.450 00:06:25.450 real 0m3.101s 00:06:25.450 user 0m0.013s 00:06:25.450 sys 0m0.001s 00:06:25.450 04:51:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.450 04:51:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.450 ************************************ 00:06:25.450 END TEST scheduler_create_thread 00:06:25.450 ************************************ 00:06:25.450 04:51:04 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:25.450 04:51:04 -- scheduler/scheduler.sh@46 -- # killprocess 2274563 00:06:25.450 04:51:04 -- common/autotest_common.sh@936 -- # '[' -z 2274563 ']' 00:06:25.450 04:51:04 -- common/autotest_common.sh@940 -- # kill -0 2274563 00:06:25.450 04:51:04 -- common/autotest_common.sh@941 -- # uname 00:06:25.450 04:51:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.450 04:51:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2274563 00:06:25.450 04:51:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:25.450 04:51:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:25.450 04:51:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2274563' 00:06:25.450 killing process with pid 2274563 00:06:25.450 04:51:04 -- common/autotest_common.sh@955 -- # kill 2274563 00:06:25.450 04:51:04 -- common/autotest_common.sh@960 -- # wait 2274563 00:06:25.450 [2024-04-23 04:51:04.581074] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:25.709 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:25.709 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:25.709 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:25.709 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:25.709 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:25.709 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:25.709 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:25.709 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:25.709 00:06:25.709 real 0m4.268s 00:06:25.709 user 0m6.997s 00:06:25.709 sys 0m0.377s 00:06:25.709 04:51:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.709 04:51:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.709 ************************************ 00:06:25.709 END TEST event_scheduler 00:06:25.709 ************************************ 00:06:25.709 04:51:04 -- event/event.sh@51 -- # modprobe -n nbd 00:06:25.709 04:51:04 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:25.709 04:51:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.709 04:51:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.709 04:51:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.968 ************************************ 00:06:25.968 START TEST app_repeat 00:06:25.968 ************************************ 00:06:25.968 04:51:04 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:06:25.968 04:51:04 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:25.968 04:51:04 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:25.968 04:51:04 -- event/event.sh@13 -- # local nbd_list 00:06:25.968 04:51:04 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:25.968 04:51:04 -- event/event.sh@14 -- # local bdev_list 00:06:25.968 04:51:04 -- event/event.sh@15 -- # local repeat_times=4 00:06:25.969 04:51:04 -- event/event.sh@17 -- # modprobe nbd 00:06:25.969 04:51:04 -- event/event.sh@19 -- # repeat_pid=2275225 00:06:25.969 04:51:04 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:25.969 04:51:04 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:25.969 04:51:04 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2275225' 00:06:25.969 Process app_repeat pid: 2275225 00:06:25.969 04:51:04 -- event/event.sh@23 -- # for i in {0..2} 00:06:25.969 04:51:04 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:25.969 spdk_app_start Round 0 00:06:25.969 04:51:04 -- event/event.sh@25 -- # waitforlisten 2275225 /var/tmp/spdk-nbd.sock 00:06:25.969 04:51:04 -- common/autotest_common.sh@817 -- # '[' -z 2275225 ']' 00:06:25.969 04:51:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.969 04:51:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:25.969 04:51:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.969 04:51:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:25.969 04:51:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.969 [2024-04-23 04:51:04.958392] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:25.969 [2024-04-23 04:51:04.958463] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2275225 ] 00:06:25.969 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.969 [2024-04-23 04:51:04.990138] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:25.969 [2024-04-23 04:51:05.020240] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:25.969 [2024-04-23 04:51:05.118544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:25.969 [2024-04-23 04:51:05.118556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.227 04:51:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:26.227 04:51:05 -- common/autotest_common.sh@850 -- # return 0 00:06:26.227 04:51:05 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:26.484 Malloc0 00:06:26.485 04:51:05 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:26.742 Malloc1 00:06:26.742 04:51:05 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@12 -- # local i 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.742 04:51:05 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:27.002 /dev/nbd0 00:06:27.002 04:51:06 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:27.002 04:51:06 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:27.002 04:51:06 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:27.003 04:51:06 -- common/autotest_common.sh@855 -- # local i 00:06:27.003 04:51:06 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:27.003 04:51:06 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:27.003 04:51:06 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:27.003 04:51:06 -- common/autotest_common.sh@859 -- # break 00:06:27.003 04:51:06 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:27.003 04:51:06 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:27.003 04:51:06 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:27.003 1+0 records in 00:06:27.003 1+0 records out 00:06:27.003 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000160455 s, 25.5 MB/s 00:06:27.003 04:51:06 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.003 04:51:06 -- common/autotest_common.sh@872 -- # size=4096 00:06:27.003 04:51:06 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.003 04:51:06 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:27.003 04:51:06 -- common/autotest_common.sh@875 -- # return 0 00:06:27.003 04:51:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:27.003 04:51:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:27.003 04:51:06 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:27.307 /dev/nbd1 00:06:27.307 04:51:06 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:27.307 04:51:06 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:27.307 04:51:06 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:27.307 04:51:06 -- common/autotest_common.sh@855 -- # local i 00:06:27.307 04:51:06 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:27.307 04:51:06 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:27.307 04:51:06 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:27.307 04:51:06 -- common/autotest_common.sh@859 -- # break 00:06:27.307 04:51:06 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:27.307 04:51:06 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:27.307 04:51:06 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:27.307 1+0 records in 00:06:27.307 1+0 records out 00:06:27.307 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000207527 s, 19.7 MB/s 00:06:27.307 04:51:06 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.307 04:51:06 -- common/autotest_common.sh@872 -- # size=4096 00:06:27.308 04:51:06 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.308 04:51:06 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:27.308 04:51:06 -- common/autotest_common.sh@875 -- # return 0 00:06:27.308 04:51:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:27.308 04:51:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:27.308 04:51:06 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:27.308 04:51:06 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.308 04:51:06 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:27.565 { 00:06:27.565 "nbd_device": "/dev/nbd0", 00:06:27.565 "bdev_name": "Malloc0" 00:06:27.565 }, 00:06:27.565 { 00:06:27.565 "nbd_device": "/dev/nbd1", 00:06:27.565 "bdev_name": "Malloc1" 00:06:27.565 } 00:06:27.565 ]' 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:27.565 { 00:06:27.565 "nbd_device": "/dev/nbd0", 00:06:27.565 "bdev_name": "Malloc0" 00:06:27.565 }, 00:06:27.565 { 00:06:27.565 "nbd_device": "/dev/nbd1", 00:06:27.565 "bdev_name": "Malloc1" 00:06:27.565 } 00:06:27.565 ]' 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:27.565 /dev/nbd1' 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:27.565 /dev/nbd1' 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@65 -- # count=2 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@95 -- # count=2 00:06:27.565 04:51:06 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:27.566 256+0 records in 00:06:27.566 256+0 records out 00:06:27.566 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00520151 s, 202 MB/s 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:27.566 256+0 records in 00:06:27.566 256+0 records out 00:06:27.566 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213105 s, 49.2 MB/s 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:27.566 256+0 records in 00:06:27.566 256+0 records out 00:06:27.566 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232078 s, 45.2 MB/s 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@51 -- # local i 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.566 04:51:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@41 -- # break 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@45 -- # return 0 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.824 04:51:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@41 -- # break 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@45 -- # return 0 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:28.081 04:51:07 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@65 -- # true 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@65 -- # count=0 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@104 -- # count=0 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:28.339 04:51:07 -- bdev/nbd_common.sh@109 -- # return 0 00:06:28.339 04:51:07 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:28.596 04:51:07 -- event/event.sh@35 -- # sleep 3 00:06:28.856 [2024-04-23 04:51:07.948512] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:29.116 [2024-04-23 04:51:08.036164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:29.116 [2024-04-23 04:51:08.036168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.116 [2024-04-23 04:51:08.090747] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:29.116 [2024-04-23 04:51:08.090829] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:31.649 04:51:10 -- event/event.sh@23 -- # for i in {0..2} 00:06:31.649 04:51:10 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:31.649 spdk_app_start Round 1 00:06:31.649 04:51:10 -- event/event.sh@25 -- # waitforlisten 2275225 /var/tmp/spdk-nbd.sock 00:06:31.649 04:51:10 -- common/autotest_common.sh@817 -- # '[' -z 2275225 ']' 00:06:31.649 04:51:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:31.649 04:51:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:31.649 04:51:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:31.649 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:31.649 04:51:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:31.649 04:51:10 -- common/autotest_common.sh@10 -- # set +x 00:06:31.907 04:51:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:31.907 04:51:10 -- common/autotest_common.sh@850 -- # return 0 00:06:31.907 04:51:10 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:32.165 Malloc0 00:06:32.165 04:51:11 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:32.423 Malloc1 00:06:32.423 04:51:11 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@12 -- # local i 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.423 04:51:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:32.681 /dev/nbd0 00:06:32.681 04:51:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:32.681 04:51:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:32.681 04:51:11 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:32.681 04:51:11 -- common/autotest_common.sh@855 -- # local i 00:06:32.681 04:51:11 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:32.681 04:51:11 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:32.681 04:51:11 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:32.681 04:51:11 -- common/autotest_common.sh@859 -- # break 00:06:32.681 04:51:11 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:32.681 04:51:11 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:32.681 04:51:11 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:32.681 1+0 records in 00:06:32.681 1+0 records out 00:06:32.681 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000152414 s, 26.9 MB/s 00:06:32.681 04:51:11 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.681 04:51:11 -- common/autotest_common.sh@872 -- # size=4096 00:06:32.681 04:51:11 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.681 04:51:11 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:32.681 04:51:11 -- common/autotest_common.sh@875 -- # return 0 00:06:32.681 04:51:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:32.681 04:51:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.681 04:51:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:32.939 /dev/nbd1 00:06:32.939 04:51:12 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:32.939 04:51:12 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:32.939 04:51:12 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:32.939 04:51:12 -- common/autotest_common.sh@855 -- # local i 00:06:32.939 04:51:12 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:32.939 04:51:12 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:32.939 04:51:12 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:32.939 04:51:12 -- common/autotest_common.sh@859 -- # break 00:06:32.939 04:51:12 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:32.939 04:51:12 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:32.939 04:51:12 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:32.939 1+0 records in 00:06:32.939 1+0 records out 00:06:32.939 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000185285 s, 22.1 MB/s 00:06:32.939 04:51:12 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.939 04:51:12 -- common/autotest_common.sh@872 -- # size=4096 00:06:32.939 04:51:12 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.939 04:51:12 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:32.939 04:51:12 -- common/autotest_common.sh@875 -- # return 0 00:06:32.939 04:51:12 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:32.939 04:51:12 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.939 04:51:12 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:32.939 04:51:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.939 04:51:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:33.197 { 00:06:33.197 "nbd_device": "/dev/nbd0", 00:06:33.197 "bdev_name": "Malloc0" 00:06:33.197 }, 00:06:33.197 { 00:06:33.197 "nbd_device": "/dev/nbd1", 00:06:33.197 "bdev_name": "Malloc1" 00:06:33.197 } 00:06:33.197 ]' 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:33.197 { 00:06:33.197 "nbd_device": "/dev/nbd0", 00:06:33.197 "bdev_name": "Malloc0" 00:06:33.197 }, 00:06:33.197 { 00:06:33.197 "nbd_device": "/dev/nbd1", 00:06:33.197 "bdev_name": "Malloc1" 00:06:33.197 } 00:06:33.197 ]' 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:33.197 /dev/nbd1' 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:33.197 /dev/nbd1' 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@65 -- # count=2 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@95 -- # count=2 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:33.197 256+0 records in 00:06:33.197 256+0 records out 00:06:33.197 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0049074 s, 214 MB/s 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:33.197 256+0 records in 00:06:33.197 256+0 records out 00:06:33.197 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235444 s, 44.5 MB/s 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:33.197 04:51:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:33.456 256+0 records in 00:06:33.456 256+0 records out 00:06:33.456 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256485 s, 40.9 MB/s 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@51 -- # local i 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:33.456 04:51:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@41 -- # break 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@45 -- # return 0 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:33.715 04:51:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@41 -- # break 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@45 -- # return 0 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:33.974 04:51:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:33.974 04:51:13 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:33.974 04:51:13 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:33.974 04:51:13 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@65 -- # true 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@65 -- # count=0 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@104 -- # count=0 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:34.233 04:51:13 -- bdev/nbd_common.sh@109 -- # return 0 00:06:34.233 04:51:13 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:34.491 04:51:13 -- event/event.sh@35 -- # sleep 3 00:06:34.751 [2024-04-23 04:51:13.688600] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:34.751 [2024-04-23 04:51:13.773601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:34.751 [2024-04-23 04:51:13.773608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.751 [2024-04-23 04:51:13.835785] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:34.751 [2024-04-23 04:51:13.835884] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:38.042 04:51:16 -- event/event.sh@23 -- # for i in {0..2} 00:06:38.042 04:51:16 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:38.042 spdk_app_start Round 2 00:06:38.042 04:51:16 -- event/event.sh@25 -- # waitforlisten 2275225 /var/tmp/spdk-nbd.sock 00:06:38.042 04:51:16 -- common/autotest_common.sh@817 -- # '[' -z 2275225 ']' 00:06:38.042 04:51:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:38.042 04:51:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:38.042 04:51:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:38.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:38.042 04:51:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:38.042 04:51:16 -- common/autotest_common.sh@10 -- # set +x 00:06:38.042 04:51:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:38.042 04:51:16 -- common/autotest_common.sh@850 -- # return 0 00:06:38.042 04:51:16 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:38.042 Malloc0 00:06:38.043 04:51:16 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:38.301 Malloc1 00:06:38.301 04:51:17 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@12 -- # local i 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.301 04:51:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:38.560 /dev/nbd0 00:06:38.560 04:51:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:38.560 04:51:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:38.560 04:51:17 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:38.560 04:51:17 -- common/autotest_common.sh@855 -- # local i 00:06:38.560 04:51:17 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:38.560 04:51:17 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:38.560 04:51:17 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:38.560 04:51:17 -- common/autotest_common.sh@859 -- # break 00:06:38.560 04:51:17 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:38.560 04:51:17 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:38.560 04:51:17 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:38.560 1+0 records in 00:06:38.560 1+0 records out 00:06:38.560 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00019653 s, 20.8 MB/s 00:06:38.560 04:51:17 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:38.560 04:51:17 -- common/autotest_common.sh@872 -- # size=4096 00:06:38.560 04:51:17 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:38.560 04:51:17 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:38.560 04:51:17 -- common/autotest_common.sh@875 -- # return 0 00:06:38.560 04:51:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:38.560 04:51:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.560 04:51:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:38.819 /dev/nbd1 00:06:38.819 04:51:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:38.819 04:51:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:38.819 04:51:17 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:38.819 04:51:17 -- common/autotest_common.sh@855 -- # local i 00:06:38.819 04:51:17 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:38.819 04:51:17 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:38.819 04:51:17 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:38.819 04:51:17 -- common/autotest_common.sh@859 -- # break 00:06:38.819 04:51:17 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:38.819 04:51:17 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:38.819 04:51:17 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:38.819 1+0 records in 00:06:38.819 1+0 records out 00:06:38.819 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000173447 s, 23.6 MB/s 00:06:38.819 04:51:17 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:38.819 04:51:17 -- common/autotest_common.sh@872 -- # size=4096 00:06:38.819 04:51:17 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:38.819 04:51:17 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:38.819 04:51:17 -- common/autotest_common.sh@875 -- # return 0 00:06:38.819 04:51:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:38.819 04:51:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.819 04:51:17 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:38.819 04:51:17 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.819 04:51:17 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:39.078 { 00:06:39.078 "nbd_device": "/dev/nbd0", 00:06:39.078 "bdev_name": "Malloc0" 00:06:39.078 }, 00:06:39.078 { 00:06:39.078 "nbd_device": "/dev/nbd1", 00:06:39.078 "bdev_name": "Malloc1" 00:06:39.078 } 00:06:39.078 ]' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:39.078 { 00:06:39.078 "nbd_device": "/dev/nbd0", 00:06:39.078 "bdev_name": "Malloc0" 00:06:39.078 }, 00:06:39.078 { 00:06:39.078 "nbd_device": "/dev/nbd1", 00:06:39.078 "bdev_name": "Malloc1" 00:06:39.078 } 00:06:39.078 ]' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:39.078 /dev/nbd1' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:39.078 /dev/nbd1' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@65 -- # count=2 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@95 -- # count=2 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:39.078 256+0 records in 00:06:39.078 256+0 records out 00:06:39.078 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00502863 s, 209 MB/s 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:39.078 256+0 records in 00:06:39.078 256+0 records out 00:06:39.078 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224758 s, 46.7 MB/s 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:39.078 256+0 records in 00:06:39.078 256+0 records out 00:06:39.078 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238119 s, 44.0 MB/s 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@51 -- # local i 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:39.078 04:51:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@41 -- # break 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@45 -- # return 0 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:39.336 04:51:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@41 -- # break 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@45 -- # return 0 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:39.595 04:51:18 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@65 -- # true 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@65 -- # count=0 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@104 -- # count=0 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:39.854 04:51:18 -- bdev/nbd_common.sh@109 -- # return 0 00:06:39.854 04:51:18 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:40.111 04:51:19 -- event/event.sh@35 -- # sleep 3 00:06:40.371 [2024-04-23 04:51:19.427443] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:40.371 [2024-04-23 04:51:19.514793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:40.371 [2024-04-23 04:51:19.514810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.629 [2024-04-23 04:51:19.576809] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:40.629 [2024-04-23 04:51:19.576895] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:43.162 04:51:22 -- event/event.sh@38 -- # waitforlisten 2275225 /var/tmp/spdk-nbd.sock 00:06:43.162 04:51:22 -- common/autotest_common.sh@817 -- # '[' -z 2275225 ']' 00:06:43.162 04:51:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:43.162 04:51:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:43.162 04:51:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:43.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:43.162 04:51:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:43.162 04:51:22 -- common/autotest_common.sh@10 -- # set +x 00:06:43.421 04:51:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:43.421 04:51:22 -- common/autotest_common.sh@850 -- # return 0 00:06:43.421 04:51:22 -- event/event.sh@39 -- # killprocess 2275225 00:06:43.421 04:51:22 -- common/autotest_common.sh@936 -- # '[' -z 2275225 ']' 00:06:43.421 04:51:22 -- common/autotest_common.sh@940 -- # kill -0 2275225 00:06:43.421 04:51:22 -- common/autotest_common.sh@941 -- # uname 00:06:43.421 04:51:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:43.421 04:51:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2275225 00:06:43.421 04:51:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:43.421 04:51:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:43.421 04:51:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2275225' 00:06:43.421 killing process with pid 2275225 00:06:43.421 04:51:22 -- common/autotest_common.sh@955 -- # kill 2275225 00:06:43.421 04:51:22 -- common/autotest_common.sh@960 -- # wait 2275225 00:06:43.680 spdk_app_start is called in Round 0. 00:06:43.680 Shutdown signal received, stop current app iteration 00:06:43.680 Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 reinitialization... 00:06:43.680 spdk_app_start is called in Round 1. 00:06:43.680 Shutdown signal received, stop current app iteration 00:06:43.680 Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 reinitialization... 00:06:43.680 spdk_app_start is called in Round 2. 00:06:43.680 Shutdown signal received, stop current app iteration 00:06:43.680 Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 reinitialization... 00:06:43.680 spdk_app_start is called in Round 3. 00:06:43.680 Shutdown signal received, stop current app iteration 00:06:43.680 04:51:22 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:43.680 04:51:22 -- event/event.sh@42 -- # return 0 00:06:43.680 00:06:43.680 real 0m17.762s 00:06:43.680 user 0m39.236s 00:06:43.680 sys 0m3.213s 00:06:43.680 04:51:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:43.680 04:51:22 -- common/autotest_common.sh@10 -- # set +x 00:06:43.680 ************************************ 00:06:43.680 END TEST app_repeat 00:06:43.680 ************************************ 00:06:43.680 04:51:22 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:43.680 04:51:22 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:43.680 04:51:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.680 04:51:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.680 04:51:22 -- common/autotest_common.sh@10 -- # set +x 00:06:43.680 ************************************ 00:06:43.680 START TEST cpu_locks 00:06:43.680 ************************************ 00:06:43.680 04:51:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:43.940 * Looking for test storage... 00:06:43.940 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:43.940 04:51:22 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:43.940 04:51:22 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:43.940 04:51:22 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:43.940 04:51:22 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:43.940 04:51:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.940 04:51:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.940 04:51:22 -- common/autotest_common.sh@10 -- # set +x 00:06:43.940 ************************************ 00:06:43.940 START TEST default_locks 00:06:43.940 ************************************ 00:06:43.940 04:51:22 -- common/autotest_common.sh@1111 -- # default_locks 00:06:43.940 04:51:22 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2278096 00:06:43.940 04:51:22 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:43.940 04:51:22 -- event/cpu_locks.sh@47 -- # waitforlisten 2278096 00:06:43.940 04:51:22 -- common/autotest_common.sh@817 -- # '[' -z 2278096 ']' 00:06:43.940 04:51:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.940 04:51:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:43.940 04:51:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.940 04:51:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:43.940 04:51:22 -- common/autotest_common.sh@10 -- # set +x 00:06:43.940 [2024-04-23 04:51:23.018579] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:43.940 [2024-04-23 04:51:23.018660] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2278096 ] 00:06:43.940 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.940 [2024-04-23 04:51:23.050854] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:43.940 [2024-04-23 04:51:23.081654] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.199 [2024-04-23 04:51:23.173715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.458 04:51:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:44.458 04:51:23 -- common/autotest_common.sh@850 -- # return 0 00:06:44.458 04:51:23 -- event/cpu_locks.sh@49 -- # locks_exist 2278096 00:06:44.458 04:51:23 -- event/cpu_locks.sh@22 -- # lslocks -p 2278096 00:06:44.458 04:51:23 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:44.718 lslocks: write error 00:06:44.718 04:51:23 -- event/cpu_locks.sh@50 -- # killprocess 2278096 00:06:44.718 04:51:23 -- common/autotest_common.sh@936 -- # '[' -z 2278096 ']' 00:06:44.718 04:51:23 -- common/autotest_common.sh@940 -- # kill -0 2278096 00:06:44.718 04:51:23 -- common/autotest_common.sh@941 -- # uname 00:06:44.718 04:51:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.718 04:51:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2278096 00:06:44.718 04:51:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.718 04:51:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.718 04:51:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2278096' 00:06:44.718 killing process with pid 2278096 00:06:44.718 04:51:23 -- common/autotest_common.sh@955 -- # kill 2278096 00:06:44.718 04:51:23 -- common/autotest_common.sh@960 -- # wait 2278096 00:06:45.286 04:51:24 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2278096 00:06:45.286 04:51:24 -- common/autotest_common.sh@638 -- # local es=0 00:06:45.286 04:51:24 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 2278096 00:06:45.286 04:51:24 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:06:45.286 04:51:24 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:45.286 04:51:24 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:06:45.286 04:51:24 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:45.286 04:51:24 -- common/autotest_common.sh@641 -- # waitforlisten 2278096 00:06:45.286 04:51:24 -- common/autotest_common.sh@817 -- # '[' -z 2278096 ']' 00:06:45.286 04:51:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.286 04:51:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:45.286 04:51:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.286 04:51:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:45.286 04:51:24 -- common/autotest_common.sh@10 -- # set +x 00:06:45.286 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (2278096) - No such process 00:06:45.286 ERROR: process (pid: 2278096) is no longer running 00:06:45.286 04:51:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:45.286 04:51:24 -- common/autotest_common.sh@850 -- # return 1 00:06:45.286 04:51:24 -- common/autotest_common.sh@641 -- # es=1 00:06:45.286 04:51:24 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:45.286 04:51:24 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:45.286 04:51:24 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:45.286 04:51:24 -- event/cpu_locks.sh@54 -- # no_locks 00:06:45.286 04:51:24 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:45.286 04:51:24 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:45.286 04:51:24 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:45.286 00:06:45.286 real 0m1.216s 00:06:45.286 user 0m1.165s 00:06:45.286 sys 0m0.537s 00:06:45.286 04:51:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:45.286 04:51:24 -- common/autotest_common.sh@10 -- # set +x 00:06:45.286 ************************************ 00:06:45.286 END TEST default_locks 00:06:45.286 ************************************ 00:06:45.286 04:51:24 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:45.286 04:51:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.286 04:51:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.286 04:51:24 -- common/autotest_common.sh@10 -- # set +x 00:06:45.286 ************************************ 00:06:45.286 START TEST default_locks_via_rpc 00:06:45.286 ************************************ 00:06:45.286 04:51:24 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:06:45.287 04:51:24 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2278266 00:06:45.287 04:51:24 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:45.287 04:51:24 -- event/cpu_locks.sh@63 -- # waitforlisten 2278266 00:06:45.287 04:51:24 -- common/autotest_common.sh@817 -- # '[' -z 2278266 ']' 00:06:45.287 04:51:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.287 04:51:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:45.287 04:51:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.287 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.287 04:51:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:45.287 04:51:24 -- common/autotest_common.sh@10 -- # set +x 00:06:45.287 [2024-04-23 04:51:24.360177] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:45.287 [2024-04-23 04:51:24.360282] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2278266 ] 00:06:45.287 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.287 [2024-04-23 04:51:24.392361] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:45.287 [2024-04-23 04:51:24.422936] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.578 [2024-04-23 04:51:24.515600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.838 04:51:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:45.838 04:51:24 -- common/autotest_common.sh@850 -- # return 0 00:06:45.838 04:51:24 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:45.838 04:51:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.838 04:51:24 -- common/autotest_common.sh@10 -- # set +x 00:06:45.838 04:51:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.838 04:51:24 -- event/cpu_locks.sh@67 -- # no_locks 00:06:45.838 04:51:24 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:45.838 04:51:24 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:45.838 04:51:24 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:45.838 04:51:24 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:45.838 04:51:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.838 04:51:24 -- common/autotest_common.sh@10 -- # set +x 00:06:45.838 04:51:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.838 04:51:24 -- event/cpu_locks.sh@71 -- # locks_exist 2278266 00:06:45.838 04:51:24 -- event/cpu_locks.sh@22 -- # lslocks -p 2278266 00:06:45.838 04:51:24 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:45.838 04:51:25 -- event/cpu_locks.sh@73 -- # killprocess 2278266 00:06:45.838 04:51:25 -- common/autotest_common.sh@936 -- # '[' -z 2278266 ']' 00:06:45.838 04:51:25 -- common/autotest_common.sh@940 -- # kill -0 2278266 00:06:45.838 04:51:25 -- common/autotest_common.sh@941 -- # uname 00:06:46.097 04:51:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:46.097 04:51:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2278266 00:06:46.097 04:51:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:46.097 04:51:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:46.097 04:51:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2278266' 00:06:46.097 killing process with pid 2278266 00:06:46.097 04:51:25 -- common/autotest_common.sh@955 -- # kill 2278266 00:06:46.097 04:51:25 -- common/autotest_common.sh@960 -- # wait 2278266 00:06:46.357 00:06:46.357 real 0m1.122s 00:06:46.357 user 0m1.073s 00:06:46.357 sys 0m0.518s 00:06:46.357 04:51:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:46.357 04:51:25 -- common/autotest_common.sh@10 -- # set +x 00:06:46.357 ************************************ 00:06:46.357 END TEST default_locks_via_rpc 00:06:46.357 ************************************ 00:06:46.357 04:51:25 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:46.357 04:51:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:46.357 04:51:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.357 04:51:25 -- common/autotest_common.sh@10 -- # set +x 00:06:46.616 ************************************ 00:06:46.616 START TEST non_locking_app_on_locked_coremask 00:06:46.616 ************************************ 00:06:46.616 04:51:25 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:06:46.616 04:51:25 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2278434 00:06:46.616 04:51:25 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:46.616 04:51:25 -- event/cpu_locks.sh@81 -- # waitforlisten 2278434 /var/tmp/spdk.sock 00:06:46.616 04:51:25 -- common/autotest_common.sh@817 -- # '[' -z 2278434 ']' 00:06:46.616 04:51:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:46.616 04:51:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:46.616 04:51:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:46.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:46.616 04:51:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:46.616 04:51:25 -- common/autotest_common.sh@10 -- # set +x 00:06:46.616 [2024-04-23 04:51:25.603679] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:46.616 [2024-04-23 04:51:25.603759] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2278434 ] 00:06:46.616 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.616 [2024-04-23 04:51:25.636131] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:46.616 [2024-04-23 04:51:25.663825] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.616 [2024-04-23 04:51:25.748152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.911 04:51:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:46.911 04:51:25 -- common/autotest_common.sh@850 -- # return 0 00:06:46.911 04:51:25 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2278565 00:06:46.911 04:51:25 -- event/cpu_locks.sh@85 -- # waitforlisten 2278565 /var/tmp/spdk2.sock 00:06:46.911 04:51:25 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:46.911 04:51:25 -- common/autotest_common.sh@817 -- # '[' -z 2278565 ']' 00:06:46.911 04:51:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:46.911 04:51:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:46.911 04:51:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:46.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:46.911 04:51:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:46.911 04:51:25 -- common/autotest_common.sh@10 -- # set +x 00:06:46.911 [2024-04-23 04:51:26.040819] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:46.911 [2024-04-23 04:51:26.040902] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2278565 ] 00:06:47.171 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.171 [2024-04-23 04:51:26.077276] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:47.171 [2024-04-23 04:51:26.141044] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:47.171 [2024-04-23 04:51:26.141075] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.171 [2024-04-23 04:51:26.318993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.106 04:51:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:48.106 04:51:26 -- common/autotest_common.sh@850 -- # return 0 00:06:48.106 04:51:26 -- event/cpu_locks.sh@87 -- # locks_exist 2278434 00:06:48.106 04:51:26 -- event/cpu_locks.sh@22 -- # lslocks -p 2278434 00:06:48.106 04:51:26 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:48.364 lslocks: write error 00:06:48.364 04:51:27 -- event/cpu_locks.sh@89 -- # killprocess 2278434 00:06:48.364 04:51:27 -- common/autotest_common.sh@936 -- # '[' -z 2278434 ']' 00:06:48.364 04:51:27 -- common/autotest_common.sh@940 -- # kill -0 2278434 00:06:48.364 04:51:27 -- common/autotest_common.sh@941 -- # uname 00:06:48.364 04:51:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:48.364 04:51:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2278434 00:06:48.364 04:51:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:48.364 04:51:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:48.364 04:51:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2278434' 00:06:48.364 killing process with pid 2278434 00:06:48.364 04:51:27 -- common/autotest_common.sh@955 -- # kill 2278434 00:06:48.364 04:51:27 -- common/autotest_common.sh@960 -- # wait 2278434 00:06:49.302 04:51:28 -- event/cpu_locks.sh@90 -- # killprocess 2278565 00:06:49.302 04:51:28 -- common/autotest_common.sh@936 -- # '[' -z 2278565 ']' 00:06:49.302 04:51:28 -- common/autotest_common.sh@940 -- # kill -0 2278565 00:06:49.302 04:51:28 -- common/autotest_common.sh@941 -- # uname 00:06:49.302 04:51:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:49.302 04:51:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2278565 00:06:49.302 04:51:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:49.302 04:51:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:49.302 04:51:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2278565' 00:06:49.302 killing process with pid 2278565 00:06:49.302 04:51:28 -- common/autotest_common.sh@955 -- # kill 2278565 00:06:49.302 04:51:28 -- common/autotest_common.sh@960 -- # wait 2278565 00:06:49.870 00:06:49.870 real 0m3.211s 00:06:49.870 user 0m3.373s 00:06:49.870 sys 0m1.021s 00:06:49.870 04:51:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:49.870 04:51:28 -- common/autotest_common.sh@10 -- # set +x 00:06:49.870 ************************************ 00:06:49.870 END TEST non_locking_app_on_locked_coremask 00:06:49.870 ************************************ 00:06:49.870 04:51:28 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:49.870 04:51:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:49.870 04:51:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.870 04:51:28 -- common/autotest_common.sh@10 -- # set +x 00:06:49.870 ************************************ 00:06:49.870 START TEST locking_app_on_unlocked_coremask 00:06:49.870 ************************************ 00:06:49.870 04:51:28 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:06:49.870 04:51:28 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2278880 00:06:49.870 04:51:28 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:49.870 04:51:28 -- event/cpu_locks.sh@99 -- # waitforlisten 2278880 /var/tmp/spdk.sock 00:06:49.870 04:51:28 -- common/autotest_common.sh@817 -- # '[' -z 2278880 ']' 00:06:49.870 04:51:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:49.870 04:51:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:49.870 04:51:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:49.870 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:49.870 04:51:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:49.870 04:51:28 -- common/autotest_common.sh@10 -- # set +x 00:06:49.870 [2024-04-23 04:51:28.943768] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:49.870 [2024-04-23 04:51:28.943849] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2278880 ] 00:06:49.870 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.870 [2024-04-23 04:51:28.975871] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:49.870 [2024-04-23 04:51:29.007760] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:49.870 [2024-04-23 04:51:29.007787] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.129 [2024-04-23 04:51:29.098557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.390 04:51:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:50.390 04:51:29 -- common/autotest_common.sh@850 -- # return 0 00:06:50.390 04:51:29 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2279007 00:06:50.390 04:51:29 -- event/cpu_locks.sh@103 -- # waitforlisten 2279007 /var/tmp/spdk2.sock 00:06:50.390 04:51:29 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:50.390 04:51:29 -- common/autotest_common.sh@817 -- # '[' -z 2279007 ']' 00:06:50.390 04:51:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:50.390 04:51:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:50.390 04:51:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:50.390 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:50.390 04:51:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:50.390 04:51:29 -- common/autotest_common.sh@10 -- # set +x 00:06:50.390 [2024-04-23 04:51:29.400921] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:50.390 [2024-04-23 04:51:29.400995] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2279007 ] 00:06:50.390 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.390 [2024-04-23 04:51:29.434389] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:50.390 [2024-04-23 04:51:29.498466] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.650 [2024-04-23 04:51:29.684493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.585 04:51:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:51.585 04:51:30 -- common/autotest_common.sh@850 -- # return 0 00:06:51.585 04:51:30 -- event/cpu_locks.sh@105 -- # locks_exist 2279007 00:06:51.585 04:51:30 -- event/cpu_locks.sh@22 -- # lslocks -p 2279007 00:06:51.585 04:51:30 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:51.845 lslocks: write error 00:06:51.845 04:51:30 -- event/cpu_locks.sh@107 -- # killprocess 2278880 00:06:51.845 04:51:30 -- common/autotest_common.sh@936 -- # '[' -z 2278880 ']' 00:06:51.845 04:51:30 -- common/autotest_common.sh@940 -- # kill -0 2278880 00:06:51.845 04:51:30 -- common/autotest_common.sh@941 -- # uname 00:06:51.845 04:51:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:51.845 04:51:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2278880 00:06:51.845 04:51:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:51.845 04:51:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:51.845 04:51:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2278880' 00:06:51.845 killing process with pid 2278880 00:06:51.845 04:51:30 -- common/autotest_common.sh@955 -- # kill 2278880 00:06:51.845 04:51:30 -- common/autotest_common.sh@960 -- # wait 2278880 00:06:52.784 04:51:31 -- event/cpu_locks.sh@108 -- # killprocess 2279007 00:06:52.784 04:51:31 -- common/autotest_common.sh@936 -- # '[' -z 2279007 ']' 00:06:52.784 04:51:31 -- common/autotest_common.sh@940 -- # kill -0 2279007 00:06:52.784 04:51:31 -- common/autotest_common.sh@941 -- # uname 00:06:52.784 04:51:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:52.784 04:51:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2279007 00:06:52.785 04:51:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:52.785 04:51:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:52.785 04:51:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2279007' 00:06:52.785 killing process with pid 2279007 00:06:52.785 04:51:31 -- common/autotest_common.sh@955 -- # kill 2279007 00:06:52.785 04:51:31 -- common/autotest_common.sh@960 -- # wait 2279007 00:06:53.043 00:06:53.043 real 0m3.262s 00:06:53.043 user 0m3.432s 00:06:53.043 sys 0m1.070s 00:06:53.043 04:51:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:53.043 04:51:32 -- common/autotest_common.sh@10 -- # set +x 00:06:53.043 ************************************ 00:06:53.043 END TEST locking_app_on_unlocked_coremask 00:06:53.043 ************************************ 00:06:53.043 04:51:32 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:53.043 04:51:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:53.043 04:51:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.043 04:51:32 -- common/autotest_common.sh@10 -- # set +x 00:06:53.301 ************************************ 00:06:53.301 START TEST locking_app_on_locked_coremask 00:06:53.301 ************************************ 00:06:53.301 04:51:32 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:06:53.301 04:51:32 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2279323 00:06:53.301 04:51:32 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:53.301 04:51:32 -- event/cpu_locks.sh@116 -- # waitforlisten 2279323 /var/tmp/spdk.sock 00:06:53.301 04:51:32 -- common/autotest_common.sh@817 -- # '[' -z 2279323 ']' 00:06:53.301 04:51:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.301 04:51:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:53.301 04:51:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.301 04:51:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:53.301 04:51:32 -- common/autotest_common.sh@10 -- # set +x 00:06:53.301 [2024-04-23 04:51:32.329124] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:53.301 [2024-04-23 04:51:32.329202] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2279323 ] 00:06:53.301 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.301 [2024-04-23 04:51:32.360149] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:53.301 [2024-04-23 04:51:32.390815] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.560 [2024-04-23 04:51:32.484025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.820 04:51:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:53.820 04:51:32 -- common/autotest_common.sh@850 -- # return 0 00:06:53.820 04:51:32 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2279450 00:06:53.820 04:51:32 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2279450 /var/tmp/spdk2.sock 00:06:53.820 04:51:32 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:53.820 04:51:32 -- common/autotest_common.sh@638 -- # local es=0 00:06:53.820 04:51:32 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 2279450 /var/tmp/spdk2.sock 00:06:53.820 04:51:32 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:06:53.820 04:51:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:53.820 04:51:32 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:06:53.820 04:51:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:53.820 04:51:32 -- common/autotest_common.sh@641 -- # waitforlisten 2279450 /var/tmp/spdk2.sock 00:06:53.820 04:51:32 -- common/autotest_common.sh@817 -- # '[' -z 2279450 ']' 00:06:53.820 04:51:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:53.820 04:51:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:53.820 04:51:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:53.820 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:53.820 04:51:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:53.820 04:51:32 -- common/autotest_common.sh@10 -- # set +x 00:06:53.820 [2024-04-23 04:51:32.786128] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:53.820 [2024-04-23 04:51:32.786202] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2279450 ] 00:06:53.820 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.820 [2024-04-23 04:51:32.819233] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:53.820 [2024-04-23 04:51:32.869644] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2279323 has claimed it. 00:06:53.820 [2024-04-23 04:51:32.869700] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:54.389 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (2279450) - No such process 00:06:54.389 ERROR: process (pid: 2279450) is no longer running 00:06:54.389 04:51:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:54.389 04:51:33 -- common/autotest_common.sh@850 -- # return 1 00:06:54.389 04:51:33 -- common/autotest_common.sh@641 -- # es=1 00:06:54.389 04:51:33 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:54.389 04:51:33 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:54.389 04:51:33 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:54.389 04:51:33 -- event/cpu_locks.sh@122 -- # locks_exist 2279323 00:06:54.389 04:51:33 -- event/cpu_locks.sh@22 -- # lslocks -p 2279323 00:06:54.389 04:51:33 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:54.648 lslocks: write error 00:06:54.648 04:51:33 -- event/cpu_locks.sh@124 -- # killprocess 2279323 00:06:54.648 04:51:33 -- common/autotest_common.sh@936 -- # '[' -z 2279323 ']' 00:06:54.648 04:51:33 -- common/autotest_common.sh@940 -- # kill -0 2279323 00:06:54.648 04:51:33 -- common/autotest_common.sh@941 -- # uname 00:06:54.648 04:51:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:54.648 04:51:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2279323 00:06:54.648 04:51:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:54.648 04:51:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:54.648 04:51:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2279323' 00:06:54.648 killing process with pid 2279323 00:06:54.648 04:51:33 -- common/autotest_common.sh@955 -- # kill 2279323 00:06:54.648 04:51:33 -- common/autotest_common.sh@960 -- # wait 2279323 00:06:55.218 00:06:55.218 real 0m1.891s 00:06:55.218 user 0m2.044s 00:06:55.218 sys 0m0.612s 00:06:55.218 04:51:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:55.218 04:51:34 -- common/autotest_common.sh@10 -- # set +x 00:06:55.218 ************************************ 00:06:55.218 END TEST locking_app_on_locked_coremask 00:06:55.218 ************************************ 00:06:55.218 04:51:34 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:55.218 04:51:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:55.218 04:51:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.218 04:51:34 -- common/autotest_common.sh@10 -- # set +x 00:06:55.218 ************************************ 00:06:55.218 START TEST locking_overlapped_coremask 00:06:55.218 ************************************ 00:06:55.218 04:51:34 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:06:55.218 04:51:34 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2279625 00:06:55.218 04:51:34 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:55.218 04:51:34 -- event/cpu_locks.sh@133 -- # waitforlisten 2279625 /var/tmp/spdk.sock 00:06:55.218 04:51:34 -- common/autotest_common.sh@817 -- # '[' -z 2279625 ']' 00:06:55.218 04:51:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:55.218 04:51:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:55.218 04:51:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:55.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:55.218 04:51:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:55.218 04:51:34 -- common/autotest_common.sh@10 -- # set +x 00:06:55.218 [2024-04-23 04:51:34.346055] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:55.218 [2024-04-23 04:51:34.346161] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2279625 ] 00:06:55.218 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.218 [2024-04-23 04:51:34.378846] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:55.476 [2024-04-23 04:51:34.405610] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:55.476 [2024-04-23 04:51:34.492343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:55.476 [2024-04-23 04:51:34.492408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:55.476 [2024-04-23 04:51:34.492411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.734 04:51:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:55.734 04:51:34 -- common/autotest_common.sh@850 -- # return 0 00:06:55.734 04:51:34 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2279749 00:06:55.734 04:51:34 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2279749 /var/tmp/spdk2.sock 00:06:55.734 04:51:34 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:55.734 04:51:34 -- common/autotest_common.sh@638 -- # local es=0 00:06:55.734 04:51:34 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 2279749 /var/tmp/spdk2.sock 00:06:55.734 04:51:34 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:06:55.734 04:51:34 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:55.734 04:51:34 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:06:55.734 04:51:34 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:55.734 04:51:34 -- common/autotest_common.sh@641 -- # waitforlisten 2279749 /var/tmp/spdk2.sock 00:06:55.734 04:51:34 -- common/autotest_common.sh@817 -- # '[' -z 2279749 ']' 00:06:55.734 04:51:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:55.734 04:51:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:55.734 04:51:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:55.734 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:55.734 04:51:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:55.734 04:51:34 -- common/autotest_common.sh@10 -- # set +x 00:06:55.734 [2024-04-23 04:51:34.785027] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:55.734 [2024-04-23 04:51:34.785103] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2279749 ] 00:06:55.734 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.734 [2024-04-23 04:51:34.821670] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:55.734 [2024-04-23 04:51:34.876635] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2279625 has claimed it. 00:06:55.734 [2024-04-23 04:51:34.876676] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:56.673 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (2279749) - No such process 00:06:56.673 ERROR: process (pid: 2279749) is no longer running 00:06:56.673 04:51:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:56.673 04:51:35 -- common/autotest_common.sh@850 -- # return 1 00:06:56.673 04:51:35 -- common/autotest_common.sh@641 -- # es=1 00:06:56.673 04:51:35 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:56.673 04:51:35 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:56.673 04:51:35 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:56.673 04:51:35 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:56.673 04:51:35 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:56.673 04:51:35 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:56.673 04:51:35 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:56.673 04:51:35 -- event/cpu_locks.sh@141 -- # killprocess 2279625 00:06:56.673 04:51:35 -- common/autotest_common.sh@936 -- # '[' -z 2279625 ']' 00:06:56.673 04:51:35 -- common/autotest_common.sh@940 -- # kill -0 2279625 00:06:56.673 04:51:35 -- common/autotest_common.sh@941 -- # uname 00:06:56.673 04:51:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.673 04:51:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2279625 00:06:56.673 04:51:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:56.673 04:51:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:56.673 04:51:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2279625' 00:06:56.673 killing process with pid 2279625 00:06:56.673 04:51:35 -- common/autotest_common.sh@955 -- # kill 2279625 00:06:56.673 04:51:35 -- common/autotest_common.sh@960 -- # wait 2279625 00:06:56.932 00:06:56.932 real 0m1.606s 00:06:56.932 user 0m4.341s 00:06:56.932 sys 0m0.456s 00:06:56.932 04:51:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.932 04:51:35 -- common/autotest_common.sh@10 -- # set +x 00:06:56.932 ************************************ 00:06:56.932 END TEST locking_overlapped_coremask 00:06:56.932 ************************************ 00:06:56.932 04:51:35 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:56.932 04:51:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:56.932 04:51:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.932 04:51:35 -- common/autotest_common.sh@10 -- # set +x 00:06:56.932 ************************************ 00:06:56.932 START TEST locking_overlapped_coremask_via_rpc 00:06:56.932 ************************************ 00:06:56.932 04:51:36 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:06:56.932 04:51:36 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2279926 00:06:56.932 04:51:36 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:56.932 04:51:36 -- event/cpu_locks.sh@149 -- # waitforlisten 2279926 /var/tmp/spdk.sock 00:06:56.932 04:51:36 -- common/autotest_common.sh@817 -- # '[' -z 2279926 ']' 00:06:56.932 04:51:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:56.932 04:51:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:56.932 04:51:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:56.932 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:56.932 04:51:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:56.932 04:51:36 -- common/autotest_common.sh@10 -- # set +x 00:06:56.932 [2024-04-23 04:51:36.072273] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:56.932 [2024-04-23 04:51:36.072350] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2279926 ] 00:06:57.192 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.192 [2024-04-23 04:51:36.104056] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:57.192 [2024-04-23 04:51:36.135120] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:57.192 [2024-04-23 04:51:36.135150] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:57.192 [2024-04-23 04:51:36.223761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:57.192 [2024-04-23 04:51:36.223825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:57.192 [2024-04-23 04:51:36.223829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.451 04:51:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:57.451 04:51:36 -- common/autotest_common.sh@850 -- # return 0 00:06:57.451 04:51:36 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2279936 00:06:57.451 04:51:36 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:57.451 04:51:36 -- event/cpu_locks.sh@153 -- # waitforlisten 2279936 /var/tmp/spdk2.sock 00:06:57.451 04:51:36 -- common/autotest_common.sh@817 -- # '[' -z 2279936 ']' 00:06:57.451 04:51:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:57.451 04:51:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:57.451 04:51:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:57.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:57.451 04:51:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:57.451 04:51:36 -- common/autotest_common.sh@10 -- # set +x 00:06:57.451 [2024-04-23 04:51:36.523384] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:57.451 [2024-04-23 04:51:36.523462] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2279936 ] 00:06:57.451 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.451 [2024-04-23 04:51:36.556575] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:06:57.451 [2024-04-23 04:51:36.611468] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:57.451 [2024-04-23 04:51:36.611494] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:57.709 [2024-04-23 04:51:36.781465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:57.709 [2024-04-23 04:51:36.784551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:57.709 [2024-04-23 04:51:36.784552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:58.646 04:51:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:58.646 04:51:37 -- common/autotest_common.sh@850 -- # return 0 00:06:58.646 04:51:37 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:58.646 04:51:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:58.646 04:51:37 -- common/autotest_common.sh@10 -- # set +x 00:06:58.646 04:51:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:58.646 04:51:37 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:58.646 04:51:37 -- common/autotest_common.sh@638 -- # local es=0 00:06:58.646 04:51:37 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:58.646 04:51:37 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:06:58.646 04:51:37 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:58.646 04:51:37 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:06:58.646 04:51:37 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:58.646 04:51:37 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:58.646 04:51:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:58.646 04:51:37 -- common/autotest_common.sh@10 -- # set +x 00:06:58.646 [2024-04-23 04:51:37.469622] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2279926 has claimed it. 00:06:58.646 request: 00:06:58.646 { 00:06:58.646 "method": "framework_enable_cpumask_locks", 00:06:58.646 "req_id": 1 00:06:58.646 } 00:06:58.646 Got JSON-RPC error response 00:06:58.646 response: 00:06:58.646 { 00:06:58.646 "code": -32603, 00:06:58.646 "message": "Failed to claim CPU core: 2" 00:06:58.646 } 00:06:58.646 04:51:37 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:06:58.646 04:51:37 -- common/autotest_common.sh@641 -- # es=1 00:06:58.646 04:51:37 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:58.646 04:51:37 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:58.646 04:51:37 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:58.646 04:51:37 -- event/cpu_locks.sh@158 -- # waitforlisten 2279926 /var/tmp/spdk.sock 00:06:58.646 04:51:37 -- common/autotest_common.sh@817 -- # '[' -z 2279926 ']' 00:06:58.646 04:51:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:58.646 04:51:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:58.646 04:51:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:58.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:58.646 04:51:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:58.646 04:51:37 -- common/autotest_common.sh@10 -- # set +x 00:06:58.646 04:51:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:58.646 04:51:37 -- common/autotest_common.sh@850 -- # return 0 00:06:58.646 04:51:37 -- event/cpu_locks.sh@159 -- # waitforlisten 2279936 /var/tmp/spdk2.sock 00:06:58.646 04:51:37 -- common/autotest_common.sh@817 -- # '[' -z 2279936 ']' 00:06:58.646 04:51:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:58.646 04:51:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:58.646 04:51:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:58.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:58.646 04:51:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:58.646 04:51:37 -- common/autotest_common.sh@10 -- # set +x 00:06:58.905 04:51:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:58.905 04:51:37 -- common/autotest_common.sh@850 -- # return 0 00:06:58.905 04:51:37 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:58.905 04:51:37 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:58.905 04:51:37 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:58.905 04:51:37 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:58.905 00:06:58.905 real 0m1.947s 00:06:58.905 user 0m0.991s 00:06:58.905 sys 0m0.184s 00:06:58.905 04:51:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:58.905 04:51:37 -- common/autotest_common.sh@10 -- # set +x 00:06:58.905 ************************************ 00:06:58.905 END TEST locking_overlapped_coremask_via_rpc 00:06:58.905 ************************************ 00:06:58.905 04:51:37 -- event/cpu_locks.sh@174 -- # cleanup 00:06:58.905 04:51:37 -- event/cpu_locks.sh@15 -- # [[ -z 2279926 ]] 00:06:58.905 04:51:37 -- event/cpu_locks.sh@15 -- # killprocess 2279926 00:06:58.905 04:51:37 -- common/autotest_common.sh@936 -- # '[' -z 2279926 ']' 00:06:58.905 04:51:37 -- common/autotest_common.sh@940 -- # kill -0 2279926 00:06:58.905 04:51:37 -- common/autotest_common.sh@941 -- # uname 00:06:58.905 04:51:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:58.905 04:51:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2279926 00:06:58.905 04:51:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:58.905 04:51:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:58.905 04:51:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2279926' 00:06:58.905 killing process with pid 2279926 00:06:58.905 04:51:38 -- common/autotest_common.sh@955 -- # kill 2279926 00:06:58.905 04:51:38 -- common/autotest_common.sh@960 -- # wait 2279926 00:06:59.475 04:51:38 -- event/cpu_locks.sh@16 -- # [[ -z 2279936 ]] 00:06:59.475 04:51:38 -- event/cpu_locks.sh@16 -- # killprocess 2279936 00:06:59.475 04:51:38 -- common/autotest_common.sh@936 -- # '[' -z 2279936 ']' 00:06:59.475 04:51:38 -- common/autotest_common.sh@940 -- # kill -0 2279936 00:06:59.475 04:51:38 -- common/autotest_common.sh@941 -- # uname 00:06:59.475 04:51:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:59.475 04:51:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2279936 00:06:59.475 04:51:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:59.475 04:51:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:59.475 04:51:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2279936' 00:06:59.475 killing process with pid 2279936 00:06:59.475 04:51:38 -- common/autotest_common.sh@955 -- # kill 2279936 00:06:59.475 04:51:38 -- common/autotest_common.sh@960 -- # wait 2279936 00:06:59.736 04:51:38 -- event/cpu_locks.sh@18 -- # rm -f 00:06:59.736 04:51:38 -- event/cpu_locks.sh@1 -- # cleanup 00:06:59.736 04:51:38 -- event/cpu_locks.sh@15 -- # [[ -z 2279926 ]] 00:06:59.736 04:51:38 -- event/cpu_locks.sh@15 -- # killprocess 2279926 00:06:59.736 04:51:38 -- common/autotest_common.sh@936 -- # '[' -z 2279926 ']' 00:06:59.736 04:51:38 -- common/autotest_common.sh@940 -- # kill -0 2279926 00:06:59.736 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2279926) - No such process 00:06:59.736 04:51:38 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2279926 is not found' 00:06:59.736 Process with pid 2279926 is not found 00:06:59.736 04:51:38 -- event/cpu_locks.sh@16 -- # [[ -z 2279936 ]] 00:06:59.736 04:51:38 -- event/cpu_locks.sh@16 -- # killprocess 2279936 00:06:59.736 04:51:38 -- common/autotest_common.sh@936 -- # '[' -z 2279936 ']' 00:06:59.736 04:51:38 -- common/autotest_common.sh@940 -- # kill -0 2279936 00:06:59.736 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2279936) - No such process 00:06:59.736 04:51:38 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2279936 is not found' 00:06:59.736 Process with pid 2279936 is not found 00:06:59.736 04:51:38 -- event/cpu_locks.sh@18 -- # rm -f 00:06:59.736 00:06:59.736 real 0m16.014s 00:06:59.736 user 0m27.203s 00:06:59.736 sys 0m5.543s 00:06:59.736 04:51:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:59.736 04:51:38 -- common/autotest_common.sh@10 -- # set +x 00:06:59.736 ************************************ 00:06:59.736 END TEST cpu_locks 00:06:59.736 ************************************ 00:06:59.736 00:06:59.736 real 0m42.551s 00:06:59.736 user 1m20.170s 00:06:59.736 sys 0m9.847s 00:06:59.736 04:51:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:59.736 04:51:38 -- common/autotest_common.sh@10 -- # set +x 00:06:59.736 ************************************ 00:06:59.736 END TEST event 00:06:59.736 ************************************ 00:06:59.736 04:51:38 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:59.736 04:51:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:59.736 04:51:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.736 04:51:38 -- common/autotest_common.sh@10 -- # set +x 00:06:59.994 ************************************ 00:06:59.994 START TEST thread 00:06:59.994 ************************************ 00:06:59.994 04:51:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:59.994 * Looking for test storage... 00:06:59.994 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:59.994 04:51:39 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:59.994 04:51:39 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:59.994 04:51:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.994 04:51:39 -- common/autotest_common.sh@10 -- # set +x 00:06:59.994 ************************************ 00:06:59.994 START TEST thread_poller_perf 00:06:59.994 ************************************ 00:06:59.994 04:51:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:59.994 [2024-04-23 04:51:39.139082] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:06:59.994 [2024-04-23 04:51:39.139149] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2280333 ] 00:07:00.254 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.254 [2024-04-23 04:51:39.173152] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:00.254 [2024-04-23 04:51:39.201328] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.254 [2024-04-23 04:51:39.287277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.254 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:01.636 ====================================== 00:07:01.636 busy:2709472753 (cyc) 00:07:01.636 total_run_count: 291000 00:07:01.636 tsc_hz: 2700000000 (cyc) 00:07:01.636 ====================================== 00:07:01.636 poller_cost: 9310 (cyc), 3448 (nsec) 00:07:01.636 00:07:01.636 real 0m1.250s 00:07:01.636 user 0m1.158s 00:07:01.636 sys 0m0.085s 00:07:01.636 04:51:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:01.636 04:51:40 -- common/autotest_common.sh@10 -- # set +x 00:07:01.636 ************************************ 00:07:01.636 END TEST thread_poller_perf 00:07:01.636 ************************************ 00:07:01.636 04:51:40 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:01.636 04:51:40 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:01.636 04:51:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.636 04:51:40 -- common/autotest_common.sh@10 -- # set +x 00:07:01.636 ************************************ 00:07:01.636 START TEST thread_poller_perf 00:07:01.636 ************************************ 00:07:01.636 04:51:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:01.636 [2024-04-23 04:51:40.511439] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:01.636 [2024-04-23 04:51:40.511501] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2280595 ] 00:07:01.636 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.636 [2024-04-23 04:51:40.544226] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:01.636 [2024-04-23 04:51:40.574220] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.636 [2024-04-23 04:51:40.663385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.636 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:03.018 ====================================== 00:07:03.018 busy:2702458035 (cyc) 00:07:03.018 total_run_count: 3834000 00:07:03.018 tsc_hz: 2700000000 (cyc) 00:07:03.018 ====================================== 00:07:03.018 poller_cost: 704 (cyc), 260 (nsec) 00:07:03.018 00:07:03.018 real 0m1.249s 00:07:03.018 user 0m1.164s 00:07:03.018 sys 0m0.079s 00:07:03.018 04:51:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:03.018 04:51:41 -- common/autotest_common.sh@10 -- # set +x 00:07:03.018 ************************************ 00:07:03.018 END TEST thread_poller_perf 00:07:03.018 ************************************ 00:07:03.018 04:51:41 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:03.018 00:07:03.018 real 0m2.797s 00:07:03.018 user 0m2.437s 00:07:03.018 sys 0m0.334s 00:07:03.018 04:51:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:03.018 04:51:41 -- common/autotest_common.sh@10 -- # set +x 00:07:03.018 ************************************ 00:07:03.018 END TEST thread 00:07:03.018 ************************************ 00:07:03.018 04:51:41 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:03.019 04:51:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:03.019 04:51:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.019 04:51:41 -- common/autotest_common.sh@10 -- # set +x 00:07:03.019 ************************************ 00:07:03.019 START TEST accel 00:07:03.019 ************************************ 00:07:03.019 04:51:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:03.019 * Looking for test storage... 00:07:03.019 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:03.019 04:51:41 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:07:03.019 04:51:41 -- accel/accel.sh@82 -- # get_expected_opcs 00:07:03.019 04:51:41 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:03.019 04:51:41 -- accel/accel.sh@62 -- # spdk_tgt_pid=2280804 00:07:03.019 04:51:41 -- accel/accel.sh@63 -- # waitforlisten 2280804 00:07:03.019 04:51:41 -- common/autotest_common.sh@817 -- # '[' -z 2280804 ']' 00:07:03.019 04:51:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:03.019 04:51:41 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:03.019 04:51:41 -- accel/accel.sh@61 -- # build_accel_config 00:07:03.019 04:51:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:03.019 04:51:41 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:03.019 04:51:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:03.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:03.019 04:51:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:03.019 04:51:41 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:03.019 04:51:41 -- common/autotest_common.sh@10 -- # set +x 00:07:03.019 04:51:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.019 04:51:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.019 04:51:41 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:03.019 04:51:41 -- accel/accel.sh@40 -- # local IFS=, 00:07:03.019 04:51:41 -- accel/accel.sh@41 -- # jq -r . 00:07:03.019 [2024-04-23 04:51:41.992085] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:03.019 [2024-04-23 04:51:41.992165] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2280804 ] 00:07:03.019 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.019 [2024-04-23 04:51:42.022071] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:03.019 [2024-04-23 04:51:42.053606] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.019 [2024-04-23 04:51:42.141925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.277 04:51:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:03.277 04:51:42 -- common/autotest_common.sh@850 -- # return 0 00:07:03.277 04:51:42 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:07:03.277 04:51:42 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:07:03.277 04:51:42 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:07:03.277 04:51:42 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:07:03.277 04:51:42 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:03.277 04:51:42 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:07:03.277 04:51:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.277 04:51:42 -- common/autotest_common.sh@10 -- # set +x 00:07:03.277 04:51:42 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:03.277 04:51:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.277 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.277 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.277 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.277 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.277 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.277 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.277 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.277 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.277 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.277 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.277 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # IFS== 00:07:03.535 04:51:42 -- accel/accel.sh@72 -- # read -r opc module 00:07:03.535 04:51:42 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:03.535 04:51:42 -- accel/accel.sh@75 -- # killprocess 2280804 00:07:03.535 04:51:42 -- common/autotest_common.sh@936 -- # '[' -z 2280804 ']' 00:07:03.535 04:51:42 -- common/autotest_common.sh@940 -- # kill -0 2280804 00:07:03.535 04:51:42 -- common/autotest_common.sh@941 -- # uname 00:07:03.535 04:51:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:03.535 04:51:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2280804 00:07:03.535 04:51:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:03.535 04:51:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:03.535 04:51:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2280804' 00:07:03.535 killing process with pid 2280804 00:07:03.535 04:51:42 -- common/autotest_common.sh@955 -- # kill 2280804 00:07:03.535 04:51:42 -- common/autotest_common.sh@960 -- # wait 2280804 00:07:03.793 04:51:42 -- accel/accel.sh@76 -- # trap - ERR 00:07:03.793 04:51:42 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:07:03.793 04:51:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:03.793 04:51:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.793 04:51:42 -- common/autotest_common.sh@10 -- # set +x 00:07:04.052 04:51:42 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:07:04.052 04:51:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:04.052 04:51:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.052 04:51:42 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:04.052 04:51:42 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:04.052 04:51:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.052 04:51:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.052 04:51:42 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:04.052 04:51:42 -- accel/accel.sh@40 -- # local IFS=, 00:07:04.052 04:51:42 -- accel/accel.sh@41 -- # jq -r . 00:07:04.052 04:51:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:04.052 04:51:43 -- common/autotest_common.sh@10 -- # set +x 00:07:04.052 04:51:43 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:04.052 04:51:43 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:04.052 04:51:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.052 04:51:43 -- common/autotest_common.sh@10 -- # set +x 00:07:04.052 ************************************ 00:07:04.052 START TEST accel_missing_filename 00:07:04.052 ************************************ 00:07:04.052 04:51:43 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:07:04.052 04:51:43 -- common/autotest_common.sh@638 -- # local es=0 00:07:04.052 04:51:43 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:04.053 04:51:43 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:04.053 04:51:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:04.053 04:51:43 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:04.053 04:51:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:04.053 04:51:43 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:07:04.053 04:51:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:04.053 04:51:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.053 04:51:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:04.053 04:51:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:04.053 04:51:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.053 04:51:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.053 04:51:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:04.053 04:51:43 -- accel/accel.sh@40 -- # local IFS=, 00:07:04.053 04:51:43 -- accel/accel.sh@41 -- # jq -r . 00:07:04.053 [2024-04-23 04:51:43.139012] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:04.053 [2024-04-23 04:51:43.139076] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2280990 ] 00:07:04.053 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.053 [2024-04-23 04:51:43.171252] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:04.053 [2024-04-23 04:51:43.203210] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.311 [2024-04-23 04:51:43.294258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.311 [2024-04-23 04:51:43.355878] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:04.311 [2024-04-23 04:51:43.444504] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:04.573 A filename is required. 00:07:04.573 04:51:43 -- common/autotest_common.sh@641 -- # es=234 00:07:04.573 04:51:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:04.573 04:51:43 -- common/autotest_common.sh@650 -- # es=106 00:07:04.573 04:51:43 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:04.573 04:51:43 -- common/autotest_common.sh@658 -- # es=1 00:07:04.573 04:51:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:04.573 00:07:04.573 real 0m0.407s 00:07:04.573 user 0m0.292s 00:07:04.573 sys 0m0.147s 00:07:04.573 04:51:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:04.573 04:51:43 -- common/autotest_common.sh@10 -- # set +x 00:07:04.573 ************************************ 00:07:04.573 END TEST accel_missing_filename 00:07:04.573 ************************************ 00:07:04.573 04:51:43 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:04.573 04:51:43 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:04.573 04:51:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.573 04:51:43 -- common/autotest_common.sh@10 -- # set +x 00:07:04.573 ************************************ 00:07:04.573 START TEST accel_compress_verify 00:07:04.573 ************************************ 00:07:04.573 04:51:43 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:04.573 04:51:43 -- common/autotest_common.sh@638 -- # local es=0 00:07:04.573 04:51:43 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:04.573 04:51:43 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:04.573 04:51:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:04.573 04:51:43 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:04.573 04:51:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:04.573 04:51:43 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:04.573 04:51:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:04.573 04:51:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.573 04:51:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:04.573 04:51:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:04.573 04:51:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.573 04:51:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.573 04:51:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:04.573 04:51:43 -- accel/accel.sh@40 -- # local IFS=, 00:07:04.573 04:51:43 -- accel/accel.sh@41 -- # jq -r . 00:07:04.573 [2024-04-23 04:51:43.675451] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:04.573 [2024-04-23 04:51:43.675526] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2281084 ] 00:07:04.573 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.573 [2024-04-23 04:51:43.708201] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:04.864 [2024-04-23 04:51:43.740359] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.864 [2024-04-23 04:51:43.832849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.864 [2024-04-23 04:51:43.892190] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:04.864 [2024-04-23 04:51:43.975007] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:05.124 00:07:05.124 Compression does not support the verify option, aborting. 00:07:05.124 04:51:44 -- common/autotest_common.sh@641 -- # es=161 00:07:05.124 04:51:44 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:05.124 04:51:44 -- common/autotest_common.sh@650 -- # es=33 00:07:05.124 04:51:44 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:05.124 04:51:44 -- common/autotest_common.sh@658 -- # es=1 00:07:05.124 04:51:44 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:05.124 00:07:05.124 real 0m0.399s 00:07:05.124 user 0m0.290s 00:07:05.124 sys 0m0.145s 00:07:05.124 04:51:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:05.124 04:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:05.124 ************************************ 00:07:05.124 END TEST accel_compress_verify 00:07:05.124 ************************************ 00:07:05.124 04:51:44 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:05.124 04:51:44 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:05.124 04:51:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.124 04:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:05.124 ************************************ 00:07:05.124 START TEST accel_wrong_workload 00:07:05.124 ************************************ 00:07:05.124 04:51:44 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:07:05.124 04:51:44 -- common/autotest_common.sh@638 -- # local es=0 00:07:05.124 04:51:44 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:05.124 04:51:44 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:05.124 04:51:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:05.124 04:51:44 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:05.124 04:51:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:05.124 04:51:44 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:07:05.124 04:51:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:05.124 04:51:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.124 04:51:44 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:05.124 04:51:44 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:05.124 04:51:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.124 04:51:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.124 04:51:44 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:05.124 04:51:44 -- accel/accel.sh@40 -- # local IFS=, 00:07:05.124 04:51:44 -- accel/accel.sh@41 -- # jq -r . 00:07:05.124 Unsupported workload type: foobar 00:07:05.124 [2024-04-23 04:51:44.191641] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:05.124 accel_perf options: 00:07:05.124 [-h help message] 00:07:05.124 [-q queue depth per core] 00:07:05.124 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:05.124 [-T number of threads per core 00:07:05.124 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:05.124 [-t time in seconds] 00:07:05.124 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:05.124 [ dif_verify, , dif_generate, dif_generate_copy 00:07:05.124 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:05.124 [-l for compress/decompress workloads, name of uncompressed input file 00:07:05.124 [-S for crc32c workload, use this seed value (default 0) 00:07:05.124 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:05.124 [-f for fill workload, use this BYTE value (default 255) 00:07:05.124 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:05.124 [-y verify result if this switch is on] 00:07:05.124 [-a tasks to allocate per core (default: same value as -q)] 00:07:05.124 Can be used to spread operations across a wider range of memory. 00:07:05.125 04:51:44 -- common/autotest_common.sh@641 -- # es=1 00:07:05.125 04:51:44 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:05.125 04:51:44 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:05.125 04:51:44 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:05.125 00:07:05.125 real 0m0.022s 00:07:05.125 user 0m0.010s 00:07:05.125 sys 0m0.011s 00:07:05.125 04:51:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:05.125 04:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:05.125 ************************************ 00:07:05.125 END TEST accel_wrong_workload 00:07:05.125 ************************************ 00:07:05.125 Error: writing output failed: Broken pipe 00:07:05.125 04:51:44 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:05.125 04:51:44 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:05.125 04:51:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.125 04:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:05.384 ************************************ 00:07:05.384 START TEST accel_negative_buffers 00:07:05.384 ************************************ 00:07:05.384 04:51:44 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:05.384 04:51:44 -- common/autotest_common.sh@638 -- # local es=0 00:07:05.384 04:51:44 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:05.384 04:51:44 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:05.384 04:51:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:05.384 04:51:44 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:05.384 04:51:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:05.384 04:51:44 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:07:05.384 04:51:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:05.384 04:51:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.384 04:51:44 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:05.384 04:51:44 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:05.384 04:51:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.384 04:51:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.384 04:51:44 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:05.384 04:51:44 -- accel/accel.sh@40 -- # local IFS=, 00:07:05.384 04:51:44 -- accel/accel.sh@41 -- # jq -r . 00:07:05.384 -x option must be non-negative. 00:07:05.384 [2024-04-23 04:51:44.335846] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:05.384 accel_perf options: 00:07:05.384 [-h help message] 00:07:05.384 [-q queue depth per core] 00:07:05.384 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:05.384 [-T number of threads per core 00:07:05.384 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:05.384 [-t time in seconds] 00:07:05.384 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:05.384 [ dif_verify, , dif_generate, dif_generate_copy 00:07:05.384 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:05.384 [-l for compress/decompress workloads, name of uncompressed input file 00:07:05.384 [-S for crc32c workload, use this seed value (default 0) 00:07:05.384 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:05.384 [-f for fill workload, use this BYTE value (default 255) 00:07:05.384 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:05.384 [-y verify result if this switch is on] 00:07:05.384 [-a tasks to allocate per core (default: same value as -q)] 00:07:05.384 Can be used to spread operations across a wider range of memory. 00:07:05.384 04:51:44 -- common/autotest_common.sh@641 -- # es=1 00:07:05.384 04:51:44 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:05.384 04:51:44 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:05.384 04:51:44 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:05.384 00:07:05.384 real 0m0.022s 00:07:05.384 user 0m0.012s 00:07:05.384 sys 0m0.009s 00:07:05.384 04:51:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:05.384 04:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:05.384 ************************************ 00:07:05.384 END TEST accel_negative_buffers 00:07:05.384 ************************************ 00:07:05.384 Error: writing output failed: Broken pipe 00:07:05.384 04:51:44 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:05.384 04:51:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:05.384 04:51:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.384 04:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:05.384 ************************************ 00:07:05.384 START TEST accel_crc32c 00:07:05.384 ************************************ 00:07:05.384 04:51:44 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:05.384 04:51:44 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.384 04:51:44 -- accel/accel.sh@17 -- # local accel_module 00:07:05.384 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.384 04:51:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:05.384 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.384 04:51:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:05.384 04:51:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.384 04:51:44 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:05.384 04:51:44 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:05.384 04:51:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.384 04:51:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.384 04:51:44 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:05.384 04:51:44 -- accel/accel.sh@40 -- # local IFS=, 00:07:05.384 04:51:44 -- accel/accel.sh@41 -- # jq -r . 00:07:05.384 [2024-04-23 04:51:44.472889] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:05.384 [2024-04-23 04:51:44.472950] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2281232 ] 00:07:05.384 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.384 [2024-04-23 04:51:44.505451] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:05.384 [2024-04-23 04:51:44.535549] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.643 [2024-04-23 04:51:44.626422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val= 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val= 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=0x1 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val= 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val= 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=crc32c 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=32 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val= 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=software 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@22 -- # accel_module=software 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=32 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=32 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=1 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val=Yes 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val= 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:05.643 04:51:44 -- accel/accel.sh@20 -- # val= 00:07:05.643 04:51:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # IFS=: 00:07:05.643 04:51:44 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@20 -- # val= 00:07:07.022 04:51:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # IFS=: 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@20 -- # val= 00:07:07.022 04:51:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # IFS=: 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@20 -- # val= 00:07:07.022 04:51:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # IFS=: 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@20 -- # val= 00:07:07.022 04:51:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # IFS=: 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@20 -- # val= 00:07:07.022 04:51:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # IFS=: 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@20 -- # val= 00:07:07.022 04:51:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # IFS=: 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:07.022 04:51:45 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:07.022 04:51:45 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.022 00:07:07.022 real 0m1.406s 00:07:07.022 user 0m1.262s 00:07:07.022 sys 0m0.146s 00:07:07.022 04:51:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:07.022 04:51:45 -- common/autotest_common.sh@10 -- # set +x 00:07:07.022 ************************************ 00:07:07.022 END TEST accel_crc32c 00:07:07.022 ************************************ 00:07:07.022 04:51:45 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:07.022 04:51:45 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:07.022 04:51:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.022 04:51:45 -- common/autotest_common.sh@10 -- # set +x 00:07:07.022 ************************************ 00:07:07.022 START TEST accel_crc32c_C2 00:07:07.022 ************************************ 00:07:07.022 04:51:45 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:07.022 04:51:45 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.022 04:51:45 -- accel/accel.sh@17 -- # local accel_module 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # IFS=: 00:07:07.022 04:51:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:07.022 04:51:45 -- accel/accel.sh@19 -- # read -r var val 00:07:07.022 04:51:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:07.022 04:51:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.022 04:51:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:07.022 04:51:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:07.022 04:51:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.022 04:51:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.022 04:51:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:07.022 04:51:45 -- accel/accel.sh@40 -- # local IFS=, 00:07:07.022 04:51:45 -- accel/accel.sh@41 -- # jq -r . 00:07:07.022 [2024-04-23 04:51:45.993908] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:07.022 [2024-04-23 04:51:45.993964] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2281504 ] 00:07:07.022 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.022 [2024-04-23 04:51:46.025841] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:07.022 [2024-04-23 04:51:46.056267] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.022 [2024-04-23 04:51:46.146358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.280 04:51:46 -- accel/accel.sh@20 -- # val= 00:07:07.280 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.280 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.280 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.280 04:51:46 -- accel/accel.sh@20 -- # val= 00:07:07.280 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.280 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.280 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.280 04:51:46 -- accel/accel.sh@20 -- # val=0x1 00:07:07.280 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.280 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.280 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.280 04:51:46 -- accel/accel.sh@20 -- # val= 00:07:07.280 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.280 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val= 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val=crc32c 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val=0 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val= 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val=software 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@22 -- # accel_module=software 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val=32 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val=32 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val=1 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val=Yes 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val= 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:07.281 04:51:46 -- accel/accel.sh@20 -- # val= 00:07:07.281 04:51:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # IFS=: 00:07:07.281 04:51:46 -- accel/accel.sh@19 -- # read -r var val 00:07:08.216 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.216 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.216 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.216 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.216 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.216 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.216 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.216 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.216 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.216 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.216 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.216 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.216 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.216 04:51:47 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:08.216 04:51:47 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:08.216 04:51:47 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:08.216 00:07:08.216 real 0m1.399s 00:07:08.216 user 0m1.271s 00:07:08.216 sys 0m0.129s 00:07:08.216 04:51:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:08.216 04:51:47 -- common/autotest_common.sh@10 -- # set +x 00:07:08.216 ************************************ 00:07:08.216 END TEST accel_crc32c_C2 00:07:08.216 ************************************ 00:07:08.474 04:51:47 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:08.474 04:51:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:08.474 04:51:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:08.474 04:51:47 -- common/autotest_common.sh@10 -- # set +x 00:07:08.474 ************************************ 00:07:08.474 START TEST accel_copy 00:07:08.474 ************************************ 00:07:08.474 04:51:47 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:07:08.474 04:51:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:08.474 04:51:47 -- accel/accel.sh@17 -- # local accel_module 00:07:08.474 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.474 04:51:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:08.474 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.474 04:51:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:08.474 04:51:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.474 04:51:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:08.474 04:51:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:08.474 04:51:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.474 04:51:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.474 04:51:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:08.474 04:51:47 -- accel/accel.sh@40 -- # local IFS=, 00:07:08.474 04:51:47 -- accel/accel.sh@41 -- # jq -r . 00:07:08.474 [2024-04-23 04:51:47.514417] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:08.474 [2024-04-23 04:51:47.514483] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2281674 ] 00:07:08.474 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.474 [2024-04-23 04:51:47.545962] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:08.474 [2024-04-23 04:51:47.575638] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.734 [2024-04-23 04:51:47.663955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val=0x1 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val=copy 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@23 -- # accel_opc=copy 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val=software 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@22 -- # accel_module=software 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val=32 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val=32 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val=1 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val=Yes 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:08.734 04:51:47 -- accel/accel.sh@20 -- # val= 00:07:08.734 04:51:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # IFS=: 00:07:08.734 04:51:47 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:48 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:48 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:48 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:48 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:48 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:48 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:48 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:48 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:10.114 04:51:48 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:07:10.114 04:51:48 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.114 00:07:10.114 real 0m1.393s 00:07:10.114 user 0m1.253s 00:07:10.114 sys 0m0.141s 00:07:10.114 04:51:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:10.114 04:51:48 -- common/autotest_common.sh@10 -- # set +x 00:07:10.114 ************************************ 00:07:10.114 END TEST accel_copy 00:07:10.114 ************************************ 00:07:10.114 04:51:48 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:10.114 04:51:48 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:10.114 04:51:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.114 04:51:48 -- common/autotest_common.sh@10 -- # set +x 00:07:10.114 ************************************ 00:07:10.114 START TEST accel_fill 00:07:10.114 ************************************ 00:07:10.114 04:51:49 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:10.114 04:51:49 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.114 04:51:49 -- accel/accel.sh@17 -- # local accel_module 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:10.114 04:51:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.114 04:51:49 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:10.114 04:51:49 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:10.114 04:51:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.114 04:51:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.114 04:51:49 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:10.114 04:51:49 -- accel/accel.sh@40 -- # local IFS=, 00:07:10.114 04:51:49 -- accel/accel.sh@41 -- # jq -r . 00:07:10.114 [2024-04-23 04:51:49.023151] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:10.114 [2024-04-23 04:51:49.023215] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2281836 ] 00:07:10.114 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.114 [2024-04-23 04:51:49.055600] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:10.114 [2024-04-23 04:51:49.085582] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.114 [2024-04-23 04:51:49.176874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val=0x1 00:07:10.114 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val= 00:07:10.114 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val=fill 00:07:10.114 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:49 -- accel/accel.sh@23 -- # accel_opc=fill 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val=0x80 00:07:10.114 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.114 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.114 04:51:49 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val= 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val=software 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@22 -- # accel_module=software 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val=64 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val=64 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val=1 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val=Yes 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val= 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:10.115 04:51:49 -- accel/accel.sh@20 -- # val= 00:07:10.115 04:51:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # IFS=: 00:07:10.115 04:51:49 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.495 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.495 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.495 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.495 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.495 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.495 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:11.495 04:51:50 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:07:11.495 04:51:50 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:11.495 00:07:11.495 real 0m1.406s 00:07:11.495 user 0m1.269s 00:07:11.495 sys 0m0.138s 00:07:11.495 04:51:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:11.495 04:51:50 -- common/autotest_common.sh@10 -- # set +x 00:07:11.495 ************************************ 00:07:11.495 END TEST accel_fill 00:07:11.495 ************************************ 00:07:11.495 04:51:50 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:11.495 04:51:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:11.495 04:51:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.495 04:51:50 -- common/autotest_common.sh@10 -- # set +x 00:07:11.495 ************************************ 00:07:11.495 START TEST accel_copy_crc32c 00:07:11.495 ************************************ 00:07:11.495 04:51:50 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:07:11.495 04:51:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:11.495 04:51:50 -- accel/accel.sh@17 -- # local accel_module 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.495 04:51:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:11.495 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.495 04:51:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:11.495 04:51:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.495 04:51:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:11.495 04:51:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:11.495 04:51:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.495 04:51:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.495 04:51:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:11.495 04:51:50 -- accel/accel.sh@40 -- # local IFS=, 00:07:11.495 04:51:50 -- accel/accel.sh@41 -- # jq -r . 00:07:11.495 [2024-04-23 04:51:50.549590] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:11.495 [2024-04-23 04:51:50.549645] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2282118 ] 00:07:11.495 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.495 [2024-04-23 04:51:50.581737] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:11.495 [2024-04-23 04:51:50.611537] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.755 [2024-04-23 04:51:50.702618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=0x1 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=0 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=software 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@22 -- # accel_module=software 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=32 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=32 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=1 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val=Yes 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:11.755 04:51:50 -- accel/accel.sh@20 -- # val= 00:07:11.755 04:51:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # IFS=: 00:07:11.755 04:51:50 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:51 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:51 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:51 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:51 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:51 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:51 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:51 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:51 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:13.134 04:51:51 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:13.134 04:51:51 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.134 00:07:13.134 real 0m1.404s 00:07:13.134 user 0m1.265s 00:07:13.134 sys 0m0.140s 00:07:13.134 04:51:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:13.134 04:51:51 -- common/autotest_common.sh@10 -- # set +x 00:07:13.134 ************************************ 00:07:13.134 END TEST accel_copy_crc32c 00:07:13.134 ************************************ 00:07:13.134 04:51:51 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:13.134 04:51:51 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:13.134 04:51:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.134 04:51:51 -- common/autotest_common.sh@10 -- # set +x 00:07:13.134 ************************************ 00:07:13.134 START TEST accel_copy_crc32c_C2 00:07:13.134 ************************************ 00:07:13.134 04:51:52 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:13.134 04:51:52 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.134 04:51:52 -- accel/accel.sh@17 -- # local accel_module 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:13.134 04:51:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.134 04:51:52 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:13.134 04:51:52 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:13.134 04:51:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.134 04:51:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.134 04:51:52 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:13.134 04:51:52 -- accel/accel.sh@40 -- # local IFS=, 00:07:13.134 04:51:52 -- accel/accel.sh@41 -- # jq -r . 00:07:13.134 [2024-04-23 04:51:52.073037] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:13.134 [2024-04-23 04:51:52.073101] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2282281 ] 00:07:13.134 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.134 [2024-04-23 04:51:52.105964] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:13.134 [2024-04-23 04:51:52.136237] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.134 [2024-04-23 04:51:52.223729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=0x1 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=0 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val='8192 bytes' 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=software 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@22 -- # accel_module=software 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=32 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=32 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=1 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val=Yes 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:13.134 04:51:52 -- accel/accel.sh@20 -- # val= 00:07:13.134 04:51:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # IFS=: 00:07:13.134 04:51:52 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.513 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.513 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.513 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.513 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.513 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.513 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:14.513 04:51:53 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:14.513 04:51:53 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:14.513 00:07:14.513 real 0m1.399s 00:07:14.513 user 0m1.259s 00:07:14.513 sys 0m0.142s 00:07:14.513 04:51:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:14.513 04:51:53 -- common/autotest_common.sh@10 -- # set +x 00:07:14.513 ************************************ 00:07:14.513 END TEST accel_copy_crc32c_C2 00:07:14.513 ************************************ 00:07:14.513 04:51:53 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:14.513 04:51:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:14.513 04:51:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.513 04:51:53 -- common/autotest_common.sh@10 -- # set +x 00:07:14.513 ************************************ 00:07:14.513 START TEST accel_dualcast 00:07:14.513 ************************************ 00:07:14.513 04:51:53 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:07:14.513 04:51:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:14.513 04:51:53 -- accel/accel.sh@17 -- # local accel_module 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.513 04:51:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:14.513 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.513 04:51:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:14.513 04:51:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.513 04:51:53 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:14.513 04:51:53 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:14.513 04:51:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.513 04:51:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.513 04:51:53 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:14.513 04:51:53 -- accel/accel.sh@40 -- # local IFS=, 00:07:14.513 04:51:53 -- accel/accel.sh@41 -- # jq -r . 00:07:14.513 [2024-04-23 04:51:53.597397] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:14.513 [2024-04-23 04:51:53.597462] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2282451 ] 00:07:14.513 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.513 [2024-04-23 04:51:53.629606] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:14.513 [2024-04-23 04:51:53.659444] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.774 [2024-04-23 04:51:53.750657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val=0x1 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val=dualcast 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val=software 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@22 -- # accel_module=software 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val=32 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val=32 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val=1 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val=Yes 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:14.774 04:51:53 -- accel/accel.sh@20 -- # val= 00:07:14.774 04:51:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # IFS=: 00:07:14.774 04:51:53 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:54 -- accel/accel.sh@20 -- # val= 00:07:16.153 04:51:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # IFS=: 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:54 -- accel/accel.sh@20 -- # val= 00:07:16.153 04:51:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # IFS=: 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:54 -- accel/accel.sh@20 -- # val= 00:07:16.153 04:51:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # IFS=: 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:54 -- accel/accel.sh@20 -- # val= 00:07:16.153 04:51:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # IFS=: 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:54 -- accel/accel.sh@20 -- # val= 00:07:16.153 04:51:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # IFS=: 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:54 -- accel/accel.sh@20 -- # val= 00:07:16.153 04:51:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # IFS=: 00:07:16.153 04:51:54 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:54 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:16.153 04:51:54 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:07:16.153 04:51:54 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.153 00:07:16.153 real 0m1.404s 00:07:16.153 user 0m1.272s 00:07:16.153 sys 0m0.133s 00:07:16.153 04:51:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:16.153 04:51:54 -- common/autotest_common.sh@10 -- # set +x 00:07:16.153 ************************************ 00:07:16.153 END TEST accel_dualcast 00:07:16.153 ************************************ 00:07:16.153 04:51:55 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:16.153 04:51:55 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:16.153 04:51:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.153 04:51:55 -- common/autotest_common.sh@10 -- # set +x 00:07:16.153 ************************************ 00:07:16.153 START TEST accel_compare 00:07:16.153 ************************************ 00:07:16.153 04:51:55 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:07:16.153 04:51:55 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.153 04:51:55 -- accel/accel.sh@17 -- # local accel_module 00:07:16.153 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.153 04:51:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:16.153 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.153 04:51:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:16.153 04:51:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.153 04:51:55 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:16.153 04:51:55 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:16.153 04:51:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.153 04:51:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.153 04:51:55 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:16.153 04:51:55 -- accel/accel.sh@40 -- # local IFS=, 00:07:16.153 04:51:55 -- accel/accel.sh@41 -- # jq -r . 00:07:16.153 [2024-04-23 04:51:55.124003] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:16.153 [2024-04-23 04:51:55.124068] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2282726 ] 00:07:16.153 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.153 [2024-04-23 04:51:55.155959] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:16.153 [2024-04-23 04:51:55.185759] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.153 [2024-04-23 04:51:55.276241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.411 04:51:55 -- accel/accel.sh@20 -- # val= 00:07:16.411 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.411 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.411 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.411 04:51:55 -- accel/accel.sh@20 -- # val= 00:07:16.411 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val=0x1 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val= 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val= 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val=compare 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@23 -- # accel_opc=compare 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val= 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val=software 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@22 -- # accel_module=software 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val=32 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val=32 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val=1 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val=Yes 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val= 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:16.412 04:51:55 -- accel/accel.sh@20 -- # val= 00:07:16.412 04:51:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # IFS=: 00:07:16.412 04:51:55 -- accel/accel.sh@19 -- # read -r var val 00:07:17.349 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.349 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.349 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.349 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.349 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.349 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.349 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.349 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.349 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.349 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.349 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.349 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.349 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.349 04:51:56 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:17.349 04:51:56 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:07:17.349 04:51:56 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:17.349 00:07:17.349 real 0m1.404s 00:07:17.349 user 0m1.258s 00:07:17.349 sys 0m0.148s 00:07:17.349 04:51:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:17.349 04:51:56 -- common/autotest_common.sh@10 -- # set +x 00:07:17.349 ************************************ 00:07:17.349 END TEST accel_compare 00:07:17.349 ************************************ 00:07:17.608 04:51:56 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:17.608 04:51:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:17.608 04:51:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.608 04:51:56 -- common/autotest_common.sh@10 -- # set +x 00:07:17.608 ************************************ 00:07:17.608 START TEST accel_xor 00:07:17.608 ************************************ 00:07:17.608 04:51:56 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:07:17.608 04:51:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:17.608 04:51:56 -- accel/accel.sh@17 -- # local accel_module 00:07:17.608 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.608 04:51:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:17.608 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.608 04:51:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:17.608 04:51:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.608 04:51:56 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:17.608 04:51:56 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:17.608 04:51:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.608 04:51:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.608 04:51:56 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:17.608 04:51:56 -- accel/accel.sh@40 -- # local IFS=, 00:07:17.608 04:51:56 -- accel/accel.sh@41 -- # jq -r . 00:07:17.608 [2024-04-23 04:51:56.647676] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:17.608 [2024-04-23 04:51:56.647738] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2282893 ] 00:07:17.608 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.608 [2024-04-23 04:51:56.679500] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:17.608 [2024-04-23 04:51:56.709439] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.867 [2024-04-23 04:51:56.797010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.867 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.867 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.867 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.867 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.867 04:51:56 -- accel/accel.sh@20 -- # val=0x1 00:07:17.867 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.867 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.867 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.867 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.867 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.867 04:51:56 -- accel/accel.sh@20 -- # val=xor 00:07:17.867 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.867 04:51:56 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:17.867 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val=2 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val=software 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@22 -- # accel_module=software 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val=32 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val=32 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val=1 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val=Yes 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:17.868 04:51:56 -- accel/accel.sh@20 -- # val= 00:07:17.868 04:51:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # IFS=: 00:07:17.868 04:51:56 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:19.247 04:51:58 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:19.247 04:51:58 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.247 00:07:19.247 real 0m1.395s 00:07:19.247 user 0m1.260s 00:07:19.247 sys 0m0.136s 00:07:19.247 04:51:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:19.247 04:51:58 -- common/autotest_common.sh@10 -- # set +x 00:07:19.247 ************************************ 00:07:19.247 END TEST accel_xor 00:07:19.247 ************************************ 00:07:19.247 04:51:58 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:19.247 04:51:58 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:19.247 04:51:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.247 04:51:58 -- common/autotest_common.sh@10 -- # set +x 00:07:19.247 ************************************ 00:07:19.247 START TEST accel_xor 00:07:19.247 ************************************ 00:07:19.247 04:51:58 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:07:19.247 04:51:58 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.247 04:51:58 -- accel/accel.sh@17 -- # local accel_module 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:19.247 04:51:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.247 04:51:58 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:19.247 04:51:58 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:19.247 04:51:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.247 04:51:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.247 04:51:58 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:19.247 04:51:58 -- accel/accel.sh@40 -- # local IFS=, 00:07:19.247 04:51:58 -- accel/accel.sh@41 -- # jq -r . 00:07:19.247 [2024-04-23 04:51:58.164605] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:19.247 [2024-04-23 04:51:58.164679] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2283061 ] 00:07:19.247 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.247 [2024-04-23 04:51:58.196635] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:19.247 [2024-04-23 04:51:58.228354] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.247 [2024-04-23 04:51:58.318488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val=0x1 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val=xor 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val=3 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val=software 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@22 -- # accel_module=software 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val=32 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.247 04:51:58 -- accel/accel.sh@20 -- # val=32 00:07:19.247 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.247 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.248 04:51:58 -- accel/accel.sh@20 -- # val=1 00:07:19.248 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.248 04:51:58 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:19.248 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.248 04:51:58 -- accel/accel.sh@20 -- # val=Yes 00:07:19.248 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.248 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.248 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:19.248 04:51:58 -- accel/accel.sh@20 -- # val= 00:07:19.248 04:51:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # IFS=: 00:07:19.248 04:51:58 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.647 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.647 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.647 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.647 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.647 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.647 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:20.647 04:51:59 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:20.647 04:51:59 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:20.647 00:07:20.647 real 0m1.405s 00:07:20.647 user 0m1.265s 00:07:20.647 sys 0m0.142s 00:07:20.647 04:51:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:20.647 04:51:59 -- common/autotest_common.sh@10 -- # set +x 00:07:20.647 ************************************ 00:07:20.647 END TEST accel_xor 00:07:20.647 ************************************ 00:07:20.647 04:51:59 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:20.647 04:51:59 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:20.647 04:51:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.647 04:51:59 -- common/autotest_common.sh@10 -- # set +x 00:07:20.647 ************************************ 00:07:20.647 START TEST accel_dif_verify 00:07:20.647 ************************************ 00:07:20.647 04:51:59 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:07:20.647 04:51:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:20.647 04:51:59 -- accel/accel.sh@17 -- # local accel_module 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.647 04:51:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:20.647 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.647 04:51:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:20.648 04:51:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.648 04:51:59 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:20.648 04:51:59 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:20.648 04:51:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.648 04:51:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.648 04:51:59 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:20.648 04:51:59 -- accel/accel.sh@40 -- # local IFS=, 00:07:20.648 04:51:59 -- accel/accel.sh@41 -- # jq -r . 00:07:20.648 [2024-04-23 04:51:59.695142] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:20.648 [2024-04-23 04:51:59.695207] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2283338 ] 00:07:20.648 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.648 [2024-04-23 04:51:59.728059] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:20.648 [2024-04-23 04:51:59.758439] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.910 [2024-04-23 04:51:59.848843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val=0x1 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val=dif_verify 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val=software 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@22 -- # accel_module=software 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val=32 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val=32 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val=1 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val=No 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:20.910 04:51:59 -- accel/accel.sh@20 -- # val= 00:07:20.910 04:51:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # IFS=: 00:07:20.910 04:51:59 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:22.289 04:52:01 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:07:22.289 04:52:01 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.289 00:07:22.289 real 0m1.408s 00:07:22.289 user 0m1.261s 00:07:22.289 sys 0m0.150s 00:07:22.289 04:52:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:22.289 04:52:01 -- common/autotest_common.sh@10 -- # set +x 00:07:22.289 ************************************ 00:07:22.289 END TEST accel_dif_verify 00:07:22.289 ************************************ 00:07:22.289 04:52:01 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:22.289 04:52:01 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:22.289 04:52:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.289 04:52:01 -- common/autotest_common.sh@10 -- # set +x 00:07:22.289 ************************************ 00:07:22.289 START TEST accel_dif_generate 00:07:22.289 ************************************ 00:07:22.289 04:52:01 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:07:22.289 04:52:01 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.289 04:52:01 -- accel/accel.sh@17 -- # local accel_module 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:22.289 04:52:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.289 04:52:01 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:22.289 04:52:01 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:22.289 04:52:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.289 04:52:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.289 04:52:01 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:22.289 04:52:01 -- accel/accel.sh@40 -- # local IFS=, 00:07:22.289 04:52:01 -- accel/accel.sh@41 -- # jq -r . 00:07:22.289 [2024-04-23 04:52:01.228399] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:22.289 [2024-04-23 04:52:01.228468] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2283508 ] 00:07:22.289 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.289 [2024-04-23 04:52:01.260666] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:22.289 [2024-04-23 04:52:01.291310] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.289 [2024-04-23 04:52:01.378898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.289 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.289 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.289 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val=0x1 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val=dif_generate 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val=software 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@22 -- # accel_module=software 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val=32 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val=32 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val=1 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val=No 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:22.290 04:52:01 -- accel/accel.sh@20 -- # val= 00:07:22.290 04:52:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # IFS=: 00:07:22.290 04:52:01 -- accel/accel.sh@19 -- # read -r var val 00:07:23.670 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.670 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.670 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.670 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.670 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.670 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.670 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.670 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.670 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.670 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.670 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.670 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.670 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.670 04:52:02 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:23.670 04:52:02 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:07:23.670 04:52:02 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:23.670 00:07:23.670 real 0m1.403s 00:07:23.670 user 0m1.258s 00:07:23.670 sys 0m0.149s 00:07:23.670 04:52:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:23.670 04:52:02 -- common/autotest_common.sh@10 -- # set +x 00:07:23.670 ************************************ 00:07:23.670 END TEST accel_dif_generate 00:07:23.670 ************************************ 00:07:23.671 04:52:02 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:23.671 04:52:02 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:23.671 04:52:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.671 04:52:02 -- common/autotest_common.sh@10 -- # set +x 00:07:23.671 ************************************ 00:07:23.671 START TEST accel_dif_generate_copy 00:07:23.671 ************************************ 00:07:23.671 04:52:02 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:07:23.671 04:52:02 -- accel/accel.sh@16 -- # local accel_opc 00:07:23.671 04:52:02 -- accel/accel.sh@17 -- # local accel_module 00:07:23.671 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.671 04:52:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:23.671 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.671 04:52:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:23.671 04:52:02 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.671 04:52:02 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:23.671 04:52:02 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:23.671 04:52:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.671 04:52:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.671 04:52:02 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:23.671 04:52:02 -- accel/accel.sh@40 -- # local IFS=, 00:07:23.671 04:52:02 -- accel/accel.sh@41 -- # jq -r . 00:07:23.671 [2024-04-23 04:52:02.762880] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:23.671 [2024-04-23 04:52:02.762945] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2283672 ] 00:07:23.671 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.671 [2024-04-23 04:52:02.795636] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:23.671 [2024-04-23 04:52:02.825548] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.930 [2024-04-23 04:52:02.917612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.930 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.930 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.930 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.930 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.930 04:52:02 -- accel/accel.sh@20 -- # val=0x1 00:07:23.930 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.930 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.930 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.930 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.930 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val=software 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@22 -- # accel_module=software 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val=32 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val=32 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val=1 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val=No 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:23.931 04:52:02 -- accel/accel.sh@20 -- # val= 00:07:23.931 04:52:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # IFS=: 00:07:23.931 04:52:02 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.305 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.305 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.305 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.305 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.305 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.305 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:25.305 04:52:04 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:07:25.305 04:52:04 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:25.305 00:07:25.305 real 0m1.400s 00:07:25.305 user 0m1.255s 00:07:25.305 sys 0m0.146s 00:07:25.305 04:52:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:25.305 04:52:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.305 ************************************ 00:07:25.305 END TEST accel_dif_generate_copy 00:07:25.305 ************************************ 00:07:25.305 04:52:04 -- accel/accel.sh@115 -- # [[ y == y ]] 00:07:25.305 04:52:04 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.305 04:52:04 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:25.305 04:52:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.305 04:52:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.305 ************************************ 00:07:25.305 START TEST accel_comp 00:07:25.305 ************************************ 00:07:25.305 04:52:04 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.305 04:52:04 -- accel/accel.sh@16 -- # local accel_opc 00:07:25.305 04:52:04 -- accel/accel.sh@17 -- # local accel_module 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.305 04:52:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.305 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.305 04:52:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.305 04:52:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.305 04:52:04 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:25.305 04:52:04 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:25.305 04:52:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.305 04:52:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.305 04:52:04 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:25.305 04:52:04 -- accel/accel.sh@40 -- # local IFS=, 00:07:25.305 04:52:04 -- accel/accel.sh@41 -- # jq -r . 00:07:25.305 [2024-04-23 04:52:04.290179] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:25.305 [2024-04-23 04:52:04.290245] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2283950 ] 00:07:25.305 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.305 [2024-04-23 04:52:04.322390] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:25.305 [2024-04-23 04:52:04.351952] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.305 [2024-04-23 04:52:04.442648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.563 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.563 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=0x1 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=compress 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@23 -- # accel_opc=compress 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=software 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@22 -- # accel_module=software 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=32 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=32 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=1 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val=No 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:25.564 04:52:04 -- accel/accel.sh@20 -- # val= 00:07:25.564 04:52:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # IFS=: 00:07:25.564 04:52:04 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:26.944 04:52:05 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:07:26.944 04:52:05 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:26.944 00:07:26.944 real 0m1.411s 00:07:26.944 user 0m1.274s 00:07:26.944 sys 0m0.140s 00:07:26.944 04:52:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:26.944 04:52:05 -- common/autotest_common.sh@10 -- # set +x 00:07:26.944 ************************************ 00:07:26.944 END TEST accel_comp 00:07:26.944 ************************************ 00:07:26.944 04:52:05 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:26.944 04:52:05 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:26.944 04:52:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.944 04:52:05 -- common/autotest_common.sh@10 -- # set +x 00:07:26.944 ************************************ 00:07:26.944 START TEST accel_decomp 00:07:26.944 ************************************ 00:07:26.944 04:52:05 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:26.944 04:52:05 -- accel/accel.sh@16 -- # local accel_opc 00:07:26.944 04:52:05 -- accel/accel.sh@17 -- # local accel_module 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:26.944 04:52:05 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:26.944 04:52:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.944 04:52:05 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:26.944 04:52:05 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:26.944 04:52:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.944 04:52:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.944 04:52:05 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:26.944 04:52:05 -- accel/accel.sh@40 -- # local IFS=, 00:07:26.944 04:52:05 -- accel/accel.sh@41 -- # jq -r . 00:07:26.944 [2024-04-23 04:52:05.823611] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:26.944 [2024-04-23 04:52:05.823674] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2284114 ] 00:07:26.944 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.944 [2024-04-23 04:52:05.855602] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:26.944 [2024-04-23 04:52:05.884876] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.944 [2024-04-23 04:52:05.972206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=0x1 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=decompress 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=software 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@22 -- # accel_module=software 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=32 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=32 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=1 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val=Yes 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:26.944 04:52:06 -- accel/accel.sh@20 -- # val= 00:07:26.944 04:52:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # IFS=: 00:07:26.944 04:52:06 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.325 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.325 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.325 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.325 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.325 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.325 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:28.325 04:52:07 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:28.325 04:52:07 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:28.325 00:07:28.325 real 0m1.397s 00:07:28.325 user 0m1.263s 00:07:28.325 sys 0m0.137s 00:07:28.325 04:52:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:28.325 04:52:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.325 ************************************ 00:07:28.325 END TEST accel_decomp 00:07:28.325 ************************************ 00:07:28.325 04:52:07 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:28.325 04:52:07 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:28.325 04:52:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.325 04:52:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.325 ************************************ 00:07:28.325 START TEST accel_decmop_full 00:07:28.325 ************************************ 00:07:28.325 04:52:07 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:28.325 04:52:07 -- accel/accel.sh@16 -- # local accel_opc 00:07:28.325 04:52:07 -- accel/accel.sh@17 -- # local accel_module 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.325 04:52:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:28.325 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.325 04:52:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:28.325 04:52:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.325 04:52:07 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:28.325 04:52:07 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:28.325 04:52:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.325 04:52:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.325 04:52:07 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:28.325 04:52:07 -- accel/accel.sh@40 -- # local IFS=, 00:07:28.325 04:52:07 -- accel/accel.sh@41 -- # jq -r . 00:07:28.325 [2024-04-23 04:52:07.340742] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:28.325 [2024-04-23 04:52:07.340804] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2284285 ] 00:07:28.325 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.325 [2024-04-23 04:52:07.373081] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:28.325 [2024-04-23 04:52:07.402931] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.586 [2024-04-23 04:52:07.495940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=0x1 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=decompress 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=software 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@22 -- # accel_module=software 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=32 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=32 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=1 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val=Yes 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:28.586 04:52:07 -- accel/accel.sh@20 -- # val= 00:07:28.586 04:52:07 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # IFS=: 00:07:28.586 04:52:07 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:08 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:08 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:08 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:08 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:08 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:08 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:29.964 04:52:08 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:29.964 04:52:08 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:29.964 00:07:29.964 real 0m1.419s 00:07:29.964 user 0m1.278s 00:07:29.964 sys 0m0.143s 00:07:29.964 04:52:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:29.964 04:52:08 -- common/autotest_common.sh@10 -- # set +x 00:07:29.964 ************************************ 00:07:29.964 END TEST accel_decmop_full 00:07:29.964 ************************************ 00:07:29.964 04:52:08 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.964 04:52:08 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:29.964 04:52:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.964 04:52:08 -- common/autotest_common.sh@10 -- # set +x 00:07:29.964 ************************************ 00:07:29.964 START TEST accel_decomp_mcore 00:07:29.964 ************************************ 00:07:29.964 04:52:08 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.964 04:52:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:29.964 04:52:08 -- accel/accel.sh@17 -- # local accel_module 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.964 04:52:08 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:29.964 04:52:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.964 04:52:08 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:29.964 04:52:08 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:29.964 04:52:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.964 04:52:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.964 04:52:08 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:29.964 04:52:08 -- accel/accel.sh@40 -- # local IFS=, 00:07:29.964 04:52:08 -- accel/accel.sh@41 -- # jq -r . 00:07:29.964 [2024-04-23 04:52:08.877416] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:29.964 [2024-04-23 04:52:08.877479] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2284559 ] 00:07:29.964 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.964 [2024-04-23 04:52:08.910133] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:29.964 [2024-04-23 04:52:08.939325] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:29.964 [2024-04-23 04:52:09.033419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:29.964 [2024-04-23 04:52:09.033487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:29.964 [2024-04-23 04:52:09.033579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:29.964 [2024-04-23 04:52:09.033582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val=0xf 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val=decompress 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val=software 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@22 -- # accel_module=software 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.964 04:52:09 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:29.964 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.964 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.965 04:52:09 -- accel/accel.sh@20 -- # val=32 00:07:29.965 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.965 04:52:09 -- accel/accel.sh@20 -- # val=32 00:07:29.965 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.965 04:52:09 -- accel/accel.sh@20 -- # val=1 00:07:29.965 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.965 04:52:09 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:29.965 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.965 04:52:09 -- accel/accel.sh@20 -- # val=Yes 00:07:29.965 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.965 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.965 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:29.965 04:52:09 -- accel/accel.sh@20 -- # val= 00:07:29.965 04:52:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # IFS=: 00:07:29.965 04:52:09 -- accel/accel.sh@19 -- # read -r var val 00:07:31.340 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.340 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.340 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.340 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.340 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.340 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.340 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.340 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.340 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.340 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.340 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.340 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.341 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.341 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.341 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.341 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.341 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.341 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.341 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.341 04:52:10 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:31.341 04:52:10 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:31.341 04:52:10 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:31.341 00:07:31.341 real 0m1.411s 00:07:31.341 user 0m4.718s 00:07:31.341 sys 0m0.155s 00:07:31.341 04:52:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:31.341 04:52:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.341 ************************************ 00:07:31.341 END TEST accel_decomp_mcore 00:07:31.341 ************************************ 00:07:31.341 04:52:10 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:31.341 04:52:10 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:31.341 04:52:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.341 04:52:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.341 ************************************ 00:07:31.341 START TEST accel_decomp_full_mcore 00:07:31.341 ************************************ 00:07:31.341 04:52:10 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:31.341 04:52:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:31.341 04:52:10 -- accel/accel.sh@17 -- # local accel_module 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.341 04:52:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:31.341 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.341 04:52:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:31.341 04:52:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.341 04:52:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:31.341 04:52:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:31.341 04:52:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.341 04:52:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.341 04:52:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:31.341 04:52:10 -- accel/accel.sh@40 -- # local IFS=, 00:07:31.341 04:52:10 -- accel/accel.sh@41 -- # jq -r . 00:07:31.341 [2024-04-23 04:52:10.406437] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:31.341 [2024-04-23 04:52:10.406501] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2284730 ] 00:07:31.341 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.341 [2024-04-23 04:52:10.438232] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:31.341 [2024-04-23 04:52:10.467889] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:31.601 [2024-04-23 04:52:10.559799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:31.601 [2024-04-23 04:52:10.559875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:31.601 [2024-04-23 04:52:10.559968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:31.601 [2024-04-23 04:52:10.559970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=0xf 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=decompress 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=software 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@22 -- # accel_module=software 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=32 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=32 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=1 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val=Yes 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:31.601 04:52:10 -- accel/accel.sh@20 -- # val= 00:07:31.601 04:52:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # IFS=: 00:07:31.601 04:52:10 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@20 -- # val= 00:07:32.985 04:52:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:32.985 04:52:11 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:32.985 04:52:11 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:32.985 00:07:32.985 real 0m1.421s 00:07:32.985 user 0m4.750s 00:07:32.985 sys 0m0.158s 00:07:32.985 04:52:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:32.985 04:52:11 -- common/autotest_common.sh@10 -- # set +x 00:07:32.985 ************************************ 00:07:32.985 END TEST accel_decomp_full_mcore 00:07:32.985 ************************************ 00:07:32.985 04:52:11 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:32.985 04:52:11 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:32.985 04:52:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:32.985 04:52:11 -- common/autotest_common.sh@10 -- # set +x 00:07:32.985 ************************************ 00:07:32.985 START TEST accel_decomp_mthread 00:07:32.985 ************************************ 00:07:32.985 04:52:11 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:32.985 04:52:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:32.985 04:52:11 -- accel/accel.sh@17 -- # local accel_module 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # IFS=: 00:07:32.985 04:52:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:32.985 04:52:11 -- accel/accel.sh@19 -- # read -r var val 00:07:32.985 04:52:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:32.985 04:52:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.985 04:52:11 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:32.985 04:52:11 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:32.985 04:52:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.985 04:52:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.985 04:52:11 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:32.985 04:52:11 -- accel/accel.sh@40 -- # local IFS=, 00:07:32.985 04:52:11 -- accel/accel.sh@41 -- # jq -r . 00:07:32.985 [2024-04-23 04:52:11.942737] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:32.985 [2024-04-23 04:52:11.942803] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2284897 ] 00:07:32.985 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.985 [2024-04-23 04:52:11.975205] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:32.985 [2024-04-23 04:52:12.005339] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:32.985 [2024-04-23 04:52:12.100118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.245 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.245 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.245 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.245 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.245 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.245 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.245 04:52:12 -- accel/accel.sh@20 -- # val=0x1 00:07:33.245 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.245 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.245 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val=decompress 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val=software 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@22 -- # accel_module=software 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val=32 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val=32 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val=2 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val=Yes 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:33.246 04:52:12 -- accel/accel.sh@20 -- # val= 00:07:33.246 04:52:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # IFS=: 00:07:33.246 04:52:12 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.185 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.185 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.185 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.185 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.185 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.185 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.185 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.185 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.185 04:52:13 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:34.185 04:52:13 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:34.185 04:52:13 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:34.185 00:07:34.185 real 0m1.417s 00:07:34.185 user 0m1.271s 00:07:34.185 sys 0m0.148s 00:07:34.185 04:52:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:34.185 04:52:13 -- common/autotest_common.sh@10 -- # set +x 00:07:34.185 ************************************ 00:07:34.185 END TEST accel_decomp_mthread 00:07:34.185 ************************************ 00:07:34.445 04:52:13 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:34.445 04:52:13 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:34.445 04:52:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.445 04:52:13 -- common/autotest_common.sh@10 -- # set +x 00:07:34.445 ************************************ 00:07:34.445 START TEST accel_deomp_full_mthread 00:07:34.445 ************************************ 00:07:34.445 04:52:13 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:34.445 04:52:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:34.445 04:52:13 -- accel/accel.sh@17 -- # local accel_module 00:07:34.445 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.445 04:52:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:34.445 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.445 04:52:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:34.445 04:52:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.445 04:52:13 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:34.445 04:52:13 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:34.445 04:52:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.445 04:52:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.445 04:52:13 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:34.445 04:52:13 -- accel/accel.sh@40 -- # local IFS=, 00:07:34.445 04:52:13 -- accel/accel.sh@41 -- # jq -r . 00:07:34.445 [2024-04-23 04:52:13.475708] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:34.445 [2024-04-23 04:52:13.475771] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2285175 ] 00:07:34.445 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.445 [2024-04-23 04:52:13.507614] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:34.445 [2024-04-23 04:52:13.537808] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.705 [2024-04-23 04:52:13.628602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=0x1 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=decompress 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=software 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@22 -- # accel_module=software 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=32 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=32 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=2 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val=Yes 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:34.705 04:52:13 -- accel/accel.sh@20 -- # val= 00:07:34.705 04:52:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # IFS=: 00:07:34.705 04:52:13 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@20 -- # val= 00:07:36.086 04:52:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # IFS=: 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@20 -- # val= 00:07:36.086 04:52:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # IFS=: 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@20 -- # val= 00:07:36.086 04:52:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # IFS=: 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@20 -- # val= 00:07:36.086 04:52:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # IFS=: 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@20 -- # val= 00:07:36.086 04:52:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # IFS=: 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@20 -- # val= 00:07:36.086 04:52:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # IFS=: 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@20 -- # val= 00:07:36.086 04:52:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # IFS=: 00:07:36.086 04:52:14 -- accel/accel.sh@19 -- # read -r var val 00:07:36.086 04:52:14 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:36.086 04:52:14 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:36.086 04:52:14 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.086 00:07:36.086 real 0m1.433s 00:07:36.086 user 0m1.296s 00:07:36.086 sys 0m0.139s 00:07:36.086 04:52:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:36.086 04:52:14 -- common/autotest_common.sh@10 -- # set +x 00:07:36.086 ************************************ 00:07:36.086 END TEST accel_deomp_full_mthread 00:07:36.086 ************************************ 00:07:36.086 04:52:14 -- accel/accel.sh@124 -- # [[ n == y ]] 00:07:36.086 04:52:14 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:36.086 04:52:14 -- accel/accel.sh@137 -- # build_accel_config 00:07:36.086 04:52:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:36.086 04:52:14 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:36.086 04:52:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.086 04:52:14 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:36.086 04:52:14 -- common/autotest_common.sh@10 -- # set +x 00:07:36.086 04:52:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.086 04:52:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.086 04:52:14 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:36.086 04:52:14 -- accel/accel.sh@40 -- # local IFS=, 00:07:36.086 04:52:14 -- accel/accel.sh@41 -- # jq -r . 00:07:36.086 ************************************ 00:07:36.086 START TEST accel_dif_functional_tests 00:07:36.086 ************************************ 00:07:36.086 04:52:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:36.086 [2024-04-23 04:52:15.057892] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:36.086 [2024-04-23 04:52:15.057952] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2285344 ] 00:07:36.086 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.086 [2024-04-23 04:52:15.087451] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:36.086 [2024-04-23 04:52:15.114059] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:36.086 [2024-04-23 04:52:15.204890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.086 [2024-04-23 04:52:15.204950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.086 [2024-04-23 04:52:15.204968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.345 00:07:36.345 00:07:36.345 CUnit - A unit testing framework for C - Version 2.1-3 00:07:36.345 http://cunit.sourceforge.net/ 00:07:36.345 00:07:36.345 00:07:36.345 Suite: accel_dif 00:07:36.345 Test: verify: DIF generated, GUARD check ...passed 00:07:36.345 Test: verify: DIF generated, APPTAG check ...passed 00:07:36.345 Test: verify: DIF generated, REFTAG check ...passed 00:07:36.345 Test: verify: DIF not generated, GUARD check ...[2024-04-23 04:52:15.298727] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:36.345 [2024-04-23 04:52:15.298794] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:36.345 passed 00:07:36.345 Test: verify: DIF not generated, APPTAG check ...[2024-04-23 04:52:15.298845] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:36.345 [2024-04-23 04:52:15.298871] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:36.345 passed 00:07:36.345 Test: verify: DIF not generated, REFTAG check ...[2024-04-23 04:52:15.298899] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:36.345 [2024-04-23 04:52:15.298925] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:36.345 passed 00:07:36.345 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:36.345 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-23 04:52:15.298982] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:36.345 passed 00:07:36.345 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:36.345 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:36.345 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:36.345 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-23 04:52:15.299111] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:36.345 passed 00:07:36.345 Test: generate copy: DIF generated, GUARD check ...passed 00:07:36.345 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:36.345 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:36.345 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:36.345 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:36.345 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:36.345 Test: generate copy: iovecs-len validate ...[2024-04-23 04:52:15.299326] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:36.345 passed 00:07:36.345 Test: generate copy: buffer alignment validate ...passed 00:07:36.345 00:07:36.345 Run Summary: Type Total Ran Passed Failed Inactive 00:07:36.345 suites 1 1 n/a 0 0 00:07:36.346 tests 20 20 20 0 0 00:07:36.346 asserts 204 204 204 0 n/a 00:07:36.346 00:07:36.346 Elapsed time = 0.000 seconds 00:07:36.346 00:07:36.346 real 0m0.485s 00:07:36.346 user 0m0.721s 00:07:36.346 sys 0m0.171s 00:07:36.346 04:52:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:36.346 04:52:15 -- common/autotest_common.sh@10 -- # set +x 00:07:36.346 ************************************ 00:07:36.346 END TEST accel_dif_functional_tests 00:07:36.346 ************************************ 00:07:36.605 00:07:36.605 real 0m33.638s 00:07:36.605 user 0m35.863s 00:07:36.605 sys 0m5.477s 00:07:36.605 04:52:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:36.605 04:52:15 -- common/autotest_common.sh@10 -- # set +x 00:07:36.605 ************************************ 00:07:36.605 END TEST accel 00:07:36.605 ************************************ 00:07:36.605 04:52:15 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:36.605 04:52:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:36.605 04:52:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.605 04:52:15 -- common/autotest_common.sh@10 -- # set +x 00:07:36.605 ************************************ 00:07:36.605 START TEST accel_rpc 00:07:36.605 ************************************ 00:07:36.605 04:52:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:36.605 * Looking for test storage... 00:07:36.605 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:36.605 04:52:15 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:36.605 04:52:15 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2285537 00:07:36.605 04:52:15 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:36.605 04:52:15 -- accel/accel_rpc.sh@15 -- # waitforlisten 2285537 00:07:36.605 04:52:15 -- common/autotest_common.sh@817 -- # '[' -z 2285537 ']' 00:07:36.605 04:52:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:36.605 04:52:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:36.605 04:52:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:36.605 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:36.605 04:52:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:36.605 04:52:15 -- common/autotest_common.sh@10 -- # set +x 00:07:36.605 [2024-04-23 04:52:15.750596] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:36.605 [2024-04-23 04:52:15.750669] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2285537 ] 00:07:36.863 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.863 [2024-04-23 04:52:15.781963] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:36.864 [2024-04-23 04:52:15.812598] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.864 [2024-04-23 04:52:15.900356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.864 04:52:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:36.864 04:52:15 -- common/autotest_common.sh@850 -- # return 0 00:07:36.864 04:52:15 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:36.864 04:52:15 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:36.864 04:52:15 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:36.864 04:52:15 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:36.864 04:52:15 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:36.864 04:52:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:36.864 04:52:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.864 04:52:15 -- common/autotest_common.sh@10 -- # set +x 00:07:37.125 ************************************ 00:07:37.125 START TEST accel_assign_opcode 00:07:37.125 ************************************ 00:07:37.125 04:52:16 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:07:37.125 04:52:16 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:37.125 04:52:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:37.125 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.125 [2024-04-23 04:52:16.037200] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:37.125 04:52:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:37.125 04:52:16 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:37.125 04:52:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:37.125 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.125 [2024-04-23 04:52:16.045209] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:37.125 04:52:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:37.125 04:52:16 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:37.125 04:52:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:37.125 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.125 04:52:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:37.125 04:52:16 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:37.125 04:52:16 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:37.125 04:52:16 -- accel/accel_rpc.sh@42 -- # grep software 00:07:37.125 04:52:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:37.125 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.381 04:52:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:37.381 software 00:07:37.381 00:07:37.381 real 0m0.293s 00:07:37.381 user 0m0.040s 00:07:37.381 sys 0m0.007s 00:07:37.381 04:52:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:37.381 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.381 ************************************ 00:07:37.381 END TEST accel_assign_opcode 00:07:37.381 ************************************ 00:07:37.381 04:52:16 -- accel/accel_rpc.sh@55 -- # killprocess 2285537 00:07:37.381 04:52:16 -- common/autotest_common.sh@936 -- # '[' -z 2285537 ']' 00:07:37.381 04:52:16 -- common/autotest_common.sh@940 -- # kill -0 2285537 00:07:37.381 04:52:16 -- common/autotest_common.sh@941 -- # uname 00:07:37.381 04:52:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:37.381 04:52:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2285537 00:07:37.381 04:52:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:37.381 04:52:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:37.381 04:52:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2285537' 00:07:37.381 killing process with pid 2285537 00:07:37.381 04:52:16 -- common/autotest_common.sh@955 -- # kill 2285537 00:07:37.381 04:52:16 -- common/autotest_common.sh@960 -- # wait 2285537 00:07:37.665 00:07:37.665 real 0m1.124s 00:07:37.665 user 0m1.062s 00:07:37.665 sys 0m0.465s 00:07:37.665 04:52:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:37.665 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.665 ************************************ 00:07:37.665 END TEST accel_rpc 00:07:37.665 ************************************ 00:07:37.665 04:52:16 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:37.665 04:52:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:37.665 04:52:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.665 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.923 ************************************ 00:07:37.923 START TEST app_cmdline 00:07:37.923 ************************************ 00:07:37.923 04:52:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:37.923 * Looking for test storage... 00:07:37.923 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:37.923 04:52:16 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:37.923 04:52:16 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2285758 00:07:37.923 04:52:16 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:37.923 04:52:16 -- app/cmdline.sh@18 -- # waitforlisten 2285758 00:07:37.923 04:52:16 -- common/autotest_common.sh@817 -- # '[' -z 2285758 ']' 00:07:37.924 04:52:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:37.924 04:52:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:37.924 04:52:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:37.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:37.924 04:52:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:37.924 04:52:16 -- common/autotest_common.sh@10 -- # set +x 00:07:37.924 [2024-04-23 04:52:16.994789] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:37.924 [2024-04-23 04:52:16.994889] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2285758 ] 00:07:37.924 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.924 [2024-04-23 04:52:17.026721] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:37.924 [2024-04-23 04:52:17.053388] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.183 [2024-04-23 04:52:17.137421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.441 04:52:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:38.441 04:52:17 -- common/autotest_common.sh@850 -- # return 0 00:07:38.441 04:52:17 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:38.699 { 00:07:38.699 "version": "SPDK v24.05-pre git sha1 a1264177c", 00:07:38.699 "fields": { 00:07:38.699 "major": 24, 00:07:38.699 "minor": 5, 00:07:38.699 "patch": 0, 00:07:38.699 "suffix": "-pre", 00:07:38.699 "commit": "a1264177c" 00:07:38.699 } 00:07:38.699 } 00:07:38.699 04:52:17 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:38.699 04:52:17 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:38.699 04:52:17 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:38.699 04:52:17 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:38.699 04:52:17 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:38.699 04:52:17 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:38.699 04:52:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:38.699 04:52:17 -- app/cmdline.sh@26 -- # sort 00:07:38.699 04:52:17 -- common/autotest_common.sh@10 -- # set +x 00:07:38.699 04:52:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:38.699 04:52:17 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:38.699 04:52:17 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:38.699 04:52:17 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:38.699 04:52:17 -- common/autotest_common.sh@638 -- # local es=0 00:07:38.699 04:52:17 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:38.699 04:52:17 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.699 04:52:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:38.699 04:52:17 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.699 04:52:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:38.699 04:52:17 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.700 04:52:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:38.700 04:52:17 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.700 04:52:17 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:38.700 04:52:17 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:38.958 request: 00:07:38.958 { 00:07:38.958 "method": "env_dpdk_get_mem_stats", 00:07:38.958 "req_id": 1 00:07:38.958 } 00:07:38.958 Got JSON-RPC error response 00:07:38.958 response: 00:07:38.958 { 00:07:38.958 "code": -32601, 00:07:38.958 "message": "Method not found" 00:07:38.958 } 00:07:38.958 04:52:17 -- common/autotest_common.sh@641 -- # es=1 00:07:38.958 04:52:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:38.958 04:52:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:38.958 04:52:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:38.958 04:52:17 -- app/cmdline.sh@1 -- # killprocess 2285758 00:07:38.958 04:52:17 -- common/autotest_common.sh@936 -- # '[' -z 2285758 ']' 00:07:38.958 04:52:17 -- common/autotest_common.sh@940 -- # kill -0 2285758 00:07:38.958 04:52:17 -- common/autotest_common.sh@941 -- # uname 00:07:38.958 04:52:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:38.958 04:52:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2285758 00:07:38.958 04:52:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:38.958 04:52:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:38.958 04:52:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2285758' 00:07:38.958 killing process with pid 2285758 00:07:38.958 04:52:17 -- common/autotest_common.sh@955 -- # kill 2285758 00:07:38.958 04:52:17 -- common/autotest_common.sh@960 -- # wait 2285758 00:07:39.217 00:07:39.217 real 0m1.456s 00:07:39.217 user 0m1.748s 00:07:39.217 sys 0m0.468s 00:07:39.217 04:52:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:39.217 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.217 ************************************ 00:07:39.217 END TEST app_cmdline 00:07:39.217 ************************************ 00:07:39.217 04:52:18 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:39.217 04:52:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:39.217 04:52:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.217 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.476 ************************************ 00:07:39.476 START TEST version 00:07:39.476 ************************************ 00:07:39.476 04:52:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:39.476 * Looking for test storage... 00:07:39.476 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:39.476 04:52:18 -- app/version.sh@17 -- # get_header_version major 00:07:39.476 04:52:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.476 04:52:18 -- app/version.sh@14 -- # cut -f2 00:07:39.476 04:52:18 -- app/version.sh@14 -- # tr -d '"' 00:07:39.476 04:52:18 -- app/version.sh@17 -- # major=24 00:07:39.476 04:52:18 -- app/version.sh@18 -- # get_header_version minor 00:07:39.476 04:52:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.476 04:52:18 -- app/version.sh@14 -- # cut -f2 00:07:39.476 04:52:18 -- app/version.sh@14 -- # tr -d '"' 00:07:39.476 04:52:18 -- app/version.sh@18 -- # minor=5 00:07:39.476 04:52:18 -- app/version.sh@19 -- # get_header_version patch 00:07:39.476 04:52:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.476 04:52:18 -- app/version.sh@14 -- # cut -f2 00:07:39.476 04:52:18 -- app/version.sh@14 -- # tr -d '"' 00:07:39.476 04:52:18 -- app/version.sh@19 -- # patch=0 00:07:39.476 04:52:18 -- app/version.sh@20 -- # get_header_version suffix 00:07:39.476 04:52:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.476 04:52:18 -- app/version.sh@14 -- # cut -f2 00:07:39.476 04:52:18 -- app/version.sh@14 -- # tr -d '"' 00:07:39.476 04:52:18 -- app/version.sh@20 -- # suffix=-pre 00:07:39.476 04:52:18 -- app/version.sh@22 -- # version=24.5 00:07:39.476 04:52:18 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:39.476 04:52:18 -- app/version.sh@28 -- # version=24.5rc0 00:07:39.476 04:52:18 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:39.476 04:52:18 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:39.476 04:52:18 -- app/version.sh@30 -- # py_version=24.5rc0 00:07:39.476 04:52:18 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:07:39.476 00:07:39.476 real 0m0.105s 00:07:39.476 user 0m0.056s 00:07:39.476 sys 0m0.067s 00:07:39.476 04:52:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:39.476 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.476 ************************************ 00:07:39.476 END TEST version 00:07:39.476 ************************************ 00:07:39.476 04:52:18 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@194 -- # uname -s 00:07:39.476 04:52:18 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:07:39.476 04:52:18 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:39.476 04:52:18 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:39.476 04:52:18 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@258 -- # timing_exit lib 00:07:39.476 04:52:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:39.476 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.476 04:52:18 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:07:39.476 04:52:18 -- spdk/autotest.sh@281 -- # '[' tcp = rdma ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@284 -- # '[' tcp = tcp ']' 00:07:39.476 04:52:18 -- spdk/autotest.sh@285 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:39.476 04:52:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:39.476 04:52:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.476 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.734 ************************************ 00:07:39.734 START TEST nvmf_tcp 00:07:39.734 ************************************ 00:07:39.734 04:52:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:39.735 * Looking for test storage... 00:07:39.735 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:39.735 04:52:18 -- nvmf/common.sh@7 -- # uname -s 00:07:39.735 04:52:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:39.735 04:52:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:39.735 04:52:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:39.735 04:52:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:39.735 04:52:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:39.735 04:52:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:39.735 04:52:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:39.735 04:52:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:39.735 04:52:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:39.735 04:52:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:39.735 04:52:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.735 04:52:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.735 04:52:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:39.735 04:52:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:39.735 04:52:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:39.735 04:52:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:39.735 04:52:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:39.735 04:52:18 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:39.735 04:52:18 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:39.735 04:52:18 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:39.735 04:52:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.735 04:52:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.735 04:52:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.735 04:52:18 -- paths/export.sh@5 -- # export PATH 00:07:39.735 04:52:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.735 04:52:18 -- nvmf/common.sh@47 -- # : 0 00:07:39.735 04:52:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:39.735 04:52:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:39.735 04:52:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:39.735 04:52:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:39.735 04:52:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:39.735 04:52:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:39.735 04:52:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:39.735 04:52:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:39.735 04:52:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:39.735 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:39.735 04:52:18 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:39.735 04:52:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:39.735 04:52:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.735 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.735 ************************************ 00:07:39.735 START TEST nvmf_example 00:07:39.735 ************************************ 00:07:39.735 04:52:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:39.994 * Looking for test storage... 00:07:39.994 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:39.994 04:52:18 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:39.994 04:52:18 -- nvmf/common.sh@7 -- # uname -s 00:07:39.994 04:52:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:39.994 04:52:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:39.994 04:52:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:39.994 04:52:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:39.994 04:52:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:39.994 04:52:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:39.994 04:52:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:39.994 04:52:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:39.994 04:52:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:39.994 04:52:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:39.994 04:52:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.994 04:52:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.994 04:52:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:39.994 04:52:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:39.994 04:52:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:39.994 04:52:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:39.994 04:52:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:39.994 04:52:18 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:39.994 04:52:18 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:39.994 04:52:18 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:39.994 04:52:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.994 04:52:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.994 04:52:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.994 04:52:18 -- paths/export.sh@5 -- # export PATH 00:07:39.994 04:52:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.994 04:52:18 -- nvmf/common.sh@47 -- # : 0 00:07:39.994 04:52:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:39.994 04:52:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:39.994 04:52:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:39.994 04:52:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:39.994 04:52:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:39.994 04:52:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:39.994 04:52:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:39.994 04:52:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:39.994 04:52:18 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:39.994 04:52:18 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:39.994 04:52:18 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:39.994 04:52:18 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:39.994 04:52:18 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:39.994 04:52:18 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:39.994 04:52:18 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:39.994 04:52:18 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:39.994 04:52:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:39.994 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:39.994 04:52:18 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:39.994 04:52:18 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:07:39.994 04:52:18 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:39.994 04:52:18 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:39.994 04:52:18 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:39.994 04:52:18 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:39.994 04:52:18 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:39.994 04:52:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:39.994 04:52:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:39.994 04:52:18 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:39.994 04:52:18 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:39.994 04:52:18 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:39.994 04:52:18 -- common/autotest_common.sh@10 -- # set +x 00:07:41.897 04:52:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:41.897 04:52:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:41.897 04:52:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:41.897 04:52:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:41.897 04:52:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:41.897 04:52:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:41.897 04:52:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:41.897 04:52:20 -- nvmf/common.sh@295 -- # net_devs=() 00:07:41.897 04:52:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:41.897 04:52:20 -- nvmf/common.sh@296 -- # e810=() 00:07:41.897 04:52:20 -- nvmf/common.sh@296 -- # local -ga e810 00:07:41.897 04:52:20 -- nvmf/common.sh@297 -- # x722=() 00:07:41.897 04:52:20 -- nvmf/common.sh@297 -- # local -ga x722 00:07:41.897 04:52:20 -- nvmf/common.sh@298 -- # mlx=() 00:07:41.897 04:52:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:41.897 04:52:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:41.897 04:52:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:41.897 04:52:20 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:41.897 04:52:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:41.897 04:52:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:41.897 04:52:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:41.897 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:41.897 04:52:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:41.897 04:52:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:41.897 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:41.897 04:52:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:41.897 04:52:20 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:41.897 04:52:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.897 04:52:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:41.897 04:52:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.897 04:52:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:41.897 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:41.897 04:52:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.897 04:52:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:41.897 04:52:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.897 04:52:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:41.897 04:52:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.897 04:52:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:41.897 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:41.897 04:52:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.897 04:52:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:41.897 04:52:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:41.897 04:52:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:07:41.897 04:52:20 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:07:41.897 04:52:20 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:41.897 04:52:20 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:41.897 04:52:20 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:41.897 04:52:20 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:07:41.897 04:52:20 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:41.897 04:52:20 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:41.897 04:52:20 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:07:41.897 04:52:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:41.897 04:52:20 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:41.897 04:52:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:07:41.897 04:52:20 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:07:41.897 04:52:20 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:07:41.897 04:52:20 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:41.897 04:52:21 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:41.897 04:52:21 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:41.897 04:52:21 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:07:41.897 04:52:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:42.156 04:52:21 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:42.156 04:52:21 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:42.156 04:52:21 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:07:42.156 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:42.156 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.117 ms 00:07:42.156 00:07:42.156 --- 10.0.0.2 ping statistics --- 00:07:42.156 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.156 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:07:42.156 04:52:21 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:42.156 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:42.156 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:07:42.156 00:07:42.156 --- 10.0.0.1 ping statistics --- 00:07:42.156 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.156 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:07:42.156 04:52:21 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:42.156 04:52:21 -- nvmf/common.sh@411 -- # return 0 00:07:42.156 04:52:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:42.156 04:52:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:42.156 04:52:21 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:07:42.156 04:52:21 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:07:42.156 04:52:21 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:42.156 04:52:21 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:07:42.156 04:52:21 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:07:42.156 04:52:21 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:42.156 04:52:21 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:42.156 04:52:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:42.156 04:52:21 -- common/autotest_common.sh@10 -- # set +x 00:07:42.156 04:52:21 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:42.156 04:52:21 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:42.156 04:52:21 -- target/nvmf_example.sh@34 -- # nvmfpid=2287768 00:07:42.156 04:52:21 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:42.156 04:52:21 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:42.156 04:52:21 -- target/nvmf_example.sh@36 -- # waitforlisten 2287768 00:07:42.156 04:52:21 -- common/autotest_common.sh@817 -- # '[' -z 2287768 ']' 00:07:42.156 04:52:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:42.156 04:52:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:42.156 04:52:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:42.156 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:42.156 04:52:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:42.156 04:52:21 -- common/autotest_common.sh@10 -- # set +x 00:07:42.156 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.091 04:52:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:43.091 04:52:22 -- common/autotest_common.sh@850 -- # return 0 00:07:43.091 04:52:22 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:43.091 04:52:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:43.091 04:52:22 -- common/autotest_common.sh@10 -- # set +x 00:07:43.091 04:52:22 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:43.091 04:52:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:43.091 04:52:22 -- common/autotest_common.sh@10 -- # set +x 00:07:43.091 04:52:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:43.091 04:52:22 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:43.091 04:52:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:43.091 04:52:22 -- common/autotest_common.sh@10 -- # set +x 00:07:43.091 04:52:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:43.091 04:52:22 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:43.091 04:52:22 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:43.091 04:52:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:43.091 04:52:22 -- common/autotest_common.sh@10 -- # set +x 00:07:43.091 04:52:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:43.091 04:52:22 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:43.091 04:52:22 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:43.091 04:52:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:43.091 04:52:22 -- common/autotest_common.sh@10 -- # set +x 00:07:43.091 04:52:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:43.091 04:52:22 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:43.091 04:52:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:43.091 04:52:22 -- common/autotest_common.sh@10 -- # set +x 00:07:43.091 04:52:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:43.091 04:52:22 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:43.091 04:52:22 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:43.091 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.289 Initializing NVMe Controllers 00:07:55.289 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:55.289 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:55.289 Initialization complete. Launching workers. 00:07:55.289 ======================================================== 00:07:55.289 Latency(us) 00:07:55.289 Device Information : IOPS MiB/s Average min max 00:07:55.289 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15306.32 59.79 4180.89 737.13 19156.96 00:07:55.289 ======================================================== 00:07:55.289 Total : 15306.32 59.79 4180.89 737.13 19156.96 00:07:55.289 00:07:55.289 04:52:32 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:55.289 04:52:32 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:55.289 04:52:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:55.289 04:52:32 -- nvmf/common.sh@117 -- # sync 00:07:55.289 04:52:32 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:07:55.289 04:52:32 -- nvmf/common.sh@120 -- # set +e 00:07:55.289 04:52:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:55.289 04:52:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:07:55.289 rmmod nvme_tcp 00:07:55.289 rmmod nvme_fabrics 00:07:55.289 rmmod nvme_keyring 00:07:55.289 04:52:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:55.289 04:52:32 -- nvmf/common.sh@124 -- # set -e 00:07:55.289 04:52:32 -- nvmf/common.sh@125 -- # return 0 00:07:55.289 04:52:32 -- nvmf/common.sh@478 -- # '[' -n 2287768 ']' 00:07:55.289 04:52:32 -- nvmf/common.sh@479 -- # killprocess 2287768 00:07:55.289 04:52:32 -- common/autotest_common.sh@936 -- # '[' -z 2287768 ']' 00:07:55.289 04:52:32 -- common/autotest_common.sh@940 -- # kill -0 2287768 00:07:55.289 04:52:32 -- common/autotest_common.sh@941 -- # uname 00:07:55.289 04:52:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:55.289 04:52:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2287768 00:07:55.289 04:52:32 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:55.289 04:52:32 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:55.289 04:52:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2287768' 00:07:55.289 killing process with pid 2287768 00:07:55.289 04:52:32 -- common/autotest_common.sh@955 -- # kill 2287768 00:07:55.289 04:52:32 -- common/autotest_common.sh@960 -- # wait 2287768 00:07:55.289 nvmf threads initialize successfully 00:07:55.289 bdev subsystem init successfully 00:07:55.289 created a nvmf target service 00:07:55.289 create targets's poll groups done 00:07:55.289 all subsystems of target started 00:07:55.289 nvmf target is running 00:07:55.289 all subsystems of target stopped 00:07:55.289 destroy targets's poll groups done 00:07:55.289 destroyed the nvmf target service 00:07:55.289 bdev subsystem finish successfully 00:07:55.289 nvmf threads destroy successfully 00:07:55.289 04:52:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:55.289 04:52:32 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:07:55.289 04:52:32 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:07:55.289 04:52:32 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:55.289 04:52:32 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:07:55.289 04:52:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:55.289 04:52:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:55.289 04:52:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:55.860 04:52:34 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:07:55.860 04:52:34 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:55.860 04:52:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:55.860 04:52:34 -- common/autotest_common.sh@10 -- # set +x 00:07:55.860 00:07:55.860 real 0m15.881s 00:07:55.860 user 0m45.209s 00:07:55.860 sys 0m3.173s 00:07:55.860 04:52:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:55.860 04:52:34 -- common/autotest_common.sh@10 -- # set +x 00:07:55.860 ************************************ 00:07:55.860 END TEST nvmf_example 00:07:55.860 ************************************ 00:07:55.860 04:52:34 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:55.860 04:52:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:55.860 04:52:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.860 04:52:34 -- common/autotest_common.sh@10 -- # set +x 00:07:55.860 ************************************ 00:07:55.860 START TEST nvmf_filesystem 00:07:55.860 ************************************ 00:07:55.860 04:52:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:55.860 * Looking for test storage... 00:07:55.860 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.860 04:52:34 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:55.860 04:52:34 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:55.860 04:52:34 -- common/autotest_common.sh@34 -- # set -e 00:07:55.860 04:52:34 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:55.860 04:52:34 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:55.860 04:52:34 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:55.860 04:52:34 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:55.860 04:52:34 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:55.860 04:52:34 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:55.860 04:52:34 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:55.860 04:52:34 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:55.860 04:52:34 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:55.860 04:52:34 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:55.860 04:52:34 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:55.860 04:52:34 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:55.860 04:52:34 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:55.860 04:52:34 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:55.860 04:52:34 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:55.860 04:52:34 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:55.860 04:52:34 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:55.860 04:52:34 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:55.860 04:52:34 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:55.860 04:52:34 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:55.860 04:52:34 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:55.860 04:52:34 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:55.861 04:52:34 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:55.861 04:52:34 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:55.861 04:52:34 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:55.861 04:52:34 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:55.861 04:52:34 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:55.861 04:52:34 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:55.861 04:52:34 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:55.861 04:52:34 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:55.861 04:52:34 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:55.861 04:52:34 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:55.861 04:52:34 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:55.861 04:52:34 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:55.861 04:52:34 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:55.861 04:52:34 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:55.861 04:52:34 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:55.861 04:52:34 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:55.861 04:52:34 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:55.861 04:52:34 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:55.861 04:52:34 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:55.861 04:52:34 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:55.861 04:52:34 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:55.861 04:52:34 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:55.861 04:52:34 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:55.861 04:52:34 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:55.861 04:52:34 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:55.861 04:52:34 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:55.861 04:52:34 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:55.861 04:52:34 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:55.861 04:52:34 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:55.861 04:52:34 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:55.861 04:52:34 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:55.861 04:52:34 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:55.861 04:52:34 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:55.861 04:52:34 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:07:55.861 04:52:34 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:55.861 04:52:34 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:07:55.861 04:52:34 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:07:55.861 04:52:34 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:07:55.861 04:52:34 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:07:55.861 04:52:34 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:07:55.861 04:52:34 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:07:55.861 04:52:34 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:07:55.861 04:52:34 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:07:55.861 04:52:34 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:07:55.861 04:52:34 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.861 04:52:34 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:07:55.861 04:52:34 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:07:55.861 04:52:34 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:07:55.861 04:52:34 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:07:55.861 04:52:34 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:07:55.861 04:52:34 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:55.861 04:52:34 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:07:55.861 04:52:34 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:07:55.861 04:52:34 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:07:55.861 04:52:34 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:07:55.861 04:52:34 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:07:55.861 04:52:34 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:07:55.861 04:52:34 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:07:55.861 04:52:34 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:07:55.861 04:52:34 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:07:55.861 04:52:34 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:07:55.861 04:52:34 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:07:55.861 04:52:34 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:55.861 04:52:34 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:07:55.861 04:52:34 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:07:55.861 04:52:34 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:55.861 04:52:34 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:55.861 04:52:34 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:55.861 04:52:34 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:55.861 04:52:34 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:55.861 04:52:34 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:55.861 04:52:34 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:55.861 04:52:34 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:55.861 04:52:34 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:55.861 04:52:34 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:55.861 04:52:34 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:55.861 04:52:34 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:55.861 04:52:34 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:55.861 04:52:34 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:55.861 04:52:34 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:55.861 04:52:34 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:55.861 #define SPDK_CONFIG_H 00:07:55.861 #define SPDK_CONFIG_APPS 1 00:07:55.861 #define SPDK_CONFIG_ARCH native 00:07:55.861 #undef SPDK_CONFIG_ASAN 00:07:55.861 #undef SPDK_CONFIG_AVAHI 00:07:55.861 #undef SPDK_CONFIG_CET 00:07:55.861 #define SPDK_CONFIG_COVERAGE 1 00:07:55.861 #define SPDK_CONFIG_CROSS_PREFIX 00:07:55.861 #undef SPDK_CONFIG_CRYPTO 00:07:55.861 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:55.861 #undef SPDK_CONFIG_CUSTOMOCF 00:07:55.861 #undef SPDK_CONFIG_DAOS 00:07:55.861 #define SPDK_CONFIG_DAOS_DIR 00:07:55.861 #define SPDK_CONFIG_DEBUG 1 00:07:55.861 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:55.861 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:55.861 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:55.861 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.861 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:55.861 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:55.861 #define SPDK_CONFIG_EXAMPLES 1 00:07:55.861 #undef SPDK_CONFIG_FC 00:07:55.861 #define SPDK_CONFIG_FC_PATH 00:07:55.861 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:55.861 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:55.861 #undef SPDK_CONFIG_FUSE 00:07:55.861 #undef SPDK_CONFIG_FUZZER 00:07:55.861 #define SPDK_CONFIG_FUZZER_LIB 00:07:55.861 #undef SPDK_CONFIG_GOLANG 00:07:55.861 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:55.861 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:07:55.861 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:55.861 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:07:55.861 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:55.861 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:55.861 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:55.861 #define SPDK_CONFIG_IDXD 1 00:07:55.861 #undef SPDK_CONFIG_IDXD_KERNEL 00:07:55.861 #undef SPDK_CONFIG_IPSEC_MB 00:07:55.861 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:55.861 #define SPDK_CONFIG_ISAL 1 00:07:55.861 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:55.861 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:55.861 #define SPDK_CONFIG_LIBDIR 00:07:55.861 #undef SPDK_CONFIG_LTO 00:07:55.861 #define SPDK_CONFIG_MAX_LCORES 00:07:55.861 #define SPDK_CONFIG_NVME_CUSE 1 00:07:55.861 #undef SPDK_CONFIG_OCF 00:07:55.861 #define SPDK_CONFIG_OCF_PATH 00:07:55.861 #define SPDK_CONFIG_OPENSSL_PATH 00:07:55.861 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:55.861 #define SPDK_CONFIG_PGO_DIR 00:07:55.861 #undef SPDK_CONFIG_PGO_USE 00:07:55.861 #define SPDK_CONFIG_PREFIX /usr/local 00:07:55.861 #undef SPDK_CONFIG_RAID5F 00:07:55.861 #undef SPDK_CONFIG_RBD 00:07:55.861 #define SPDK_CONFIG_RDMA 1 00:07:55.861 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:55.861 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:55.861 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:55.861 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:55.861 #define SPDK_CONFIG_SHARED 1 00:07:55.861 #undef SPDK_CONFIG_SMA 00:07:55.861 #define SPDK_CONFIG_TESTS 1 00:07:55.861 #undef SPDK_CONFIG_TSAN 00:07:55.861 #define SPDK_CONFIG_UBLK 1 00:07:55.861 #define SPDK_CONFIG_UBSAN 1 00:07:55.861 #undef SPDK_CONFIG_UNIT_TESTS 00:07:55.861 #undef SPDK_CONFIG_URING 00:07:55.861 #define SPDK_CONFIG_URING_PATH 00:07:55.861 #undef SPDK_CONFIG_URING_ZNS 00:07:55.861 #undef SPDK_CONFIG_USDT 00:07:55.861 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:55.861 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:55.861 #define SPDK_CONFIG_VFIO_USER 1 00:07:55.861 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:55.861 #define SPDK_CONFIG_VHOST 1 00:07:55.861 #define SPDK_CONFIG_VIRTIO 1 00:07:55.861 #undef SPDK_CONFIG_VTUNE 00:07:55.861 #define SPDK_CONFIG_VTUNE_DIR 00:07:55.861 #define SPDK_CONFIG_WERROR 1 00:07:55.861 #define SPDK_CONFIG_WPDK_DIR 00:07:55.861 #undef SPDK_CONFIG_XNVME 00:07:55.861 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:55.861 04:52:34 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:55.861 04:52:34 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:55.861 04:52:34 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:55.861 04:52:34 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:55.861 04:52:34 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:55.862 04:52:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.862 04:52:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.862 04:52:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.862 04:52:34 -- paths/export.sh@5 -- # export PATH 00:07:55.862 04:52:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.862 04:52:34 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:55.862 04:52:34 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:55.862 04:52:34 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:55.862 04:52:34 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:55.862 04:52:34 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:55.862 04:52:34 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:55.862 04:52:34 -- pm/common@67 -- # TEST_TAG=N/A 00:07:55.862 04:52:34 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:55.862 04:52:34 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:07:55.862 04:52:34 -- pm/common@71 -- # uname -s 00:07:55.862 04:52:34 -- pm/common@71 -- # PM_OS=Linux 00:07:55.862 04:52:34 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:07:55.862 04:52:34 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:07:55.862 04:52:34 -- pm/common@76 -- # [[ Linux == Linux ]] 00:07:55.862 04:52:34 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:07:55.862 04:52:34 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:07:55.862 04:52:34 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:07:55.862 04:52:34 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:07:55.862 04:52:34 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:07:55.862 04:52:34 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:07:55.862 04:52:34 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:07:55.862 04:52:34 -- common/autotest_common.sh@57 -- # : 1 00:07:55.862 04:52:34 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:07:55.862 04:52:34 -- common/autotest_common.sh@61 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:55.862 04:52:34 -- common/autotest_common.sh@63 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:07:55.862 04:52:34 -- common/autotest_common.sh@65 -- # : 1 00:07:55.862 04:52:34 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:55.862 04:52:34 -- common/autotest_common.sh@67 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:07:55.862 04:52:34 -- common/autotest_common.sh@69 -- # : 00:07:55.862 04:52:34 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:07:55.862 04:52:34 -- common/autotest_common.sh@71 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:07:55.862 04:52:34 -- common/autotest_common.sh@73 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:07:55.862 04:52:34 -- common/autotest_common.sh@75 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:07:55.862 04:52:34 -- common/autotest_common.sh@77 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:55.862 04:52:34 -- common/autotest_common.sh@79 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:07:55.862 04:52:34 -- common/autotest_common.sh@81 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:07:55.862 04:52:34 -- common/autotest_common.sh@83 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:07:55.862 04:52:34 -- common/autotest_common.sh@85 -- # : 1 00:07:55.862 04:52:34 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:07:55.862 04:52:34 -- common/autotest_common.sh@87 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:07:55.862 04:52:34 -- common/autotest_common.sh@89 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:07:55.862 04:52:34 -- common/autotest_common.sh@91 -- # : 1 00:07:55.862 04:52:34 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:07:55.862 04:52:34 -- common/autotest_common.sh@93 -- # : 1 00:07:55.862 04:52:34 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:07:55.862 04:52:34 -- common/autotest_common.sh@95 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:55.862 04:52:34 -- common/autotest_common.sh@97 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:07:55.862 04:52:34 -- common/autotest_common.sh@99 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:07:55.862 04:52:34 -- common/autotest_common.sh@101 -- # : tcp 00:07:55.862 04:52:34 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:55.862 04:52:34 -- common/autotest_common.sh@103 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:07:55.862 04:52:34 -- common/autotest_common.sh@105 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:07:55.862 04:52:34 -- common/autotest_common.sh@107 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:07:55.862 04:52:34 -- common/autotest_common.sh@109 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:07:55.862 04:52:34 -- common/autotest_common.sh@111 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:07:55.862 04:52:34 -- common/autotest_common.sh@113 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:07:55.862 04:52:34 -- common/autotest_common.sh@115 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:07:55.862 04:52:34 -- common/autotest_common.sh@117 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:55.862 04:52:34 -- common/autotest_common.sh@119 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:07:55.862 04:52:34 -- common/autotest_common.sh@121 -- # : 1 00:07:55.862 04:52:34 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:07:55.862 04:52:34 -- common/autotest_common.sh@123 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:55.862 04:52:34 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:55.862 04:52:34 -- common/autotest_common.sh@125 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:07:55.862 04:52:34 -- common/autotest_common.sh@127 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:07:55.862 04:52:34 -- common/autotest_common.sh@129 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:07:55.862 04:52:34 -- common/autotest_common.sh@131 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:07:55.862 04:52:34 -- common/autotest_common.sh@133 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:07:55.862 04:52:34 -- common/autotest_common.sh@135 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:07:55.862 04:52:34 -- common/autotest_common.sh@137 -- # : main 00:07:55.862 04:52:34 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:07:55.862 04:52:34 -- common/autotest_common.sh@139 -- # : true 00:07:55.862 04:52:34 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:07:55.862 04:52:34 -- common/autotest_common.sh@141 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:07:55.862 04:52:34 -- common/autotest_common.sh@143 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:07:55.862 04:52:34 -- common/autotest_common.sh@145 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:07:55.862 04:52:34 -- common/autotest_common.sh@147 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:07:55.862 04:52:34 -- common/autotest_common.sh@149 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:07:55.862 04:52:34 -- common/autotest_common.sh@151 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:07:55.862 04:52:34 -- common/autotest_common.sh@153 -- # : e810 00:07:55.862 04:52:34 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:07:55.862 04:52:34 -- common/autotest_common.sh@155 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:07:55.862 04:52:34 -- common/autotest_common.sh@157 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:07:55.862 04:52:34 -- common/autotest_common.sh@159 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:07:55.862 04:52:34 -- common/autotest_common.sh@161 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:07:55.862 04:52:34 -- common/autotest_common.sh@163 -- # : 0 00:07:55.862 04:52:34 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:07:55.862 04:52:34 -- common/autotest_common.sh@166 -- # : 00:07:55.863 04:52:34 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:07:55.863 04:52:34 -- common/autotest_common.sh@168 -- # : 0 00:07:55.863 04:52:34 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:07:55.863 04:52:34 -- common/autotest_common.sh@170 -- # : 0 00:07:55.863 04:52:34 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:55.863 04:52:34 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.863 04:52:34 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:55.863 04:52:34 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:55.863 04:52:34 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:55.863 04:52:34 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:55.863 04:52:34 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:55.863 04:52:34 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:07:55.863 04:52:34 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:55.863 04:52:34 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:55.863 04:52:34 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:55.863 04:52:34 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:55.863 04:52:34 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:55.863 04:52:34 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:07:55.863 04:52:34 -- common/autotest_common.sh@199 -- # cat 00:07:55.863 04:52:34 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:07:55.863 04:52:34 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:55.863 04:52:34 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:55.863 04:52:34 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:55.863 04:52:34 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:55.863 04:52:34 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:07:55.863 04:52:34 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:07:55.863 04:52:34 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:55.863 04:52:34 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:55.863 04:52:34 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:55.863 04:52:34 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:55.863 04:52:34 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:55.863 04:52:34 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:55.863 04:52:34 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:55.863 04:52:34 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:55.863 04:52:34 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:55.863 04:52:34 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:55.863 04:52:34 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:55.863 04:52:34 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:55.863 04:52:34 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:07:55.863 04:52:34 -- common/autotest_common.sh@252 -- # export valgrind= 00:07:55.863 04:52:34 -- common/autotest_common.sh@252 -- # valgrind= 00:07:55.863 04:52:34 -- common/autotest_common.sh@258 -- # uname -s 00:07:55.863 04:52:34 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:07:55.863 04:52:34 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:07:55.863 04:52:34 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:07:55.863 04:52:34 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:07:55.863 04:52:34 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:07:55.863 04:52:34 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:07:55.863 04:52:34 -- common/autotest_common.sh@268 -- # MAKE=make 00:07:55.863 04:52:34 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j48 00:07:55.863 04:52:34 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:07:55.863 04:52:34 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:07:55.863 04:52:34 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:07:55.863 04:52:34 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:07:55.863 04:52:34 -- common/autotest_common.sh@289 -- # for i in "$@" 00:07:55.863 04:52:34 -- common/autotest_common.sh@290 -- # case "$i" in 00:07:55.863 04:52:34 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=tcp 00:07:55.863 04:52:34 -- common/autotest_common.sh@307 -- # [[ -z 2289543 ]] 00:07:55.863 04:52:34 -- common/autotest_common.sh@307 -- # kill -0 2289543 00:07:55.863 04:52:34 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:07:55.863 04:52:34 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:07:55.863 04:52:34 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:07:55.863 04:52:34 -- common/autotest_common.sh@320 -- # local mount target_dir 00:07:55.863 04:52:34 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:07:55.863 04:52:34 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:07:55.863 04:52:34 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:07:55.863 04:52:34 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:07:55.863 04:52:34 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.0ZM7Qx 00:07:55.863 04:52:34 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:55.863 04:52:34 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:07:55.863 04:52:34 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:07:55.863 04:52:34 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.0ZM7Qx/tests/target /tmp/spdk.0ZM7Qx 00:07:55.863 04:52:34 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:07:55.863 04:52:34 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:55.863 04:52:34 -- common/autotest_common.sh@316 -- # df -T 00:07:55.863 04:52:34 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:07:55.863 04:52:34 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:07:55.863 04:52:34 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # avails["$mount"]=55630008320 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67279548416 00:07:55.863 04:52:34 -- common/autotest_common.sh@352 -- # uses["$mount"]=11649540096 00:07:55.863 04:52:34 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # avails["$mount"]=33638494208 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # sizes["$mount"]=33639772160 00:07:55.863 04:52:34 -- common/autotest_common.sh@352 -- # uses["$mount"]=1277952 00:07:55.863 04:52:34 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:55.863 04:52:34 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # avails["$mount"]=13447159808 00:07:55.863 04:52:34 -- common/autotest_common.sh@351 -- # sizes["$mount"]=13455912960 00:07:55.864 04:52:34 -- common/autotest_common.sh@352 -- # uses["$mount"]=8753152 00:07:55.864 04:52:34 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:55.864 04:52:34 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:55.864 04:52:34 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:55.864 04:52:34 -- common/autotest_common.sh@351 -- # avails["$mount"]=33639194624 00:07:55.864 04:52:34 -- common/autotest_common.sh@351 -- # sizes["$mount"]=33639776256 00:07:55.864 04:52:34 -- common/autotest_common.sh@352 -- # uses["$mount"]=581632 00:07:55.864 04:52:34 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:55.864 04:52:34 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:55.864 04:52:34 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:55.864 04:52:34 -- common/autotest_common.sh@351 -- # avails["$mount"]=6727950336 00:07:55.864 04:52:34 -- common/autotest_common.sh@351 -- # sizes["$mount"]=6727954432 00:07:55.864 04:52:34 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:07:55.864 04:52:34 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:55.864 04:52:34 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:07:55.864 * Looking for test storage... 00:07:55.864 04:52:34 -- common/autotest_common.sh@357 -- # local target_space new_size 00:07:55.864 04:52:34 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:07:55.864 04:52:34 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.864 04:52:34 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:55.864 04:52:34 -- common/autotest_common.sh@361 -- # mount=/ 00:07:55.864 04:52:34 -- common/autotest_common.sh@363 -- # target_space=55630008320 00:07:55.864 04:52:34 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:07:55.864 04:52:34 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:07:55.864 04:52:34 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:07:55.864 04:52:34 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:07:55.864 04:52:34 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:07:55.864 04:52:34 -- common/autotest_common.sh@370 -- # new_size=13864132608 00:07:55.864 04:52:34 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:55.864 04:52:34 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.864 04:52:34 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.864 04:52:34 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.864 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.864 04:52:35 -- common/autotest_common.sh@378 -- # return 0 00:07:55.864 04:52:35 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:07:55.864 04:52:35 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:07:55.864 04:52:35 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:55.864 04:52:35 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:55.864 04:52:35 -- common/autotest_common.sh@1673 -- # true 00:07:55.864 04:52:35 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:07:55.864 04:52:35 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:55.864 04:52:35 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:55.864 04:52:35 -- common/autotest_common.sh@27 -- # exec 00:07:55.864 04:52:35 -- common/autotest_common.sh@29 -- # exec 00:07:55.864 04:52:35 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:55.864 04:52:35 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:55.864 04:52:35 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:55.864 04:52:35 -- common/autotest_common.sh@18 -- # set -x 00:07:55.864 04:52:35 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:55.864 04:52:35 -- nvmf/common.sh@7 -- # uname -s 00:07:55.864 04:52:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:55.864 04:52:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:55.864 04:52:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:55.864 04:52:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:55.864 04:52:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:55.864 04:52:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:55.864 04:52:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:55.864 04:52:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:55.864 04:52:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:55.864 04:52:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:55.864 04:52:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:55.864 04:52:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:55.864 04:52:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:55.864 04:52:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:55.864 04:52:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:55.864 04:52:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:55.864 04:52:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:55.864 04:52:35 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:55.864 04:52:35 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:55.864 04:52:35 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:55.864 04:52:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.864 04:52:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.864 04:52:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.864 04:52:35 -- paths/export.sh@5 -- # export PATH 00:07:55.864 04:52:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.864 04:52:35 -- nvmf/common.sh@47 -- # : 0 00:07:55.864 04:52:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:55.864 04:52:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:55.864 04:52:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:55.864 04:52:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:55.864 04:52:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:55.864 04:52:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:55.864 04:52:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:55.864 04:52:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:55.864 04:52:35 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:55.864 04:52:35 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:55.864 04:52:35 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:55.864 04:52:35 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:07:55.864 04:52:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:55.864 04:52:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:55.864 04:52:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:55.864 04:52:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:55.864 04:52:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:55.864 04:52:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:55.864 04:52:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:56.123 04:52:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:56.123 04:52:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:56.123 04:52:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:56.123 04:52:35 -- common/autotest_common.sh@10 -- # set +x 00:07:58.024 04:52:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:58.025 04:52:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:58.025 04:52:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:58.025 04:52:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:58.025 04:52:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:58.025 04:52:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:58.025 04:52:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:58.025 04:52:36 -- nvmf/common.sh@295 -- # net_devs=() 00:07:58.025 04:52:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:58.025 04:52:36 -- nvmf/common.sh@296 -- # e810=() 00:07:58.025 04:52:36 -- nvmf/common.sh@296 -- # local -ga e810 00:07:58.025 04:52:36 -- nvmf/common.sh@297 -- # x722=() 00:07:58.025 04:52:36 -- nvmf/common.sh@297 -- # local -ga x722 00:07:58.025 04:52:36 -- nvmf/common.sh@298 -- # mlx=() 00:07:58.025 04:52:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:58.025 04:52:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:58.025 04:52:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:58.025 04:52:36 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:58.025 04:52:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:58.025 04:52:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:58.025 04:52:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:58.025 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:58.025 04:52:36 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:58.025 04:52:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:58.025 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:58.025 04:52:36 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:58.025 04:52:36 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:58.025 04:52:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:58.025 04:52:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:58.025 04:52:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:58.025 04:52:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:58.025 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:58.025 04:52:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:58.025 04:52:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:58.025 04:52:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:58.025 04:52:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:58.025 04:52:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:58.025 04:52:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:58.025 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:58.025 04:52:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:58.025 04:52:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:58.025 04:52:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:58.025 04:52:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:07:58.025 04:52:36 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:07:58.025 04:52:36 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:58.025 04:52:36 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:58.025 04:52:36 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:58.025 04:52:36 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:07:58.025 04:52:36 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:58.025 04:52:36 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:58.025 04:52:36 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:07:58.025 04:52:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:58.025 04:52:36 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:58.025 04:52:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:07:58.025 04:52:36 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:07:58.025 04:52:36 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:07:58.025 04:52:36 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:58.025 04:52:37 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:58.025 04:52:37 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:58.025 04:52:37 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:07:58.025 04:52:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:58.025 04:52:37 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:58.025 04:52:37 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:58.025 04:52:37 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:07:58.025 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:58.025 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:07:58.025 00:07:58.025 --- 10.0.0.2 ping statistics --- 00:07:58.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:58.025 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:07:58.025 04:52:37 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:58.025 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:58.025 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:07:58.025 00:07:58.025 --- 10.0.0.1 ping statistics --- 00:07:58.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:58.025 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:07:58.025 04:52:37 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:58.025 04:52:37 -- nvmf/common.sh@411 -- # return 0 00:07:58.025 04:52:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:58.025 04:52:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:58.025 04:52:37 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:07:58.025 04:52:37 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:07:58.025 04:52:37 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:58.025 04:52:37 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:07:58.025 04:52:37 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:07:58.025 04:52:37 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:58.025 04:52:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:58.025 04:52:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:58.025 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.284 ************************************ 00:07:58.284 START TEST nvmf_filesystem_no_in_capsule 00:07:58.284 ************************************ 00:07:58.284 04:52:37 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:07:58.284 04:52:37 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:58.284 04:52:37 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:58.284 04:52:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:58.284 04:52:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:58.284 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.284 04:52:37 -- nvmf/common.sh@470 -- # nvmfpid=2291173 00:07:58.284 04:52:37 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:58.284 04:52:37 -- nvmf/common.sh@471 -- # waitforlisten 2291173 00:07:58.284 04:52:37 -- common/autotest_common.sh@817 -- # '[' -z 2291173 ']' 00:07:58.284 04:52:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:58.284 04:52:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:58.284 04:52:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:58.284 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:58.284 04:52:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:58.284 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.285 [2024-04-23 04:52:37.259267] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:07:58.285 [2024-04-23 04:52:37.259349] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:58.285 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.285 [2024-04-23 04:52:37.295036] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:07:58.285 [2024-04-23 04:52:37.325684] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:58.285 [2024-04-23 04:52:37.416208] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:58.285 [2024-04-23 04:52:37.416273] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:58.285 [2024-04-23 04:52:37.416289] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:58.285 [2024-04-23 04:52:37.416303] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:58.285 [2024-04-23 04:52:37.416315] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:58.285 [2024-04-23 04:52:37.416398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:58.285 [2024-04-23 04:52:37.416454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:58.285 [2024-04-23 04:52:37.416573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:58.285 [2024-04-23 04:52:37.416575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.543 04:52:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:58.543 04:52:37 -- common/autotest_common.sh@850 -- # return 0 00:07:58.543 04:52:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:58.543 04:52:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:58.543 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.543 04:52:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:58.543 04:52:37 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:58.543 04:52:37 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:58.543 04:52:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:58.543 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.543 [2024-04-23 04:52:37.581260] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:58.543 04:52:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:58.543 04:52:37 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:58.543 04:52:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:58.543 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.801 Malloc1 00:07:58.801 04:52:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:58.801 04:52:37 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:58.801 04:52:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:58.801 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.801 04:52:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:58.801 04:52:37 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:58.801 04:52:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:58.801 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.801 04:52:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:58.801 04:52:37 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:58.801 04:52:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:58.801 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.801 [2024-04-23 04:52:37.767756] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:58.801 04:52:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:58.801 04:52:37 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:58.801 04:52:37 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:07:58.801 04:52:37 -- common/autotest_common.sh@1365 -- # local bdev_info 00:07:58.801 04:52:37 -- common/autotest_common.sh@1366 -- # local bs 00:07:58.801 04:52:37 -- common/autotest_common.sh@1367 -- # local nb 00:07:58.801 04:52:37 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:58.801 04:52:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:58.801 04:52:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.801 04:52:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:58.801 04:52:37 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:07:58.801 { 00:07:58.801 "name": "Malloc1", 00:07:58.801 "aliases": [ 00:07:58.801 "556181ac-3c4b-4d4c-9575-da406d1891ba" 00:07:58.801 ], 00:07:58.801 "product_name": "Malloc disk", 00:07:58.801 "block_size": 512, 00:07:58.801 "num_blocks": 1048576, 00:07:58.801 "uuid": "556181ac-3c4b-4d4c-9575-da406d1891ba", 00:07:58.801 "assigned_rate_limits": { 00:07:58.801 "rw_ios_per_sec": 0, 00:07:58.801 "rw_mbytes_per_sec": 0, 00:07:58.801 "r_mbytes_per_sec": 0, 00:07:58.801 "w_mbytes_per_sec": 0 00:07:58.801 }, 00:07:58.801 "claimed": true, 00:07:58.801 "claim_type": "exclusive_write", 00:07:58.801 "zoned": false, 00:07:58.801 "supported_io_types": { 00:07:58.801 "read": true, 00:07:58.801 "write": true, 00:07:58.801 "unmap": true, 00:07:58.801 "write_zeroes": true, 00:07:58.801 "flush": true, 00:07:58.801 "reset": true, 00:07:58.801 "compare": false, 00:07:58.801 "compare_and_write": false, 00:07:58.801 "abort": true, 00:07:58.801 "nvme_admin": false, 00:07:58.801 "nvme_io": false 00:07:58.801 }, 00:07:58.801 "memory_domains": [ 00:07:58.801 { 00:07:58.801 "dma_device_id": "system", 00:07:58.801 "dma_device_type": 1 00:07:58.801 }, 00:07:58.801 { 00:07:58.801 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:58.801 "dma_device_type": 2 00:07:58.801 } 00:07:58.801 ], 00:07:58.801 "driver_specific": {} 00:07:58.801 } 00:07:58.801 ]' 00:07:58.801 04:52:37 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:07:58.801 04:52:37 -- common/autotest_common.sh@1369 -- # bs=512 00:07:58.801 04:52:37 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:07:58.801 04:52:37 -- common/autotest_common.sh@1370 -- # nb=1048576 00:07:58.801 04:52:37 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:07:58.801 04:52:37 -- common/autotest_common.sh@1374 -- # echo 512 00:07:58.801 04:52:37 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:58.802 04:52:37 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:59.367 04:52:38 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:59.367 04:52:38 -- common/autotest_common.sh@1184 -- # local i=0 00:07:59.367 04:52:38 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:59.367 04:52:38 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:59.367 04:52:38 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:01.892 04:52:40 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:01.892 04:52:40 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:01.892 04:52:40 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:01.892 04:52:40 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:01.892 04:52:40 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:01.892 04:52:40 -- common/autotest_common.sh@1194 -- # return 0 00:08:01.892 04:52:40 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:01.892 04:52:40 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:01.892 04:52:40 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:01.892 04:52:40 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:01.892 04:52:40 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:01.892 04:52:40 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:01.892 04:52:40 -- setup/common.sh@80 -- # echo 536870912 00:08:01.892 04:52:40 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:01.892 04:52:40 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:01.892 04:52:40 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:01.892 04:52:40 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:01.892 04:52:40 -- target/filesystem.sh@69 -- # partprobe 00:08:02.879 04:52:41 -- target/filesystem.sh@70 -- # sleep 1 00:08:03.812 04:52:42 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:03.812 04:52:42 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:03.812 04:52:42 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:03.812 04:52:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.812 04:52:42 -- common/autotest_common.sh@10 -- # set +x 00:08:03.812 ************************************ 00:08:03.812 START TEST filesystem_ext4 00:08:03.812 ************************************ 00:08:03.812 04:52:42 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:03.812 04:52:42 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:03.812 04:52:42 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:03.812 04:52:42 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:03.812 04:52:42 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:03.812 04:52:42 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:03.812 04:52:42 -- common/autotest_common.sh@914 -- # local i=0 00:08:03.812 04:52:42 -- common/autotest_common.sh@915 -- # local force 00:08:03.812 04:52:42 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:03.812 04:52:42 -- common/autotest_common.sh@918 -- # force=-F 00:08:03.812 04:52:42 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:03.812 mke2fs 1.46.5 (30-Dec-2021) 00:08:03.812 Discarding device blocks: 0/522240 done 00:08:03.812 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:03.812 Filesystem UUID: a4df9df2-94d3-4fb8-bd9c-a5d263f19834 00:08:03.812 Superblock backups stored on blocks: 00:08:03.812 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:03.812 00:08:03.812 Allocating group tables: 0/64 done 00:08:03.812 Writing inode tables: 0/64 done 00:08:06.335 Creating journal (8192 blocks): done 00:08:06.335 Writing superblocks and filesystem accounting information: 0/64 done 00:08:06.335 00:08:06.335 04:52:44 -- common/autotest_common.sh@931 -- # return 0 00:08:06.335 04:52:44 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:06.335 04:52:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:06.335 04:52:45 -- target/filesystem.sh@25 -- # sync 00:08:06.335 04:52:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:06.335 04:52:45 -- target/filesystem.sh@27 -- # sync 00:08:06.335 04:52:45 -- target/filesystem.sh@29 -- # i=0 00:08:06.335 04:52:45 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:06.335 04:52:45 -- target/filesystem.sh@37 -- # kill -0 2291173 00:08:06.335 04:52:45 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:06.335 04:52:45 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:06.335 04:52:45 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:06.335 04:52:45 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:06.335 00:08:06.335 real 0m2.557s 00:08:06.335 user 0m0.007s 00:08:06.335 sys 0m0.035s 00:08:06.335 04:52:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:06.335 04:52:45 -- common/autotest_common.sh@10 -- # set +x 00:08:06.335 ************************************ 00:08:06.335 END TEST filesystem_ext4 00:08:06.335 ************************************ 00:08:06.335 04:52:45 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:06.335 04:52:45 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:06.335 04:52:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:06.335 04:52:45 -- common/autotest_common.sh@10 -- # set +x 00:08:06.335 ************************************ 00:08:06.335 START TEST filesystem_btrfs 00:08:06.335 ************************************ 00:08:06.335 04:52:45 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:06.335 04:52:45 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:06.335 04:52:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:06.335 04:52:45 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:06.335 04:52:45 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:06.335 04:52:45 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:06.335 04:52:45 -- common/autotest_common.sh@914 -- # local i=0 00:08:06.335 04:52:45 -- common/autotest_common.sh@915 -- # local force 00:08:06.335 04:52:45 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:06.335 04:52:45 -- common/autotest_common.sh@920 -- # force=-f 00:08:06.335 04:52:45 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:06.593 btrfs-progs v6.6.2 00:08:06.593 See https://btrfs.readthedocs.io for more information. 00:08:06.593 00:08:06.593 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:06.593 NOTE: several default settings have changed in version 5.15, please make sure 00:08:06.593 this does not affect your deployments: 00:08:06.593 - DUP for metadata (-m dup) 00:08:06.593 - enabled no-holes (-O no-holes) 00:08:06.593 - enabled free-space-tree (-R free-space-tree) 00:08:06.593 00:08:06.593 Label: (null) 00:08:06.593 UUID: 2574eefd-86be-4eca-850f-5424058977f1 00:08:06.593 Node size: 16384 00:08:06.593 Sector size: 4096 00:08:06.593 Filesystem size: 510.00MiB 00:08:06.593 Block group profiles: 00:08:06.593 Data: single 8.00MiB 00:08:06.593 Metadata: DUP 32.00MiB 00:08:06.594 System: DUP 8.00MiB 00:08:06.594 SSD detected: yes 00:08:06.594 Zoned device: no 00:08:06.594 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:06.594 Runtime features: free-space-tree 00:08:06.594 Checksum: crc32c 00:08:06.594 Number of devices: 1 00:08:06.594 Devices: 00:08:06.594 ID SIZE PATH 00:08:06.594 1 510.00MiB /dev/nvme0n1p1 00:08:06.594 00:08:06.594 04:52:45 -- common/autotest_common.sh@931 -- # return 0 00:08:06.594 04:52:45 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:07.158 04:52:46 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:07.159 04:52:46 -- target/filesystem.sh@25 -- # sync 00:08:07.159 04:52:46 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:07.159 04:52:46 -- target/filesystem.sh@27 -- # sync 00:08:07.159 04:52:46 -- target/filesystem.sh@29 -- # i=0 00:08:07.159 04:52:46 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:07.159 04:52:46 -- target/filesystem.sh@37 -- # kill -0 2291173 00:08:07.159 04:52:46 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:07.159 04:52:46 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:07.159 04:52:46 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:07.159 04:52:46 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:07.159 00:08:07.159 real 0m0.833s 00:08:07.159 user 0m0.018s 00:08:07.159 sys 0m0.034s 00:08:07.159 04:52:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:07.159 04:52:46 -- common/autotest_common.sh@10 -- # set +x 00:08:07.159 ************************************ 00:08:07.159 END TEST filesystem_btrfs 00:08:07.159 ************************************ 00:08:07.159 04:52:46 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:07.159 04:52:46 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:07.159 04:52:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:07.159 04:52:46 -- common/autotest_common.sh@10 -- # set +x 00:08:07.417 ************************************ 00:08:07.417 START TEST filesystem_xfs 00:08:07.417 ************************************ 00:08:07.417 04:52:46 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:07.417 04:52:46 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:07.417 04:52:46 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:07.417 04:52:46 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:07.417 04:52:46 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:07.417 04:52:46 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:07.417 04:52:46 -- common/autotest_common.sh@914 -- # local i=0 00:08:07.417 04:52:46 -- common/autotest_common.sh@915 -- # local force 00:08:07.417 04:52:46 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:07.417 04:52:46 -- common/autotest_common.sh@920 -- # force=-f 00:08:07.417 04:52:46 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:07.417 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:07.417 = sectsz=512 attr=2, projid32bit=1 00:08:07.417 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:07.417 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:07.417 data = bsize=4096 blocks=130560, imaxpct=25 00:08:07.417 = sunit=0 swidth=0 blks 00:08:07.417 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:07.417 log =internal log bsize=4096 blocks=16384, version=2 00:08:07.417 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:07.417 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:08.789 Discarding blocks...Done. 00:08:08.789 04:52:47 -- common/autotest_common.sh@931 -- # return 0 00:08:08.789 04:52:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:10.160 04:52:49 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:10.417 04:52:49 -- target/filesystem.sh@25 -- # sync 00:08:10.417 04:52:49 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:10.417 04:52:49 -- target/filesystem.sh@27 -- # sync 00:08:10.417 04:52:49 -- target/filesystem.sh@29 -- # i=0 00:08:10.417 04:52:49 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:10.417 04:52:49 -- target/filesystem.sh@37 -- # kill -0 2291173 00:08:10.417 04:52:49 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:10.417 04:52:49 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:10.417 04:52:49 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:10.417 04:52:49 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:10.417 00:08:10.417 real 0m3.055s 00:08:10.417 user 0m0.016s 00:08:10.417 sys 0m0.033s 00:08:10.417 04:52:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:10.417 04:52:49 -- common/autotest_common.sh@10 -- # set +x 00:08:10.417 ************************************ 00:08:10.417 END TEST filesystem_xfs 00:08:10.417 ************************************ 00:08:10.417 04:52:49 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:10.674 04:52:49 -- target/filesystem.sh@93 -- # sync 00:08:10.674 04:52:49 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:10.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.674 04:52:49 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:10.674 04:52:49 -- common/autotest_common.sh@1205 -- # local i=0 00:08:10.674 04:52:49 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:10.674 04:52:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:10.674 04:52:49 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:10.674 04:52:49 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:10.674 04:52:49 -- common/autotest_common.sh@1217 -- # return 0 00:08:10.674 04:52:49 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:10.674 04:52:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.674 04:52:49 -- common/autotest_common.sh@10 -- # set +x 00:08:10.674 04:52:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.674 04:52:49 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:10.674 04:52:49 -- target/filesystem.sh@101 -- # killprocess 2291173 00:08:10.674 04:52:49 -- common/autotest_common.sh@936 -- # '[' -z 2291173 ']' 00:08:10.674 04:52:49 -- common/autotest_common.sh@940 -- # kill -0 2291173 00:08:10.674 04:52:49 -- common/autotest_common.sh@941 -- # uname 00:08:10.674 04:52:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:10.674 04:52:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2291173 00:08:10.933 04:52:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:10.933 04:52:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:10.933 04:52:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2291173' 00:08:10.933 killing process with pid 2291173 00:08:10.933 04:52:49 -- common/autotest_common.sh@955 -- # kill 2291173 00:08:10.933 04:52:49 -- common/autotest_common.sh@960 -- # wait 2291173 00:08:11.191 04:52:50 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:11.191 00:08:11.191 real 0m13.059s 00:08:11.191 user 0m50.254s 00:08:11.191 sys 0m1.848s 00:08:11.191 04:52:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:11.191 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.191 ************************************ 00:08:11.191 END TEST nvmf_filesystem_no_in_capsule 00:08:11.191 ************************************ 00:08:11.191 04:52:50 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:11.191 04:52:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:11.191 04:52:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:11.191 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.450 ************************************ 00:08:11.450 START TEST nvmf_filesystem_in_capsule 00:08:11.450 ************************************ 00:08:11.450 04:52:50 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:08:11.450 04:52:50 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:11.450 04:52:50 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:11.450 04:52:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:11.450 04:52:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:11.450 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.450 04:52:50 -- nvmf/common.sh@470 -- # nvmfpid=2292904 00:08:11.450 04:52:50 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:11.450 04:52:50 -- nvmf/common.sh@471 -- # waitforlisten 2292904 00:08:11.450 04:52:50 -- common/autotest_common.sh@817 -- # '[' -z 2292904 ']' 00:08:11.450 04:52:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:11.450 04:52:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:11.450 04:52:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:11.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:11.450 04:52:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:11.450 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.450 [2024-04-23 04:52:50.452280] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:08:11.450 [2024-04-23 04:52:50.452381] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:11.450 EAL: No free 2048 kB hugepages reported on node 1 00:08:11.450 [2024-04-23 04:52:50.490242] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:08:11.450 [2024-04-23 04:52:50.516916] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:11.450 [2024-04-23 04:52:50.604732] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:11.450 [2024-04-23 04:52:50.604802] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:11.450 [2024-04-23 04:52:50.604816] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:11.450 [2024-04-23 04:52:50.604826] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:11.450 [2024-04-23 04:52:50.604837] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:11.450 [2024-04-23 04:52:50.604911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:11.450 [2024-04-23 04:52:50.604973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:11.450 [2024-04-23 04:52:50.605018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:11.450 [2024-04-23 04:52:50.605021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.709 04:52:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:11.709 04:52:50 -- common/autotest_common.sh@850 -- # return 0 00:08:11.709 04:52:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:11.709 04:52:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:11.709 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.709 04:52:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:11.709 04:52:50 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:11.709 04:52:50 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:11.709 04:52:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:11.709 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.709 [2024-04-23 04:52:50.763336] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:11.709 04:52:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:11.709 04:52:50 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:11.709 04:52:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:11.709 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.966 Malloc1 00:08:11.966 04:52:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:11.966 04:52:50 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:11.966 04:52:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:11.966 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.966 04:52:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:11.966 04:52:50 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:11.966 04:52:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:11.966 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.966 04:52:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:11.966 04:52:50 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:11.966 04:52:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:11.966 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.966 [2024-04-23 04:52:50.950829] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:11.966 04:52:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:11.966 04:52:50 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:11.966 04:52:50 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:08:11.966 04:52:50 -- common/autotest_common.sh@1365 -- # local bdev_info 00:08:11.966 04:52:50 -- common/autotest_common.sh@1366 -- # local bs 00:08:11.966 04:52:50 -- common/autotest_common.sh@1367 -- # local nb 00:08:11.966 04:52:50 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:11.967 04:52:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:11.967 04:52:50 -- common/autotest_common.sh@10 -- # set +x 00:08:11.967 04:52:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:11.967 04:52:50 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:08:11.967 { 00:08:11.967 "name": "Malloc1", 00:08:11.967 "aliases": [ 00:08:11.967 "6b217d12-1e28-4827-a3d3-401eaa252215" 00:08:11.967 ], 00:08:11.967 "product_name": "Malloc disk", 00:08:11.967 "block_size": 512, 00:08:11.967 "num_blocks": 1048576, 00:08:11.967 "uuid": "6b217d12-1e28-4827-a3d3-401eaa252215", 00:08:11.967 "assigned_rate_limits": { 00:08:11.967 "rw_ios_per_sec": 0, 00:08:11.967 "rw_mbytes_per_sec": 0, 00:08:11.967 "r_mbytes_per_sec": 0, 00:08:11.967 "w_mbytes_per_sec": 0 00:08:11.967 }, 00:08:11.967 "claimed": true, 00:08:11.967 "claim_type": "exclusive_write", 00:08:11.967 "zoned": false, 00:08:11.967 "supported_io_types": { 00:08:11.967 "read": true, 00:08:11.967 "write": true, 00:08:11.967 "unmap": true, 00:08:11.967 "write_zeroes": true, 00:08:11.967 "flush": true, 00:08:11.967 "reset": true, 00:08:11.967 "compare": false, 00:08:11.967 "compare_and_write": false, 00:08:11.967 "abort": true, 00:08:11.967 "nvme_admin": false, 00:08:11.967 "nvme_io": false 00:08:11.967 }, 00:08:11.967 "memory_domains": [ 00:08:11.967 { 00:08:11.967 "dma_device_id": "system", 00:08:11.967 "dma_device_type": 1 00:08:11.967 }, 00:08:11.967 { 00:08:11.967 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:11.967 "dma_device_type": 2 00:08:11.967 } 00:08:11.967 ], 00:08:11.967 "driver_specific": {} 00:08:11.967 } 00:08:11.967 ]' 00:08:11.967 04:52:50 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:08:11.967 04:52:51 -- common/autotest_common.sh@1369 -- # bs=512 00:08:11.967 04:52:51 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:08:11.967 04:52:51 -- common/autotest_common.sh@1370 -- # nb=1048576 00:08:11.967 04:52:51 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:08:11.967 04:52:51 -- common/autotest_common.sh@1374 -- # echo 512 00:08:11.967 04:52:51 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:11.967 04:52:51 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:12.532 04:52:51 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:12.532 04:52:51 -- common/autotest_common.sh@1184 -- # local i=0 00:08:12.532 04:52:51 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:12.532 04:52:51 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:12.532 04:52:51 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:15.055 04:52:53 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:15.055 04:52:53 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:15.055 04:52:53 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:15.055 04:52:53 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:15.055 04:52:53 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:15.055 04:52:53 -- common/autotest_common.sh@1194 -- # return 0 00:08:15.055 04:52:53 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:15.055 04:52:53 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:15.055 04:52:53 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:15.055 04:52:53 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:15.055 04:52:53 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:15.055 04:52:53 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:15.055 04:52:53 -- setup/common.sh@80 -- # echo 536870912 00:08:15.055 04:52:53 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:15.055 04:52:53 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:15.055 04:52:53 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:15.055 04:52:53 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:15.055 04:52:53 -- target/filesystem.sh@69 -- # partprobe 00:08:15.313 04:52:54 -- target/filesystem.sh@70 -- # sleep 1 00:08:16.247 04:52:55 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:16.247 04:52:55 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:16.247 04:52:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:16.247 04:52:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.247 04:52:55 -- common/autotest_common.sh@10 -- # set +x 00:08:16.247 ************************************ 00:08:16.247 START TEST filesystem_in_capsule_ext4 00:08:16.247 ************************************ 00:08:16.247 04:52:55 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:16.247 04:52:55 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:16.247 04:52:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:16.247 04:52:55 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:16.247 04:52:55 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:16.247 04:52:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:16.247 04:52:55 -- common/autotest_common.sh@914 -- # local i=0 00:08:16.247 04:52:55 -- common/autotest_common.sh@915 -- # local force 00:08:16.247 04:52:55 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:16.247 04:52:55 -- common/autotest_common.sh@918 -- # force=-F 00:08:16.247 04:52:55 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:16.247 mke2fs 1.46.5 (30-Dec-2021) 00:08:16.505 Discarding device blocks: 0/522240 done 00:08:16.505 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:16.505 Filesystem UUID: c581cf6b-1dff-40a1-9e31-177ffc5d0664 00:08:16.505 Superblock backups stored on blocks: 00:08:16.505 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:16.505 00:08:16.505 Allocating group tables: 0/64 done 00:08:16.505 Writing inode tables: 0/64 done 00:08:16.505 Creating journal (8192 blocks): done 00:08:17.070 Writing superblocks and filesystem accounting information: 0/64 8/64 done 00:08:17.070 00:08:17.070 04:52:56 -- common/autotest_common.sh@931 -- # return 0 00:08:17.070 04:52:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:18.004 04:52:57 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:18.004 04:52:57 -- target/filesystem.sh@25 -- # sync 00:08:18.004 04:52:57 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:18.004 04:52:57 -- target/filesystem.sh@27 -- # sync 00:08:18.004 04:52:57 -- target/filesystem.sh@29 -- # i=0 00:08:18.004 04:52:57 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:18.004 04:52:57 -- target/filesystem.sh@37 -- # kill -0 2292904 00:08:18.004 04:52:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:18.004 04:52:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:18.004 04:52:57 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:18.004 04:52:57 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:18.004 00:08:18.004 real 0m1.757s 00:08:18.004 user 0m0.014s 00:08:18.004 sys 0m0.032s 00:08:18.004 04:52:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:18.004 04:52:57 -- common/autotest_common.sh@10 -- # set +x 00:08:18.004 ************************************ 00:08:18.004 END TEST filesystem_in_capsule_ext4 00:08:18.004 ************************************ 00:08:18.004 04:52:57 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:18.004 04:52:57 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:18.004 04:52:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:18.004 04:52:57 -- common/autotest_common.sh@10 -- # set +x 00:08:18.262 ************************************ 00:08:18.262 START TEST filesystem_in_capsule_btrfs 00:08:18.262 ************************************ 00:08:18.262 04:52:57 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:18.262 04:52:57 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:18.262 04:52:57 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:18.262 04:52:57 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:18.262 04:52:57 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:18.262 04:52:57 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:18.262 04:52:57 -- common/autotest_common.sh@914 -- # local i=0 00:08:18.262 04:52:57 -- common/autotest_common.sh@915 -- # local force 00:08:18.262 04:52:57 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:18.262 04:52:57 -- common/autotest_common.sh@920 -- # force=-f 00:08:18.262 04:52:57 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:18.520 btrfs-progs v6.6.2 00:08:18.520 See https://btrfs.readthedocs.io for more information. 00:08:18.520 00:08:18.520 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:18.520 NOTE: several default settings have changed in version 5.15, please make sure 00:08:18.520 this does not affect your deployments: 00:08:18.520 - DUP for metadata (-m dup) 00:08:18.520 - enabled no-holes (-O no-holes) 00:08:18.520 - enabled free-space-tree (-R free-space-tree) 00:08:18.520 00:08:18.520 Label: (null) 00:08:18.520 UUID: 419e3c0d-c6e3-44c3-bea5-53724bed3104 00:08:18.520 Node size: 16384 00:08:18.520 Sector size: 4096 00:08:18.520 Filesystem size: 510.00MiB 00:08:18.520 Block group profiles: 00:08:18.520 Data: single 8.00MiB 00:08:18.520 Metadata: DUP 32.00MiB 00:08:18.520 System: DUP 8.00MiB 00:08:18.520 SSD detected: yes 00:08:18.520 Zoned device: no 00:08:18.520 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:18.520 Runtime features: free-space-tree 00:08:18.520 Checksum: crc32c 00:08:18.520 Number of devices: 1 00:08:18.520 Devices: 00:08:18.520 ID SIZE PATH 00:08:18.520 1 510.00MiB /dev/nvme0n1p1 00:08:18.520 00:08:18.520 04:52:57 -- common/autotest_common.sh@931 -- # return 0 00:08:18.520 04:52:57 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:19.454 04:52:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:19.454 04:52:58 -- target/filesystem.sh@25 -- # sync 00:08:19.454 04:52:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:19.454 04:52:58 -- target/filesystem.sh@27 -- # sync 00:08:19.454 04:52:58 -- target/filesystem.sh@29 -- # i=0 00:08:19.454 04:52:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:19.454 04:52:58 -- target/filesystem.sh@37 -- # kill -0 2292904 00:08:19.454 04:52:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:19.454 04:52:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:19.454 04:52:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:19.454 04:52:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:19.454 00:08:19.454 real 0m1.088s 00:08:19.454 user 0m0.012s 00:08:19.454 sys 0m0.044s 00:08:19.454 04:52:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:19.454 04:52:58 -- common/autotest_common.sh@10 -- # set +x 00:08:19.454 ************************************ 00:08:19.454 END TEST filesystem_in_capsule_btrfs 00:08:19.454 ************************************ 00:08:19.454 04:52:58 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:19.454 04:52:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:19.454 04:52:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:19.454 04:52:58 -- common/autotest_common.sh@10 -- # set +x 00:08:19.454 ************************************ 00:08:19.454 START TEST filesystem_in_capsule_xfs 00:08:19.454 ************************************ 00:08:19.454 04:52:58 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:19.454 04:52:58 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:19.454 04:52:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:19.454 04:52:58 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:19.454 04:52:58 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:19.454 04:52:58 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:19.454 04:52:58 -- common/autotest_common.sh@914 -- # local i=0 00:08:19.454 04:52:58 -- common/autotest_common.sh@915 -- # local force 00:08:19.454 04:52:58 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:19.454 04:52:58 -- common/autotest_common.sh@920 -- # force=-f 00:08:19.454 04:52:58 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:19.454 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:19.454 = sectsz=512 attr=2, projid32bit=1 00:08:19.454 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:19.454 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:19.454 data = bsize=4096 blocks=130560, imaxpct=25 00:08:19.454 = sunit=0 swidth=0 blks 00:08:19.454 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:19.454 log =internal log bsize=4096 blocks=16384, version=2 00:08:19.454 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:19.454 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:20.417 Discarding blocks...Done. 00:08:20.417 04:52:59 -- common/autotest_common.sh@931 -- # return 0 00:08:20.417 04:52:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:22.943 04:53:02 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:22.943 04:53:02 -- target/filesystem.sh@25 -- # sync 00:08:22.943 04:53:02 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:22.943 04:53:02 -- target/filesystem.sh@27 -- # sync 00:08:22.943 04:53:02 -- target/filesystem.sh@29 -- # i=0 00:08:22.943 04:53:02 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:22.943 04:53:02 -- target/filesystem.sh@37 -- # kill -0 2292904 00:08:22.943 04:53:02 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:22.943 04:53:02 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:22.943 04:53:02 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:22.943 04:53:02 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:22.943 00:08:22.943 real 0m3.660s 00:08:22.943 user 0m0.017s 00:08:22.943 sys 0m0.031s 00:08:22.943 04:53:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:22.943 04:53:02 -- common/autotest_common.sh@10 -- # set +x 00:08:22.943 ************************************ 00:08:22.943 END TEST filesystem_in_capsule_xfs 00:08:22.943 ************************************ 00:08:22.943 04:53:02 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:23.202 04:53:02 -- target/filesystem.sh@93 -- # sync 00:08:23.202 04:53:02 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:23.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.202 04:53:02 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:23.202 04:53:02 -- common/autotest_common.sh@1205 -- # local i=0 00:08:23.202 04:53:02 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:23.202 04:53:02 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:23.202 04:53:02 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:23.202 04:53:02 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:23.202 04:53:02 -- common/autotest_common.sh@1217 -- # return 0 00:08:23.202 04:53:02 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:23.202 04:53:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:23.202 04:53:02 -- common/autotest_common.sh@10 -- # set +x 00:08:23.202 04:53:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:23.202 04:53:02 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:23.202 04:53:02 -- target/filesystem.sh@101 -- # killprocess 2292904 00:08:23.202 04:53:02 -- common/autotest_common.sh@936 -- # '[' -z 2292904 ']' 00:08:23.202 04:53:02 -- common/autotest_common.sh@940 -- # kill -0 2292904 00:08:23.202 04:53:02 -- common/autotest_common.sh@941 -- # uname 00:08:23.202 04:53:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:23.202 04:53:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2292904 00:08:23.202 04:53:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:23.202 04:53:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:23.202 04:53:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2292904' 00:08:23.202 killing process with pid 2292904 00:08:23.202 04:53:02 -- common/autotest_common.sh@955 -- # kill 2292904 00:08:23.202 04:53:02 -- common/autotest_common.sh@960 -- # wait 2292904 00:08:23.768 04:53:02 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:23.768 00:08:23.768 real 0m12.297s 00:08:23.768 user 0m47.230s 00:08:23.768 sys 0m1.848s 00:08:23.768 04:53:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:23.768 04:53:02 -- common/autotest_common.sh@10 -- # set +x 00:08:23.768 ************************************ 00:08:23.768 END TEST nvmf_filesystem_in_capsule 00:08:23.768 ************************************ 00:08:23.768 04:53:02 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:23.768 04:53:02 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:23.768 04:53:02 -- nvmf/common.sh@117 -- # sync 00:08:23.768 04:53:02 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:08:23.768 04:53:02 -- nvmf/common.sh@120 -- # set +e 00:08:23.768 04:53:02 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:23.768 04:53:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:08:23.768 rmmod nvme_tcp 00:08:23.768 rmmod nvme_fabrics 00:08:23.768 rmmod nvme_keyring 00:08:23.768 04:53:02 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:23.768 04:53:02 -- nvmf/common.sh@124 -- # set -e 00:08:23.768 04:53:02 -- nvmf/common.sh@125 -- # return 0 00:08:23.768 04:53:02 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:08:23.768 04:53:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:23.768 04:53:02 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:08:23.768 04:53:02 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:08:23.768 04:53:02 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:23.768 04:53:02 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:08:23.768 04:53:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:23.768 04:53:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:23.768 04:53:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:25.668 04:53:04 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:08:25.668 00:08:25.668 real 0m29.958s 00:08:25.668 user 1m38.455s 00:08:25.668 sys 0m5.295s 00:08:25.668 04:53:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:25.668 04:53:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.668 ************************************ 00:08:25.668 END TEST nvmf_filesystem 00:08:25.668 ************************************ 00:08:25.926 04:53:04 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:25.926 04:53:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:25.926 04:53:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:25.926 04:53:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.926 ************************************ 00:08:25.926 START TEST nvmf_discovery 00:08:25.926 ************************************ 00:08:25.926 04:53:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:25.926 * Looking for test storage... 00:08:25.926 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:25.926 04:53:05 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:25.926 04:53:05 -- nvmf/common.sh@7 -- # uname -s 00:08:25.926 04:53:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:25.926 04:53:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:25.926 04:53:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:25.926 04:53:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:25.926 04:53:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:25.926 04:53:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:25.926 04:53:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:25.926 04:53:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:25.926 04:53:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:25.926 04:53:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:25.926 04:53:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:25.926 04:53:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:25.926 04:53:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:25.926 04:53:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:25.926 04:53:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:25.926 04:53:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:25.926 04:53:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:25.926 04:53:05 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:25.926 04:53:05 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:25.926 04:53:05 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:25.926 04:53:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.926 04:53:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.926 04:53:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.926 04:53:05 -- paths/export.sh@5 -- # export PATH 00:08:25.926 04:53:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:25.926 04:53:05 -- nvmf/common.sh@47 -- # : 0 00:08:25.926 04:53:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:25.926 04:53:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:25.927 04:53:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:25.927 04:53:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:25.927 04:53:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:25.927 04:53:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:25.927 04:53:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:25.927 04:53:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:25.927 04:53:05 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:25.927 04:53:05 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:25.927 04:53:05 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:25.927 04:53:05 -- target/discovery.sh@15 -- # hash nvme 00:08:25.927 04:53:05 -- target/discovery.sh@20 -- # nvmftestinit 00:08:25.927 04:53:05 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:08:25.927 04:53:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:25.927 04:53:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:25.927 04:53:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:25.927 04:53:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:25.927 04:53:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:25.927 04:53:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:25.927 04:53:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:25.927 04:53:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:25.927 04:53:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:25.927 04:53:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:25.927 04:53:05 -- common/autotest_common.sh@10 -- # set +x 00:08:28.461 04:53:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:28.461 04:53:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:28.461 04:53:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:28.461 04:53:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:28.461 04:53:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:28.461 04:53:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:28.461 04:53:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:28.461 04:53:07 -- nvmf/common.sh@295 -- # net_devs=() 00:08:28.461 04:53:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:28.461 04:53:07 -- nvmf/common.sh@296 -- # e810=() 00:08:28.461 04:53:07 -- nvmf/common.sh@296 -- # local -ga e810 00:08:28.461 04:53:07 -- nvmf/common.sh@297 -- # x722=() 00:08:28.461 04:53:07 -- nvmf/common.sh@297 -- # local -ga x722 00:08:28.461 04:53:07 -- nvmf/common.sh@298 -- # mlx=() 00:08:28.461 04:53:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:28.461 04:53:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:28.461 04:53:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:28.461 04:53:07 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:28.461 04:53:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:28.461 04:53:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:28.461 04:53:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:28.461 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:28.461 04:53:07 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:28.461 04:53:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:28.461 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:28.461 04:53:07 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:28.461 04:53:07 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:28.461 04:53:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:28.461 04:53:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:28.461 04:53:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:28.461 04:53:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:28.461 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:28.461 04:53:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:28.461 04:53:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:28.461 04:53:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:28.461 04:53:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:28.461 04:53:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:28.461 04:53:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:28.461 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:28.461 04:53:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:28.461 04:53:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:28.461 04:53:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:28.461 04:53:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:08:28.461 04:53:07 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:08:28.461 04:53:07 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:28.461 04:53:07 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:28.461 04:53:07 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:28.461 04:53:07 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:08:28.461 04:53:07 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:28.461 04:53:07 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:28.461 04:53:07 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:08:28.461 04:53:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:28.461 04:53:07 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:28.461 04:53:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:08:28.461 04:53:07 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:08:28.461 04:53:07 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:08:28.462 04:53:07 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:28.462 04:53:07 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:28.462 04:53:07 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:28.462 04:53:07 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:08:28.462 04:53:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:28.462 04:53:07 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:28.462 04:53:07 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:28.462 04:53:07 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:08:28.462 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:28.462 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:08:28.462 00:08:28.462 --- 10.0.0.2 ping statistics --- 00:08:28.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:28.462 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:08:28.462 04:53:07 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:28.462 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:28.462 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:08:28.462 00:08:28.462 --- 10.0.0.1 ping statistics --- 00:08:28.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:28.462 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:08:28.462 04:53:07 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:28.462 04:53:07 -- nvmf/common.sh@411 -- # return 0 00:08:28.462 04:53:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:28.462 04:53:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:28.462 04:53:07 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:08:28.462 04:53:07 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:08:28.462 04:53:07 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:28.462 04:53:07 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:08:28.462 04:53:07 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:08:28.462 04:53:07 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:28.462 04:53:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:28.462 04:53:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:28.462 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.462 04:53:07 -- nvmf/common.sh@470 -- # nvmfpid=2296537 00:08:28.462 04:53:07 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:28.462 04:53:07 -- nvmf/common.sh@471 -- # waitforlisten 2296537 00:08:28.462 04:53:07 -- common/autotest_common.sh@817 -- # '[' -z 2296537 ']' 00:08:28.462 04:53:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:28.462 04:53:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:28.462 04:53:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:28.462 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:28.462 04:53:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:28.462 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.462 [2024-04-23 04:53:07.295701] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:08:28.462 [2024-04-23 04:53:07.295772] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:28.462 EAL: No free 2048 kB hugepages reported on node 1 00:08:28.462 [2024-04-23 04:53:07.333336] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:08:28.462 [2024-04-23 04:53:07.365453] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:28.462 [2024-04-23 04:53:07.454465] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:28.462 [2024-04-23 04:53:07.454532] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:28.462 [2024-04-23 04:53:07.454551] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:28.462 [2024-04-23 04:53:07.454565] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:28.462 [2024-04-23 04:53:07.454577] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:28.462 [2024-04-23 04:53:07.454664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:28.462 [2024-04-23 04:53:07.454733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:28.462 [2024-04-23 04:53:07.454833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:28.462 [2024-04-23 04:53:07.454836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:28.462 04:53:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:28.462 04:53:07 -- common/autotest_common.sh@850 -- # return 0 00:08:28.462 04:53:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:28.462 04:53:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:28.462 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.462 04:53:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:28.462 04:53:07 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:28.462 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.462 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.462 [2024-04-23 04:53:07.604158] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:28.462 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.462 04:53:07 -- target/discovery.sh@26 -- # seq 1 4 00:08:28.462 04:53:07 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.462 04:53:07 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:28.462 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.462 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.462 Null1 00:08:28.462 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.462 04:53:07 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:28.462 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.462 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.720 04:53:07 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:28.720 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.720 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.720 04:53:07 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:28.720 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.720 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 [2024-04-23 04:53:07.644522] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.720 04:53:07 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.720 04:53:07 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:28.720 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.720 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 Null2 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.720 04:53:07 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:28.720 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.720 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.720 04:53:07 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:28.720 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.720 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.720 04:53:07 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:28.720 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.720 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.720 04:53:07 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.720 04:53:07 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:28.720 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.720 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.720 Null3 00:08:28.720 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.721 04:53:07 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 Null4 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.721 04:53:07 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:28.721 00:08:28.721 Discovery Log Number of Records 6, Generation counter 6 00:08:28.721 =====Discovery Log Entry 0====== 00:08:28.721 trtype: tcp 00:08:28.721 adrfam: ipv4 00:08:28.721 subtype: current discovery subsystem 00:08:28.721 treq: not required 00:08:28.721 portid: 0 00:08:28.721 trsvcid: 4420 00:08:28.721 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:28.721 traddr: 10.0.0.2 00:08:28.721 eflags: explicit discovery connections, duplicate discovery information 00:08:28.721 sectype: none 00:08:28.721 =====Discovery Log Entry 1====== 00:08:28.721 trtype: tcp 00:08:28.721 adrfam: ipv4 00:08:28.721 subtype: nvme subsystem 00:08:28.721 treq: not required 00:08:28.721 portid: 0 00:08:28.721 trsvcid: 4420 00:08:28.721 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:28.721 traddr: 10.0.0.2 00:08:28.721 eflags: none 00:08:28.721 sectype: none 00:08:28.721 =====Discovery Log Entry 2====== 00:08:28.721 trtype: tcp 00:08:28.721 adrfam: ipv4 00:08:28.721 subtype: nvme subsystem 00:08:28.721 treq: not required 00:08:28.721 portid: 0 00:08:28.721 trsvcid: 4420 00:08:28.721 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:28.721 traddr: 10.0.0.2 00:08:28.721 eflags: none 00:08:28.721 sectype: none 00:08:28.721 =====Discovery Log Entry 3====== 00:08:28.721 trtype: tcp 00:08:28.721 adrfam: ipv4 00:08:28.721 subtype: nvme subsystem 00:08:28.721 treq: not required 00:08:28.721 portid: 0 00:08:28.721 trsvcid: 4420 00:08:28.721 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:28.721 traddr: 10.0.0.2 00:08:28.721 eflags: none 00:08:28.721 sectype: none 00:08:28.721 =====Discovery Log Entry 4====== 00:08:28.721 trtype: tcp 00:08:28.721 adrfam: ipv4 00:08:28.721 subtype: nvme subsystem 00:08:28.721 treq: not required 00:08:28.721 portid: 0 00:08:28.721 trsvcid: 4420 00:08:28.721 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:28.721 traddr: 10.0.0.2 00:08:28.721 eflags: none 00:08:28.721 sectype: none 00:08:28.721 =====Discovery Log Entry 5====== 00:08:28.721 trtype: tcp 00:08:28.721 adrfam: ipv4 00:08:28.721 subtype: discovery subsystem referral 00:08:28.721 treq: not required 00:08:28.721 portid: 0 00:08:28.721 trsvcid: 4430 00:08:28.721 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:28.721 traddr: 10.0.0.2 00:08:28.721 eflags: none 00:08:28.721 sectype: none 00:08:28.721 04:53:07 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:28.721 Perform nvmf subsystem discovery via RPC 00:08:28.721 04:53:07 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:28.721 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.721 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.721 [2024-04-23 04:53:07.868974] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:28.721 [ 00:08:28.721 { 00:08:28.721 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:28.721 "subtype": "Discovery", 00:08:28.721 "listen_addresses": [ 00:08:28.721 { 00:08:28.721 "transport": "TCP", 00:08:28.721 "trtype": "TCP", 00:08:28.721 "adrfam": "IPv4", 00:08:28.721 "traddr": "10.0.0.2", 00:08:28.721 "trsvcid": "4420" 00:08:28.721 } 00:08:28.721 ], 00:08:28.721 "allow_any_host": true, 00:08:28.721 "hosts": [] 00:08:28.721 }, 00:08:28.721 { 00:08:28.721 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:28.721 "subtype": "NVMe", 00:08:28.721 "listen_addresses": [ 00:08:28.721 { 00:08:28.721 "transport": "TCP", 00:08:28.721 "trtype": "TCP", 00:08:28.721 "adrfam": "IPv4", 00:08:28.721 "traddr": "10.0.0.2", 00:08:28.721 "trsvcid": "4420" 00:08:28.721 } 00:08:28.721 ], 00:08:28.721 "allow_any_host": true, 00:08:28.721 "hosts": [], 00:08:28.721 "serial_number": "SPDK00000000000001", 00:08:28.721 "model_number": "SPDK bdev Controller", 00:08:28.721 "max_namespaces": 32, 00:08:28.721 "min_cntlid": 1, 00:08:28.721 "max_cntlid": 65519, 00:08:28.721 "namespaces": [ 00:08:28.721 { 00:08:28.721 "nsid": 1, 00:08:28.721 "bdev_name": "Null1", 00:08:28.721 "name": "Null1", 00:08:28.721 "nguid": "F22E4D90C6DD4454A51D563ED1774662", 00:08:28.721 "uuid": "f22e4d90-c6dd-4454-a51d-563ed1774662" 00:08:28.721 } 00:08:28.721 ] 00:08:28.721 }, 00:08:28.721 { 00:08:28.721 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:28.721 "subtype": "NVMe", 00:08:28.721 "listen_addresses": [ 00:08:28.721 { 00:08:28.721 "transport": "TCP", 00:08:28.721 "trtype": "TCP", 00:08:28.721 "adrfam": "IPv4", 00:08:28.721 "traddr": "10.0.0.2", 00:08:28.721 "trsvcid": "4420" 00:08:28.721 } 00:08:28.721 ], 00:08:28.721 "allow_any_host": true, 00:08:28.721 "hosts": [], 00:08:28.721 "serial_number": "SPDK00000000000002", 00:08:28.721 "model_number": "SPDK bdev Controller", 00:08:28.721 "max_namespaces": 32, 00:08:28.721 "min_cntlid": 1, 00:08:28.721 "max_cntlid": 65519, 00:08:28.721 "namespaces": [ 00:08:28.721 { 00:08:28.721 "nsid": 1, 00:08:28.721 "bdev_name": "Null2", 00:08:28.721 "name": "Null2", 00:08:28.721 "nguid": "91212D3AC7254132BCABB0288FFFE575", 00:08:28.721 "uuid": "91212d3a-c725-4132-bcab-b0288fffe575" 00:08:28.721 } 00:08:28.721 ] 00:08:28.721 }, 00:08:28.721 { 00:08:28.721 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:28.721 "subtype": "NVMe", 00:08:28.721 "listen_addresses": [ 00:08:28.721 { 00:08:28.721 "transport": "TCP", 00:08:28.721 "trtype": "TCP", 00:08:28.721 "adrfam": "IPv4", 00:08:28.721 "traddr": "10.0.0.2", 00:08:28.721 "trsvcid": "4420" 00:08:28.721 } 00:08:28.721 ], 00:08:28.721 "allow_any_host": true, 00:08:28.721 "hosts": [], 00:08:28.721 "serial_number": "SPDK00000000000003", 00:08:28.721 "model_number": "SPDK bdev Controller", 00:08:28.721 "max_namespaces": 32, 00:08:28.721 "min_cntlid": 1, 00:08:28.721 "max_cntlid": 65519, 00:08:28.721 "namespaces": [ 00:08:28.721 { 00:08:28.721 "nsid": 1, 00:08:28.721 "bdev_name": "Null3", 00:08:28.721 "name": "Null3", 00:08:28.721 "nguid": "A1DC007EE46E46609CE366D7F7F627A2", 00:08:28.721 "uuid": "a1dc007e-e46e-4660-9ce3-66d7f7f627a2" 00:08:28.721 } 00:08:28.721 ] 00:08:28.721 }, 00:08:28.721 { 00:08:28.721 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:28.721 "subtype": "NVMe", 00:08:28.721 "listen_addresses": [ 00:08:28.721 { 00:08:28.721 "transport": "TCP", 00:08:28.721 "trtype": "TCP", 00:08:28.721 "adrfam": "IPv4", 00:08:28.721 "traddr": "10.0.0.2", 00:08:28.721 "trsvcid": "4420" 00:08:28.721 } 00:08:28.721 ], 00:08:28.721 "allow_any_host": true, 00:08:28.721 "hosts": [], 00:08:28.721 "serial_number": "SPDK00000000000004", 00:08:28.721 "model_number": "SPDK bdev Controller", 00:08:28.721 "max_namespaces": 32, 00:08:28.721 "min_cntlid": 1, 00:08:28.721 "max_cntlid": 65519, 00:08:28.721 "namespaces": [ 00:08:28.721 { 00:08:28.721 "nsid": 1, 00:08:28.721 "bdev_name": "Null4", 00:08:28.722 "name": "Null4", 00:08:28.722 "nguid": "31EEA5B3DFAE434887CA9FED7817C341", 00:08:28.722 "uuid": "31eea5b3-dfae-4348-87ca-9fed7817c341" 00:08:28.722 } 00:08:28.722 ] 00:08:28.722 } 00:08:28.722 ] 00:08:28.722 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.722 04:53:07 -- target/discovery.sh@42 -- # seq 1 4 00:08:28.980 04:53:07 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.980 04:53:07 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.980 04:53:07 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.980 04:53:07 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.980 04:53:07 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:28.980 04:53:07 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:28.980 04:53:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.980 04:53:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.980 04:53:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.980 04:53:07 -- target/discovery.sh@49 -- # check_bdevs= 00:08:28.980 04:53:07 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:28.980 04:53:07 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:28.980 04:53:07 -- target/discovery.sh@57 -- # nvmftestfini 00:08:28.980 04:53:07 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:28.980 04:53:07 -- nvmf/common.sh@117 -- # sync 00:08:28.980 04:53:08 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:08:28.980 04:53:08 -- nvmf/common.sh@120 -- # set +e 00:08:28.980 04:53:08 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:28.980 04:53:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:08:28.980 rmmod nvme_tcp 00:08:28.980 rmmod nvme_fabrics 00:08:28.980 rmmod nvme_keyring 00:08:28.980 04:53:08 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:28.980 04:53:08 -- nvmf/common.sh@124 -- # set -e 00:08:28.980 04:53:08 -- nvmf/common.sh@125 -- # return 0 00:08:28.980 04:53:08 -- nvmf/common.sh@478 -- # '[' -n 2296537 ']' 00:08:28.980 04:53:08 -- nvmf/common.sh@479 -- # killprocess 2296537 00:08:28.980 04:53:08 -- common/autotest_common.sh@936 -- # '[' -z 2296537 ']' 00:08:28.980 04:53:08 -- common/autotest_common.sh@940 -- # kill -0 2296537 00:08:28.980 04:53:08 -- common/autotest_common.sh@941 -- # uname 00:08:28.980 04:53:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:28.980 04:53:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2296537 00:08:28.980 04:53:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:28.980 04:53:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:28.980 04:53:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2296537' 00:08:28.980 killing process with pid 2296537 00:08:28.980 04:53:08 -- common/autotest_common.sh@955 -- # kill 2296537 00:08:28.980 [2024-04-23 04:53:08.073646] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:28.980 04:53:08 -- common/autotest_common.sh@960 -- # wait 2296537 00:08:29.239 04:53:08 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:29.239 04:53:08 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:08:29.239 04:53:08 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:08:29.239 04:53:08 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:29.239 04:53:08 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:08:29.239 04:53:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:29.239 04:53:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:29.239 04:53:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:31.772 04:53:10 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:08:31.772 00:08:31.772 real 0m5.395s 00:08:31.772 user 0m4.172s 00:08:31.772 sys 0m1.830s 00:08:31.772 04:53:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:31.772 04:53:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.772 ************************************ 00:08:31.772 END TEST nvmf_discovery 00:08:31.772 ************************************ 00:08:31.772 04:53:10 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:31.772 04:53:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:31.772 04:53:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:31.772 04:53:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.772 ************************************ 00:08:31.772 START TEST nvmf_referrals 00:08:31.772 ************************************ 00:08:31.772 04:53:10 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:31.772 * Looking for test storage... 00:08:31.772 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.772 04:53:10 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:31.772 04:53:10 -- nvmf/common.sh@7 -- # uname -s 00:08:31.772 04:53:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:31.772 04:53:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:31.772 04:53:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:31.772 04:53:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:31.772 04:53:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:31.772 04:53:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:31.772 04:53:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:31.772 04:53:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:31.772 04:53:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:31.772 04:53:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:31.772 04:53:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:31.772 04:53:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:31.772 04:53:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:31.772 04:53:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:31.772 04:53:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:31.772 04:53:10 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:31.772 04:53:10 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:31.772 04:53:10 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:31.772 04:53:10 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:31.772 04:53:10 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:31.772 04:53:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.772 04:53:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.772 04:53:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.772 04:53:10 -- paths/export.sh@5 -- # export PATH 00:08:31.772 04:53:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.772 04:53:10 -- nvmf/common.sh@47 -- # : 0 00:08:31.772 04:53:10 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:31.772 04:53:10 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:31.772 04:53:10 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:31.772 04:53:10 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:31.772 04:53:10 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:31.772 04:53:10 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:31.772 04:53:10 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:31.772 04:53:10 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:31.772 04:53:10 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:31.772 04:53:10 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:31.772 04:53:10 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:31.772 04:53:10 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:31.772 04:53:10 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:31.772 04:53:10 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:31.772 04:53:10 -- target/referrals.sh@37 -- # nvmftestinit 00:08:31.772 04:53:10 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:08:31.772 04:53:10 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:31.772 04:53:10 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:31.772 04:53:10 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:31.772 04:53:10 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:31.772 04:53:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:31.772 04:53:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:31.772 04:53:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:31.772 04:53:10 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:31.772 04:53:10 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:31.772 04:53:10 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:31.772 04:53:10 -- common/autotest_common.sh@10 -- # set +x 00:08:33.684 04:53:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:33.684 04:53:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:33.684 04:53:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:33.684 04:53:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:33.684 04:53:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:33.684 04:53:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:33.684 04:53:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:33.684 04:53:12 -- nvmf/common.sh@295 -- # net_devs=() 00:08:33.684 04:53:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:33.684 04:53:12 -- nvmf/common.sh@296 -- # e810=() 00:08:33.684 04:53:12 -- nvmf/common.sh@296 -- # local -ga e810 00:08:33.684 04:53:12 -- nvmf/common.sh@297 -- # x722=() 00:08:33.684 04:53:12 -- nvmf/common.sh@297 -- # local -ga x722 00:08:33.684 04:53:12 -- nvmf/common.sh@298 -- # mlx=() 00:08:33.684 04:53:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:33.684 04:53:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:33.684 04:53:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:33.684 04:53:12 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:33.684 04:53:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:33.684 04:53:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:33.684 04:53:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:33.684 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:33.684 04:53:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:33.684 04:53:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:33.684 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:33.684 04:53:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:33.684 04:53:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:33.684 04:53:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:33.684 04:53:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:33.684 04:53:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:33.684 04:53:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:33.684 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:33.684 04:53:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:33.684 04:53:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:33.684 04:53:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:33.684 04:53:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:33.684 04:53:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:33.684 04:53:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:33.684 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:33.684 04:53:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:33.684 04:53:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:33.684 04:53:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:33.684 04:53:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:08:33.684 04:53:12 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:33.684 04:53:12 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:33.684 04:53:12 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:33.684 04:53:12 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:08:33.684 04:53:12 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:33.684 04:53:12 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:33.684 04:53:12 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:08:33.684 04:53:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:33.684 04:53:12 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:33.684 04:53:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:08:33.684 04:53:12 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:08:33.684 04:53:12 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:08:33.684 04:53:12 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:33.684 04:53:12 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:33.684 04:53:12 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:33.684 04:53:12 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:08:33.684 04:53:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:33.684 04:53:12 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:33.684 04:53:12 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:33.684 04:53:12 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:08:33.684 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:33.684 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:08:33.684 00:08:33.684 --- 10.0.0.2 ping statistics --- 00:08:33.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:33.684 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:08:33.684 04:53:12 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:33.684 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:33.684 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:08:33.684 00:08:33.684 --- 10.0.0.1 ping statistics --- 00:08:33.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:33.684 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:08:33.684 04:53:12 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:33.684 04:53:12 -- nvmf/common.sh@411 -- # return 0 00:08:33.684 04:53:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:33.684 04:53:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:33.684 04:53:12 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:08:33.684 04:53:12 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:33.684 04:53:12 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:08:33.684 04:53:12 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:08:33.684 04:53:12 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:33.684 04:53:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:33.684 04:53:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:33.684 04:53:12 -- common/autotest_common.sh@10 -- # set +x 00:08:33.684 04:53:12 -- nvmf/common.sh@470 -- # nvmfpid=2298638 00:08:33.684 04:53:12 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:33.684 04:53:12 -- nvmf/common.sh@471 -- # waitforlisten 2298638 00:08:33.684 04:53:12 -- common/autotest_common.sh@817 -- # '[' -z 2298638 ']' 00:08:33.684 04:53:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:33.684 04:53:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:33.685 04:53:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:33.685 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:33.685 04:53:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:33.685 04:53:12 -- common/autotest_common.sh@10 -- # set +x 00:08:33.685 [2024-04-23 04:53:12.717351] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:08:33.685 [2024-04-23 04:53:12.717439] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:33.685 EAL: No free 2048 kB hugepages reported on node 1 00:08:33.685 [2024-04-23 04:53:12.757461] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:08:33.685 [2024-04-23 04:53:12.787943] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:33.943 [2024-04-23 04:53:12.881360] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:33.943 [2024-04-23 04:53:12.881425] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:33.943 [2024-04-23 04:53:12.881453] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:33.943 [2024-04-23 04:53:12.881464] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:33.943 [2024-04-23 04:53:12.881474] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:33.943 [2024-04-23 04:53:12.881560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:33.943 [2024-04-23 04:53:12.881593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:33.943 [2024-04-23 04:53:12.881719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:33.943 [2024-04-23 04:53:12.881724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:33.943 04:53:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:33.943 04:53:13 -- common/autotest_common.sh@850 -- # return 0 00:08:33.943 04:53:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:33.943 04:53:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:33.943 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:33.943 04:53:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:33.943 04:53:13 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:33.943 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:33.943 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:33.943 [2024-04-23 04:53:13.035306] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:33.943 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:33.943 04:53:13 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:33.943 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:33.943 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:33.943 [2024-04-23 04:53:13.047594] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:33.943 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:33.943 04:53:13 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:33.943 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:33.943 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:33.943 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:33.943 04:53:13 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:33.943 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:33.943 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:33.943 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:33.943 04:53:13 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:33.943 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:33.943 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:33.943 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:33.943 04:53:13 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:33.943 04:53:13 -- target/referrals.sh@48 -- # jq length 00:08:33.943 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:33.943 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:33.943 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.201 04:53:13 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:34.201 04:53:13 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:34.201 04:53:13 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:34.201 04:53:13 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:34.201 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.201 04:53:13 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:34.201 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.201 04:53:13 -- target/referrals.sh@21 -- # sort 00:08:34.201 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.201 04:53:13 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:34.201 04:53:13 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:34.201 04:53:13 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:34.201 04:53:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:34.201 04:53:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:34.201 04:53:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.201 04:53:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:34.201 04:53:13 -- target/referrals.sh@26 -- # sort 00:08:34.201 04:53:13 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:34.201 04:53:13 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:34.201 04:53:13 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:34.201 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.201 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.201 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.201 04:53:13 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:34.201 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.201 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.482 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.482 04:53:13 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:34.482 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.482 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.482 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.482 04:53:13 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:34.482 04:53:13 -- target/referrals.sh@56 -- # jq length 00:08:34.482 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.482 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.482 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.482 04:53:13 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:34.482 04:53:13 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:34.482 04:53:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:34.482 04:53:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:34.482 04:53:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.482 04:53:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:34.482 04:53:13 -- target/referrals.sh@26 -- # sort 00:08:34.482 04:53:13 -- target/referrals.sh@26 -- # echo 00:08:34.482 04:53:13 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:34.482 04:53:13 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:34.482 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.482 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.482 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.482 04:53:13 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:34.482 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.482 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.482 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.482 04:53:13 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:34.482 04:53:13 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:34.482 04:53:13 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:34.482 04:53:13 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:34.482 04:53:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.482 04:53:13 -- common/autotest_common.sh@10 -- # set +x 00:08:34.482 04:53:13 -- target/referrals.sh@21 -- # sort 00:08:34.482 04:53:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.482 04:53:13 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:34.482 04:53:13 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:34.482 04:53:13 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:34.482 04:53:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:34.482 04:53:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:34.482 04:53:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.482 04:53:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:34.482 04:53:13 -- target/referrals.sh@26 -- # sort 00:08:34.740 04:53:13 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:34.740 04:53:13 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:34.740 04:53:13 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:34.740 04:53:13 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:34.740 04:53:13 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:34.740 04:53:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.740 04:53:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:34.740 04:53:13 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:34.740 04:53:13 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:34.740 04:53:13 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:34.740 04:53:13 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:34.740 04:53:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.740 04:53:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:34.998 04:53:14 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:34.998 04:53:14 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:34.998 04:53:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.998 04:53:14 -- common/autotest_common.sh@10 -- # set +x 00:08:34.998 04:53:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.998 04:53:14 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:34.998 04:53:14 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:34.998 04:53:14 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:34.998 04:53:14 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:34.998 04:53:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:34.998 04:53:14 -- common/autotest_common.sh@10 -- # set +x 00:08:34.998 04:53:14 -- target/referrals.sh@21 -- # sort 00:08:34.998 04:53:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:34.998 04:53:14 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:34.998 04:53:14 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:34.998 04:53:14 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:34.998 04:53:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:34.998 04:53:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:34.998 04:53:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:34.998 04:53:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:34.998 04:53:14 -- target/referrals.sh@26 -- # sort 00:08:35.255 04:53:14 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:35.255 04:53:14 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:35.255 04:53:14 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:35.255 04:53:14 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:35.255 04:53:14 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:35.255 04:53:14 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.255 04:53:14 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:35.255 04:53:14 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:35.255 04:53:14 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:35.255 04:53:14 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:35.255 04:53:14 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:35.255 04:53:14 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.255 04:53:14 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:35.255 04:53:14 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:35.255 04:53:14 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:35.255 04:53:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:35.255 04:53:14 -- common/autotest_common.sh@10 -- # set +x 00:08:35.255 04:53:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:35.255 04:53:14 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:35.255 04:53:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:35.255 04:53:14 -- target/referrals.sh@82 -- # jq length 00:08:35.255 04:53:14 -- common/autotest_common.sh@10 -- # set +x 00:08:35.255 04:53:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:35.255 04:53:14 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:35.255 04:53:14 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:35.255 04:53:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:35.255 04:53:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:35.255 04:53:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:35.255 04:53:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:35.255 04:53:14 -- target/referrals.sh@26 -- # sort 00:08:35.513 04:53:14 -- target/referrals.sh@26 -- # echo 00:08:35.513 04:53:14 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:35.513 04:53:14 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:35.513 04:53:14 -- target/referrals.sh@86 -- # nvmftestfini 00:08:35.513 04:53:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:35.513 04:53:14 -- nvmf/common.sh@117 -- # sync 00:08:35.513 04:53:14 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:08:35.513 04:53:14 -- nvmf/common.sh@120 -- # set +e 00:08:35.513 04:53:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:35.513 04:53:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:08:35.513 rmmod nvme_tcp 00:08:35.513 rmmod nvme_fabrics 00:08:35.513 rmmod nvme_keyring 00:08:35.513 04:53:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:35.513 04:53:14 -- nvmf/common.sh@124 -- # set -e 00:08:35.513 04:53:14 -- nvmf/common.sh@125 -- # return 0 00:08:35.513 04:53:14 -- nvmf/common.sh@478 -- # '[' -n 2298638 ']' 00:08:35.513 04:53:14 -- nvmf/common.sh@479 -- # killprocess 2298638 00:08:35.513 04:53:14 -- common/autotest_common.sh@936 -- # '[' -z 2298638 ']' 00:08:35.513 04:53:14 -- common/autotest_common.sh@940 -- # kill -0 2298638 00:08:35.513 04:53:14 -- common/autotest_common.sh@941 -- # uname 00:08:35.513 04:53:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:35.513 04:53:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2298638 00:08:35.513 04:53:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:35.513 04:53:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:35.513 04:53:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2298638' 00:08:35.513 killing process with pid 2298638 00:08:35.513 04:53:14 -- common/autotest_common.sh@955 -- # kill 2298638 00:08:35.513 04:53:14 -- common/autotest_common.sh@960 -- # wait 2298638 00:08:35.772 04:53:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:35.772 04:53:14 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:08:35.772 04:53:14 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:08:35.772 04:53:14 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:35.772 04:53:14 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:08:35.772 04:53:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:35.772 04:53:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:35.772 04:53:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:37.674 04:53:16 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:08:37.674 00:08:37.674 real 0m6.327s 00:08:37.674 user 0m8.847s 00:08:37.674 sys 0m1.892s 00:08:37.674 04:53:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:37.674 04:53:16 -- common/autotest_common.sh@10 -- # set +x 00:08:37.674 ************************************ 00:08:37.674 END TEST nvmf_referrals 00:08:37.674 ************************************ 00:08:37.674 04:53:16 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:37.674 04:53:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:37.674 04:53:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:37.674 04:53:16 -- common/autotest_common.sh@10 -- # set +x 00:08:37.932 ************************************ 00:08:37.932 START TEST nvmf_connect_disconnect 00:08:37.932 ************************************ 00:08:37.932 04:53:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:37.932 * Looking for test storage... 00:08:37.932 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:37.932 04:53:16 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:37.932 04:53:16 -- nvmf/common.sh@7 -- # uname -s 00:08:37.932 04:53:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:37.932 04:53:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:37.932 04:53:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:37.932 04:53:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:37.932 04:53:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:37.932 04:53:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:37.932 04:53:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:37.932 04:53:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:37.932 04:53:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:37.932 04:53:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:37.932 04:53:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:37.932 04:53:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:37.932 04:53:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:37.932 04:53:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:37.932 04:53:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:37.932 04:53:17 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:37.932 04:53:17 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:37.932 04:53:17 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:37.932 04:53:17 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:37.932 04:53:17 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:37.933 04:53:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.933 04:53:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.933 04:53:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.933 04:53:17 -- paths/export.sh@5 -- # export PATH 00:08:37.933 04:53:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.933 04:53:17 -- nvmf/common.sh@47 -- # : 0 00:08:37.933 04:53:17 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:37.933 04:53:17 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:37.933 04:53:17 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:37.933 04:53:17 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:37.933 04:53:17 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:37.933 04:53:17 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:37.933 04:53:17 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:37.933 04:53:17 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:37.933 04:53:17 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:37.933 04:53:17 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:37.933 04:53:17 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:37.933 04:53:17 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:08:37.933 04:53:17 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:37.933 04:53:17 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:37.933 04:53:17 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:37.933 04:53:17 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:37.933 04:53:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:37.933 04:53:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:37.933 04:53:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:37.933 04:53:17 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:37.933 04:53:17 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:37.933 04:53:17 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:37.933 04:53:17 -- common/autotest_common.sh@10 -- # set +x 00:08:39.870 04:53:18 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:39.870 04:53:18 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:39.870 04:53:18 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:39.870 04:53:18 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:39.870 04:53:18 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:39.870 04:53:18 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:39.870 04:53:18 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:39.870 04:53:18 -- nvmf/common.sh@295 -- # net_devs=() 00:08:39.870 04:53:18 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:39.870 04:53:18 -- nvmf/common.sh@296 -- # e810=() 00:08:39.870 04:53:18 -- nvmf/common.sh@296 -- # local -ga e810 00:08:39.870 04:53:18 -- nvmf/common.sh@297 -- # x722=() 00:08:39.870 04:53:18 -- nvmf/common.sh@297 -- # local -ga x722 00:08:39.870 04:53:18 -- nvmf/common.sh@298 -- # mlx=() 00:08:39.870 04:53:18 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:39.870 04:53:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:39.870 04:53:18 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:39.870 04:53:18 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:39.870 04:53:18 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:39.870 04:53:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:39.870 04:53:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:39.870 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:39.870 04:53:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:39.870 04:53:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:39.870 04:53:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:39.870 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:39.871 04:53:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:39.871 04:53:18 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:39.871 04:53:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:39.871 04:53:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:39.871 04:53:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:39.871 04:53:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:39.871 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:39.871 04:53:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:39.871 04:53:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:39.871 04:53:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:39.871 04:53:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:39.871 04:53:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:39.871 04:53:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:39.871 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:39.871 04:53:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:39.871 04:53:18 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:39.871 04:53:18 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:39.871 04:53:18 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:08:39.871 04:53:18 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:08:39.871 04:53:18 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:39.871 04:53:18 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:39.871 04:53:18 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:39.871 04:53:18 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:08:39.871 04:53:18 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:39.871 04:53:18 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:39.871 04:53:18 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:08:39.871 04:53:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:39.871 04:53:18 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:39.871 04:53:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:08:39.871 04:53:18 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:08:39.871 04:53:18 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:08:39.871 04:53:18 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:39.871 04:53:19 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:39.871 04:53:19 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:39.871 04:53:19 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:08:39.871 04:53:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:40.130 04:53:19 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:40.130 04:53:19 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:40.130 04:53:19 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:08:40.130 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:40.130 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:08:40.130 00:08:40.130 --- 10.0.0.2 ping statistics --- 00:08:40.130 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:40.130 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:08:40.130 04:53:19 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:40.130 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:40.130 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:08:40.130 00:08:40.130 --- 10.0.0.1 ping statistics --- 00:08:40.130 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:40.130 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:08:40.130 04:53:19 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:40.131 04:53:19 -- nvmf/common.sh@411 -- # return 0 00:08:40.131 04:53:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:40.131 04:53:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:40.131 04:53:19 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:08:40.131 04:53:19 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:08:40.131 04:53:19 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:40.131 04:53:19 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:08:40.131 04:53:19 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:08:40.131 04:53:19 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:40.131 04:53:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:40.131 04:53:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:40.131 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.131 04:53:19 -- nvmf/common.sh@470 -- # nvmfpid=2300938 00:08:40.131 04:53:19 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:40.131 04:53:19 -- nvmf/common.sh@471 -- # waitforlisten 2300938 00:08:40.131 04:53:19 -- common/autotest_common.sh@817 -- # '[' -z 2300938 ']' 00:08:40.131 04:53:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:40.131 04:53:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:40.131 04:53:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:40.131 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:40.131 04:53:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:40.131 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.131 [2024-04-23 04:53:19.138736] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:08:40.131 [2024-04-23 04:53:19.138836] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:40.131 EAL: No free 2048 kB hugepages reported on node 1 00:08:40.131 [2024-04-23 04:53:19.176896] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:08:40.131 [2024-04-23 04:53:19.203310] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:40.131 [2024-04-23 04:53:19.287840] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:40.131 [2024-04-23 04:53:19.287906] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:40.131 [2024-04-23 04:53:19.287936] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:40.131 [2024-04-23 04:53:19.287947] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:40.131 [2024-04-23 04:53:19.287957] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:40.131 [2024-04-23 04:53:19.288015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:40.131 [2024-04-23 04:53:19.288078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:40.131 [2024-04-23 04:53:19.288144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:40.131 [2024-04-23 04:53:19.288149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:40.391 04:53:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:40.391 04:53:19 -- common/autotest_common.sh@850 -- # return 0 00:08:40.391 04:53:19 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:40.391 04:53:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:40.391 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.391 04:53:19 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:40.391 04:53:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:40.391 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.391 [2024-04-23 04:53:19.443232] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:40.391 04:53:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:40.391 04:53:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:40.391 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.391 04:53:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:40.391 04:53:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:40.391 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.391 04:53:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:40.391 04:53:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:40.391 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.391 04:53:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:40.391 04:53:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:40.391 04:53:19 -- common/autotest_common.sh@10 -- # set +x 00:08:40.391 [2024-04-23 04:53:19.496447] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:40.391 04:53:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:40.391 04:53:19 -- target/connect_disconnect.sh@34 -- # set +x 00:08:42.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.279 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.817 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.353 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.792 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.709 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.301 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.839 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.708 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.233 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.677 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.616 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.151 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.585 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.119 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.026 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.560 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.185 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.688 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.223 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.114 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.650 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.484 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.025 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.930 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.991 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.309 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.865 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.290 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.186 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.711 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.232 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.128 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.077 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.531 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.846 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.896 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.229 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.691 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.216 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.741 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.635 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.162 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.117 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.044 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.576 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.000 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.907 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.348 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.789 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.797 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.335 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.690 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.229 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.763 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.669 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:24.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.103 [2024-04-23 04:57:05.967290] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x866200 is same with the state(5) to be set 00:12:27.103 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.103 04:57:05 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:27.103 04:57:05 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:27.103 04:57:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:27.103 04:57:05 -- nvmf/common.sh@117 -- # sync 00:12:27.103 04:57:05 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:12:27.103 04:57:05 -- nvmf/common.sh@120 -- # set +e 00:12:27.103 04:57:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:27.103 04:57:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:12:27.103 rmmod nvme_tcp 00:12:27.103 rmmod nvme_fabrics 00:12:27.103 rmmod nvme_keyring 00:12:27.103 04:57:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:27.103 04:57:06 -- nvmf/common.sh@124 -- # set -e 00:12:27.103 04:57:06 -- nvmf/common.sh@125 -- # return 0 00:12:27.103 04:57:06 -- nvmf/common.sh@478 -- # '[' -n 2300938 ']' 00:12:27.103 04:57:06 -- nvmf/common.sh@479 -- # killprocess 2300938 00:12:27.104 04:57:06 -- common/autotest_common.sh@936 -- # '[' -z 2300938 ']' 00:12:27.104 04:57:06 -- common/autotest_common.sh@940 -- # kill -0 2300938 00:12:27.104 04:57:06 -- common/autotest_common.sh@941 -- # uname 00:12:27.104 04:57:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:27.104 04:57:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2300938 00:12:27.104 04:57:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:27.104 04:57:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:27.104 04:57:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2300938' 00:12:27.104 killing process with pid 2300938 00:12:27.104 04:57:06 -- common/autotest_common.sh@955 -- # kill 2300938 00:12:27.104 04:57:06 -- common/autotest_common.sh@960 -- # wait 2300938 00:12:27.364 04:57:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:27.364 04:57:06 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:12:27.364 04:57:06 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:12:27.364 04:57:06 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:27.365 04:57:06 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:12:27.365 04:57:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:27.365 04:57:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:27.365 04:57:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:29.271 04:57:08 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:12:29.271 00:12:29.271 real 3m51.403s 00:12:29.271 user 14m41.256s 00:12:29.271 sys 0m30.920s 00:12:29.271 04:57:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:29.271 04:57:08 -- common/autotest_common.sh@10 -- # set +x 00:12:29.271 ************************************ 00:12:29.271 END TEST nvmf_connect_disconnect 00:12:29.271 ************************************ 00:12:29.271 04:57:08 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:29.271 04:57:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:29.271 04:57:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:29.271 04:57:08 -- common/autotest_common.sh@10 -- # set +x 00:12:29.529 ************************************ 00:12:29.529 START TEST nvmf_multitarget 00:12:29.529 ************************************ 00:12:29.529 04:57:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:29.529 * Looking for test storage... 00:12:29.529 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:29.529 04:57:08 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:29.529 04:57:08 -- nvmf/common.sh@7 -- # uname -s 00:12:29.529 04:57:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:29.529 04:57:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:29.529 04:57:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:29.529 04:57:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:29.529 04:57:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:29.529 04:57:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:29.529 04:57:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:29.529 04:57:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:29.530 04:57:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:29.530 04:57:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:29.530 04:57:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:29.530 04:57:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:29.530 04:57:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:29.530 04:57:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:29.530 04:57:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:29.530 04:57:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:29.530 04:57:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:29.530 04:57:08 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:29.530 04:57:08 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:29.530 04:57:08 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:29.530 04:57:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.530 04:57:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.530 04:57:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.530 04:57:08 -- paths/export.sh@5 -- # export PATH 00:12:29.530 04:57:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.530 04:57:08 -- nvmf/common.sh@47 -- # : 0 00:12:29.530 04:57:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:29.530 04:57:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:29.530 04:57:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:29.530 04:57:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:29.530 04:57:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:29.530 04:57:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:29.530 04:57:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:29.530 04:57:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:29.530 04:57:08 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:29.530 04:57:08 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:29.530 04:57:08 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:12:29.530 04:57:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:29.530 04:57:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:29.530 04:57:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:29.530 04:57:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:29.530 04:57:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:29.530 04:57:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:29.530 04:57:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:29.530 04:57:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:29.530 04:57:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:29.530 04:57:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:29.530 04:57:08 -- common/autotest_common.sh@10 -- # set +x 00:12:31.436 04:57:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:31.436 04:57:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:31.436 04:57:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:31.436 04:57:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:31.436 04:57:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:31.436 04:57:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:31.436 04:57:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:31.436 04:57:10 -- nvmf/common.sh@295 -- # net_devs=() 00:12:31.436 04:57:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:31.436 04:57:10 -- nvmf/common.sh@296 -- # e810=() 00:12:31.436 04:57:10 -- nvmf/common.sh@296 -- # local -ga e810 00:12:31.436 04:57:10 -- nvmf/common.sh@297 -- # x722=() 00:12:31.436 04:57:10 -- nvmf/common.sh@297 -- # local -ga x722 00:12:31.436 04:57:10 -- nvmf/common.sh@298 -- # mlx=() 00:12:31.436 04:57:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:31.436 04:57:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:31.436 04:57:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:31.436 04:57:10 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:31.436 04:57:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:31.436 04:57:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:31.436 04:57:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:31.436 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:31.436 04:57:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:31.436 04:57:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:31.436 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:31.436 04:57:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:31.436 04:57:10 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:31.436 04:57:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:31.436 04:57:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:31.436 04:57:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:31.436 04:57:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:31.436 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:31.436 04:57:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:31.436 04:57:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:31.436 04:57:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:31.436 04:57:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:31.436 04:57:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:31.436 04:57:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:31.436 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:31.436 04:57:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:31.436 04:57:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:31.436 04:57:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:31.436 04:57:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:12:31.436 04:57:10 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:12:31.436 04:57:10 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:31.436 04:57:10 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:31.436 04:57:10 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:31.436 04:57:10 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:12:31.436 04:57:10 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:31.436 04:57:10 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:31.436 04:57:10 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:12:31.436 04:57:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:31.436 04:57:10 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:31.436 04:57:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:12:31.436 04:57:10 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:12:31.436 04:57:10 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:12:31.436 04:57:10 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:31.436 04:57:10 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:31.436 04:57:10 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:31.436 04:57:10 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:12:31.436 04:57:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:31.436 04:57:10 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:31.436 04:57:10 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:31.436 04:57:10 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:12:31.436 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:31.436 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:12:31.436 00:12:31.436 --- 10.0.0.2 ping statistics --- 00:12:31.436 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:31.436 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:12:31.436 04:57:10 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:31.436 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:31.436 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:12:31.436 00:12:31.436 --- 10.0.0.1 ping statistics --- 00:12:31.436 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:31.437 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:12:31.437 04:57:10 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:31.437 04:57:10 -- nvmf/common.sh@411 -- # return 0 00:12:31.437 04:57:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:31.437 04:57:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:31.437 04:57:10 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:12:31.437 04:57:10 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:12:31.437 04:57:10 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:31.437 04:57:10 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:12:31.437 04:57:10 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:12:31.437 04:57:10 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:31.437 04:57:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:31.437 04:57:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:31.437 04:57:10 -- common/autotest_common.sh@10 -- # set +x 00:12:31.437 04:57:10 -- nvmf/common.sh@470 -- # nvmfpid=2332070 00:12:31.437 04:57:10 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:31.437 04:57:10 -- nvmf/common.sh@471 -- # waitforlisten 2332070 00:12:31.437 04:57:10 -- common/autotest_common.sh@817 -- # '[' -z 2332070 ']' 00:12:31.437 04:57:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:31.437 04:57:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:31.437 04:57:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:31.437 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:31.437 04:57:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:31.437 04:57:10 -- common/autotest_common.sh@10 -- # set +x 00:12:31.696 [2024-04-23 04:57:10.636272] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:12:31.696 [2024-04-23 04:57:10.636362] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:31.696 EAL: No free 2048 kB hugepages reported on node 1 00:12:31.696 [2024-04-23 04:57:10.676899] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:12:31.696 [2024-04-23 04:57:10.709707] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:31.696 [2024-04-23 04:57:10.800926] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:31.696 [2024-04-23 04:57:10.800991] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:31.696 [2024-04-23 04:57:10.801022] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:31.696 [2024-04-23 04:57:10.801034] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:31.697 [2024-04-23 04:57:10.801045] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:31.697 [2024-04-23 04:57:10.801180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:31.697 [2024-04-23 04:57:10.801205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:31.697 [2024-04-23 04:57:10.801328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:31.697 [2024-04-23 04:57:10.801325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:31.955 04:57:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:31.955 04:57:10 -- common/autotest_common.sh@850 -- # return 0 00:12:31.955 04:57:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:31.955 04:57:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:31.955 04:57:10 -- common/autotest_common.sh@10 -- # set +x 00:12:31.955 04:57:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:31.955 04:57:10 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:31.955 04:57:10 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:31.955 04:57:10 -- target/multitarget.sh@21 -- # jq length 00:12:31.955 04:57:11 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:31.955 04:57:11 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:32.213 "nvmf_tgt_1" 00:12:32.213 04:57:11 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:32.213 "nvmf_tgt_2" 00:12:32.213 04:57:11 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:32.213 04:57:11 -- target/multitarget.sh@28 -- # jq length 00:12:32.471 04:57:11 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:32.471 04:57:11 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:32.471 true 00:12:32.471 04:57:11 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:32.471 true 00:12:32.471 04:57:11 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:32.471 04:57:11 -- target/multitarget.sh@35 -- # jq length 00:12:32.731 04:57:11 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:32.731 04:57:11 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:32.731 04:57:11 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:32.731 04:57:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:32.731 04:57:11 -- nvmf/common.sh@117 -- # sync 00:12:32.731 04:57:11 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:12:32.731 04:57:11 -- nvmf/common.sh@120 -- # set +e 00:12:32.731 04:57:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:32.731 04:57:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:12:32.731 rmmod nvme_tcp 00:12:32.731 rmmod nvme_fabrics 00:12:32.731 rmmod nvme_keyring 00:12:32.731 04:57:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:32.731 04:57:11 -- nvmf/common.sh@124 -- # set -e 00:12:32.731 04:57:11 -- nvmf/common.sh@125 -- # return 0 00:12:32.731 04:57:11 -- nvmf/common.sh@478 -- # '[' -n 2332070 ']' 00:12:32.731 04:57:11 -- nvmf/common.sh@479 -- # killprocess 2332070 00:12:32.731 04:57:11 -- common/autotest_common.sh@936 -- # '[' -z 2332070 ']' 00:12:32.731 04:57:11 -- common/autotest_common.sh@940 -- # kill -0 2332070 00:12:32.731 04:57:11 -- common/autotest_common.sh@941 -- # uname 00:12:32.731 04:57:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:32.731 04:57:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332070 00:12:32.731 04:57:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:32.731 04:57:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:32.731 04:57:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332070' 00:12:32.731 killing process with pid 2332070 00:12:32.731 04:57:11 -- common/autotest_common.sh@955 -- # kill 2332070 00:12:32.731 04:57:11 -- common/autotest_common.sh@960 -- # wait 2332070 00:12:32.990 04:57:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:32.990 04:57:12 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:12:32.990 04:57:12 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:12:32.990 04:57:12 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:32.990 04:57:12 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:12:32.990 04:57:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:32.990 04:57:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:32.990 04:57:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:35.528 04:57:14 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:12:35.528 00:12:35.528 real 0m5.612s 00:12:35.528 user 0m6.163s 00:12:35.528 sys 0m1.894s 00:12:35.528 04:57:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:35.528 04:57:14 -- common/autotest_common.sh@10 -- # set +x 00:12:35.528 ************************************ 00:12:35.528 END TEST nvmf_multitarget 00:12:35.528 ************************************ 00:12:35.528 04:57:14 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:35.528 04:57:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:35.528 04:57:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:35.528 04:57:14 -- common/autotest_common.sh@10 -- # set +x 00:12:35.528 ************************************ 00:12:35.528 START TEST nvmf_rpc 00:12:35.528 ************************************ 00:12:35.528 04:57:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:35.528 * Looking for test storage... 00:12:35.528 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:35.528 04:57:14 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:35.528 04:57:14 -- nvmf/common.sh@7 -- # uname -s 00:12:35.528 04:57:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:35.528 04:57:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:35.528 04:57:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:35.528 04:57:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:35.528 04:57:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:35.528 04:57:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:35.528 04:57:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:35.528 04:57:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:35.528 04:57:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:35.528 04:57:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:35.528 04:57:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:35.528 04:57:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:35.528 04:57:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:35.528 04:57:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:35.528 04:57:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:35.528 04:57:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:35.528 04:57:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:35.528 04:57:14 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:35.528 04:57:14 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:35.528 04:57:14 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:35.528 04:57:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.528 04:57:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.528 04:57:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.528 04:57:14 -- paths/export.sh@5 -- # export PATH 00:12:35.528 04:57:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.528 04:57:14 -- nvmf/common.sh@47 -- # : 0 00:12:35.528 04:57:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:35.528 04:57:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:35.528 04:57:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:35.528 04:57:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:35.528 04:57:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:35.528 04:57:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:35.528 04:57:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:35.528 04:57:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:35.528 04:57:14 -- target/rpc.sh@11 -- # loops=5 00:12:35.528 04:57:14 -- target/rpc.sh@23 -- # nvmftestinit 00:12:35.528 04:57:14 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:12:35.528 04:57:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:35.528 04:57:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:35.528 04:57:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:35.528 04:57:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:35.528 04:57:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:35.528 04:57:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:35.528 04:57:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:35.528 04:57:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:35.528 04:57:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:35.528 04:57:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:35.528 04:57:14 -- common/autotest_common.sh@10 -- # set +x 00:12:37.435 04:57:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:37.435 04:57:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:37.435 04:57:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:37.435 04:57:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:37.435 04:57:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:37.435 04:57:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:37.435 04:57:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:37.435 04:57:16 -- nvmf/common.sh@295 -- # net_devs=() 00:12:37.435 04:57:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:37.435 04:57:16 -- nvmf/common.sh@296 -- # e810=() 00:12:37.435 04:57:16 -- nvmf/common.sh@296 -- # local -ga e810 00:12:37.435 04:57:16 -- nvmf/common.sh@297 -- # x722=() 00:12:37.435 04:57:16 -- nvmf/common.sh@297 -- # local -ga x722 00:12:37.435 04:57:16 -- nvmf/common.sh@298 -- # mlx=() 00:12:37.435 04:57:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:37.435 04:57:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:37.435 04:57:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:37.435 04:57:16 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:37.435 04:57:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:37.435 04:57:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:37.435 04:57:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:37.435 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:37.435 04:57:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:37.435 04:57:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:37.435 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:37.435 04:57:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:37.435 04:57:16 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:12:37.435 04:57:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:37.435 04:57:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.435 04:57:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:37.435 04:57:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.435 04:57:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:37.435 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:37.436 04:57:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.436 04:57:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:37.436 04:57:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.436 04:57:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:37.436 04:57:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.436 04:57:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:37.436 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:37.436 04:57:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.436 04:57:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:37.436 04:57:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:37.436 04:57:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:37.436 04:57:16 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:12:37.436 04:57:16 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:12:37.436 04:57:16 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:37.436 04:57:16 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:37.436 04:57:16 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:37.436 04:57:16 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:12:37.436 04:57:16 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:37.436 04:57:16 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:37.436 04:57:16 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:12:37.436 04:57:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:37.436 04:57:16 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:37.436 04:57:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:12:37.436 04:57:16 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:12:37.436 04:57:16 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:12:37.436 04:57:16 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:37.436 04:57:16 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:37.436 04:57:16 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:37.436 04:57:16 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:12:37.436 04:57:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:37.436 04:57:16 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:37.436 04:57:16 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:37.436 04:57:16 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:12:37.436 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:37.436 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.146 ms 00:12:37.436 00:12:37.436 --- 10.0.0.2 ping statistics --- 00:12:37.436 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.436 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:12:37.436 04:57:16 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:37.436 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:37.436 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:12:37.436 00:12:37.436 --- 10.0.0.1 ping statistics --- 00:12:37.436 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.436 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:12:37.436 04:57:16 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:37.436 04:57:16 -- nvmf/common.sh@411 -- # return 0 00:12:37.436 04:57:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:37.436 04:57:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:37.436 04:57:16 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:12:37.436 04:57:16 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:12:37.436 04:57:16 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:37.436 04:57:16 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:12:37.436 04:57:16 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:12:37.436 04:57:16 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:37.436 04:57:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:37.436 04:57:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:37.436 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.436 04:57:16 -- nvmf/common.sh@470 -- # nvmfpid=2334274 00:12:37.436 04:57:16 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:37.436 04:57:16 -- nvmf/common.sh@471 -- # waitforlisten 2334274 00:12:37.436 04:57:16 -- common/autotest_common.sh@817 -- # '[' -z 2334274 ']' 00:12:37.436 04:57:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:37.436 04:57:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:37.436 04:57:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:37.436 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:37.436 04:57:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:37.436 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.436 [2024-04-23 04:57:16.446342] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:12:37.436 [2024-04-23 04:57:16.446416] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:37.436 EAL: No free 2048 kB hugepages reported on node 1 00:12:37.436 [2024-04-23 04:57:16.484626] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:12:37.436 [2024-04-23 04:57:16.516750] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:37.694 [2024-04-23 04:57:16.611043] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:37.694 [2024-04-23 04:57:16.611100] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:37.694 [2024-04-23 04:57:16.611116] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:37.694 [2024-04-23 04:57:16.611130] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:37.694 [2024-04-23 04:57:16.611141] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:37.694 [2024-04-23 04:57:16.611223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:37.694 [2024-04-23 04:57:16.611277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:37.694 [2024-04-23 04:57:16.611338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:37.694 [2024-04-23 04:57:16.611340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:37.694 04:57:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:37.694 04:57:16 -- common/autotest_common.sh@850 -- # return 0 00:12:37.694 04:57:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:37.694 04:57:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:37.694 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.694 04:57:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:37.694 04:57:16 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:37.694 04:57:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.694 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.694 04:57:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.694 04:57:16 -- target/rpc.sh@26 -- # stats='{ 00:12:37.694 "tick_rate": 2700000000, 00:12:37.694 "poll_groups": [ 00:12:37.694 { 00:12:37.694 "name": "nvmf_tgt_poll_group_0", 00:12:37.694 "admin_qpairs": 0, 00:12:37.694 "io_qpairs": 0, 00:12:37.694 "current_admin_qpairs": 0, 00:12:37.694 "current_io_qpairs": 0, 00:12:37.694 "pending_bdev_io": 0, 00:12:37.694 "completed_nvme_io": 0, 00:12:37.694 "transports": [] 00:12:37.694 }, 00:12:37.694 { 00:12:37.694 "name": "nvmf_tgt_poll_group_1", 00:12:37.694 "admin_qpairs": 0, 00:12:37.694 "io_qpairs": 0, 00:12:37.694 "current_admin_qpairs": 0, 00:12:37.694 "current_io_qpairs": 0, 00:12:37.694 "pending_bdev_io": 0, 00:12:37.694 "completed_nvme_io": 0, 00:12:37.694 "transports": [] 00:12:37.694 }, 00:12:37.694 { 00:12:37.694 "name": "nvmf_tgt_poll_group_2", 00:12:37.694 "admin_qpairs": 0, 00:12:37.694 "io_qpairs": 0, 00:12:37.694 "current_admin_qpairs": 0, 00:12:37.694 "current_io_qpairs": 0, 00:12:37.694 "pending_bdev_io": 0, 00:12:37.694 "completed_nvme_io": 0, 00:12:37.694 "transports": [] 00:12:37.694 }, 00:12:37.694 { 00:12:37.694 "name": "nvmf_tgt_poll_group_3", 00:12:37.694 "admin_qpairs": 0, 00:12:37.694 "io_qpairs": 0, 00:12:37.694 "current_admin_qpairs": 0, 00:12:37.694 "current_io_qpairs": 0, 00:12:37.694 "pending_bdev_io": 0, 00:12:37.694 "completed_nvme_io": 0, 00:12:37.694 "transports": [] 00:12:37.694 } 00:12:37.694 ] 00:12:37.694 }' 00:12:37.694 04:57:16 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:37.694 04:57:16 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:37.694 04:57:16 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:37.694 04:57:16 -- target/rpc.sh@15 -- # wc -l 00:12:37.694 04:57:16 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:37.694 04:57:16 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:37.694 04:57:16 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:37.694 04:57:16 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:37.694 04:57:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 [2024-04-23 04:57:16.863737] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:37.972 04:57:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:16 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:37.972 04:57:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 04:57:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:16 -- target/rpc.sh@33 -- # stats='{ 00:12:37.972 "tick_rate": 2700000000, 00:12:37.972 "poll_groups": [ 00:12:37.972 { 00:12:37.972 "name": "nvmf_tgt_poll_group_0", 00:12:37.972 "admin_qpairs": 0, 00:12:37.972 "io_qpairs": 0, 00:12:37.972 "current_admin_qpairs": 0, 00:12:37.972 "current_io_qpairs": 0, 00:12:37.972 "pending_bdev_io": 0, 00:12:37.972 "completed_nvme_io": 0, 00:12:37.972 "transports": [ 00:12:37.972 { 00:12:37.972 "trtype": "TCP" 00:12:37.972 } 00:12:37.972 ] 00:12:37.972 }, 00:12:37.972 { 00:12:37.972 "name": "nvmf_tgt_poll_group_1", 00:12:37.972 "admin_qpairs": 0, 00:12:37.972 "io_qpairs": 0, 00:12:37.972 "current_admin_qpairs": 0, 00:12:37.972 "current_io_qpairs": 0, 00:12:37.972 "pending_bdev_io": 0, 00:12:37.972 "completed_nvme_io": 0, 00:12:37.972 "transports": [ 00:12:37.972 { 00:12:37.972 "trtype": "TCP" 00:12:37.972 } 00:12:37.972 ] 00:12:37.972 }, 00:12:37.972 { 00:12:37.972 "name": "nvmf_tgt_poll_group_2", 00:12:37.972 "admin_qpairs": 0, 00:12:37.972 "io_qpairs": 0, 00:12:37.972 "current_admin_qpairs": 0, 00:12:37.972 "current_io_qpairs": 0, 00:12:37.972 "pending_bdev_io": 0, 00:12:37.972 "completed_nvme_io": 0, 00:12:37.972 "transports": [ 00:12:37.972 { 00:12:37.972 "trtype": "TCP" 00:12:37.972 } 00:12:37.972 ] 00:12:37.972 }, 00:12:37.972 { 00:12:37.972 "name": "nvmf_tgt_poll_group_3", 00:12:37.972 "admin_qpairs": 0, 00:12:37.972 "io_qpairs": 0, 00:12:37.972 "current_admin_qpairs": 0, 00:12:37.972 "current_io_qpairs": 0, 00:12:37.972 "pending_bdev_io": 0, 00:12:37.972 "completed_nvme_io": 0, 00:12:37.972 "transports": [ 00:12:37.972 { 00:12:37.972 "trtype": "TCP" 00:12:37.972 } 00:12:37.972 ] 00:12:37.972 } 00:12:37.972 ] 00:12:37.972 }' 00:12:37.972 04:57:16 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:37.972 04:57:16 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:37.972 04:57:16 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:37.972 04:57:16 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.972 04:57:16 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:37.972 04:57:16 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:37.972 04:57:16 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:37.972 04:57:16 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:37.972 04:57:16 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.972 04:57:16 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:37.972 04:57:16 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:37.972 04:57:16 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:37.972 04:57:16 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:37.972 04:57:16 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:37.972 04:57:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 Malloc1 00:12:37.972 04:57:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:16 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:37.972 04:57:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 04:57:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:16 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:37.972 04:57:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:16 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 04:57:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:17 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:37.972 04:57:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:17 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 04:57:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:17 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:37.972 04:57:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:17 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 [2024-04-23 04:57:17.017072] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:37.972 04:57:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:17 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:37.972 04:57:17 -- common/autotest_common.sh@638 -- # local es=0 00:12:37.972 04:57:17 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:37.972 04:57:17 -- common/autotest_common.sh@626 -- # local arg=nvme 00:12:37.972 04:57:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:37.972 04:57:17 -- common/autotest_common.sh@630 -- # type -t nvme 00:12:37.972 04:57:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:37.972 04:57:17 -- common/autotest_common.sh@632 -- # type -P nvme 00:12:37.972 04:57:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:37.972 04:57:17 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:12:37.972 04:57:17 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:12:37.972 04:57:17 -- common/autotest_common.sh@641 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:37.972 [2024-04-23 04:57:17.039523] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:37.972 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:37.972 could not add new controller: failed to write to nvme-fabrics device 00:12:37.972 04:57:17 -- common/autotest_common.sh@641 -- # es=1 00:12:37.972 04:57:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:37.972 04:57:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:37.972 04:57:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:37.972 04:57:17 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:37.972 04:57:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.972 04:57:17 -- common/autotest_common.sh@10 -- # set +x 00:12:37.972 04:57:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.972 04:57:17 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:38.591 04:57:17 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:38.591 04:57:17 -- common/autotest_common.sh@1184 -- # local i=0 00:12:38.591 04:57:17 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:38.591 04:57:17 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:38.591 04:57:17 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:40.496 04:57:19 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:40.496 04:57:19 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:40.496 04:57:19 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:40.496 04:57:19 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:40.496 04:57:19 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:40.496 04:57:19 -- common/autotest_common.sh@1194 -- # return 0 00:12:40.496 04:57:19 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:40.756 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:40.756 04:57:19 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:40.756 04:57:19 -- common/autotest_common.sh@1205 -- # local i=0 00:12:40.756 04:57:19 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:40.756 04:57:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:40.756 04:57:19 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:40.756 04:57:19 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:40.756 04:57:19 -- common/autotest_common.sh@1217 -- # return 0 00:12:40.756 04:57:19 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:40.756 04:57:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:40.756 04:57:19 -- common/autotest_common.sh@10 -- # set +x 00:12:40.756 04:57:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:40.756 04:57:19 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:40.756 04:57:19 -- common/autotest_common.sh@638 -- # local es=0 00:12:40.756 04:57:19 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:40.756 04:57:19 -- common/autotest_common.sh@626 -- # local arg=nvme 00:12:40.756 04:57:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:40.756 04:57:19 -- common/autotest_common.sh@630 -- # type -t nvme 00:12:40.756 04:57:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:40.756 04:57:19 -- common/autotest_common.sh@632 -- # type -P nvme 00:12:40.756 04:57:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:40.756 04:57:19 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:12:40.756 04:57:19 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:12:40.756 04:57:19 -- common/autotest_common.sh@641 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:40.756 [2024-04-23 04:57:19.713754] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:40.756 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:40.756 could not add new controller: failed to write to nvme-fabrics device 00:12:40.756 04:57:19 -- common/autotest_common.sh@641 -- # es=1 00:12:40.756 04:57:19 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:40.756 04:57:19 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:40.756 04:57:19 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:40.756 04:57:19 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:40.756 04:57:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:40.756 04:57:19 -- common/autotest_common.sh@10 -- # set +x 00:12:40.756 04:57:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:40.756 04:57:19 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:41.327 04:57:20 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:41.327 04:57:20 -- common/autotest_common.sh@1184 -- # local i=0 00:12:41.327 04:57:20 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:41.327 04:57:20 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:41.327 04:57:20 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:43.231 04:57:22 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:43.231 04:57:22 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:43.231 04:57:22 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:43.231 04:57:22 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:43.231 04:57:22 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:43.231 04:57:22 -- common/autotest_common.sh@1194 -- # return 0 00:12:43.231 04:57:22 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:43.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.491 04:57:22 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:43.491 04:57:22 -- common/autotest_common.sh@1205 -- # local i=0 00:12:43.491 04:57:22 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:43.491 04:57:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:43.491 04:57:22 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:43.491 04:57:22 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:43.491 04:57:22 -- common/autotest_common.sh@1217 -- # return 0 00:12:43.491 04:57:22 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.491 04:57:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.491 04:57:22 -- common/autotest_common.sh@10 -- # set +x 00:12:43.491 04:57:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.491 04:57:22 -- target/rpc.sh@81 -- # seq 1 5 00:12:43.491 04:57:22 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:43.491 04:57:22 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:43.491 04:57:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.491 04:57:22 -- common/autotest_common.sh@10 -- # set +x 00:12:43.491 04:57:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.491 04:57:22 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:43.491 04:57:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.491 04:57:22 -- common/autotest_common.sh@10 -- # set +x 00:12:43.491 [2024-04-23 04:57:22.451784] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:43.491 04:57:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.491 04:57:22 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:43.491 04:57:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.491 04:57:22 -- common/autotest_common.sh@10 -- # set +x 00:12:43.491 04:57:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.491 04:57:22 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:43.491 04:57:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.491 04:57:22 -- common/autotest_common.sh@10 -- # set +x 00:12:43.491 04:57:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.491 04:57:22 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:44.060 04:57:23 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:44.060 04:57:23 -- common/autotest_common.sh@1184 -- # local i=0 00:12:44.060 04:57:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:44.060 04:57:23 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:44.060 04:57:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:45.966 04:57:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:45.966 04:57:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:45.966 04:57:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:45.966 04:57:25 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:45.966 04:57:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:45.966 04:57:25 -- common/autotest_common.sh@1194 -- # return 0 00:12:45.966 04:57:25 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:46.225 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.225 04:57:25 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:46.225 04:57:25 -- common/autotest_common.sh@1205 -- # local i=0 00:12:46.225 04:57:25 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:46.225 04:57:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:46.225 04:57:25 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:46.225 04:57:25 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:46.225 04:57:25 -- common/autotest_common.sh@1217 -- # return 0 00:12:46.225 04:57:25 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:46.225 04:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:46.225 04:57:25 -- common/autotest_common.sh@10 -- # set +x 00:12:46.225 04:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:46.225 04:57:25 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:46.225 04:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:46.225 04:57:25 -- common/autotest_common.sh@10 -- # set +x 00:12:46.225 04:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:46.225 04:57:25 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:46.225 04:57:25 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:46.225 04:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:46.225 04:57:25 -- common/autotest_common.sh@10 -- # set +x 00:12:46.225 04:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:46.225 04:57:25 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:46.225 04:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:46.225 04:57:25 -- common/autotest_common.sh@10 -- # set +x 00:12:46.225 [2024-04-23 04:57:25.204552] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:46.225 04:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:46.225 04:57:25 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:46.225 04:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:46.225 04:57:25 -- common/autotest_common.sh@10 -- # set +x 00:12:46.225 04:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:46.225 04:57:25 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:46.225 04:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:46.225 04:57:25 -- common/autotest_common.sh@10 -- # set +x 00:12:46.225 04:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:46.225 04:57:25 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:46.795 04:57:25 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:46.795 04:57:25 -- common/autotest_common.sh@1184 -- # local i=0 00:12:46.795 04:57:25 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:46.795 04:57:25 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:46.795 04:57:25 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:48.701 04:57:27 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:48.701 04:57:27 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:48.701 04:57:27 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:48.701 04:57:27 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:48.701 04:57:27 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:48.701 04:57:27 -- common/autotest_common.sh@1194 -- # return 0 00:12:48.701 04:57:27 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:48.701 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.701 04:57:27 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:48.702 04:57:27 -- common/autotest_common.sh@1205 -- # local i=0 00:12:48.702 04:57:27 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:48.702 04:57:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:48.702 04:57:27 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:48.702 04:57:27 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:48.702 04:57:27 -- common/autotest_common.sh@1217 -- # return 0 00:12:48.702 04:57:27 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.702 04:57:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:48.702 04:57:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.702 04:57:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:48.702 04:57:27 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:48.702 04:57:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:48.702 04:57:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.702 04:57:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:48.702 04:57:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:48.702 04:57:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:48.702 04:57:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:48.702 04:57:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.961 04:57:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:48.961 04:57:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:48.961 04:57:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:48.961 04:57:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.961 [2024-04-23 04:57:27.878284] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:48.961 04:57:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:48.961 04:57:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:48.961 04:57:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:48.961 04:57:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.961 04:57:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:48.961 04:57:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:48.961 04:57:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:48.961 04:57:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.961 04:57:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:48.961 04:57:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:49.532 04:57:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:49.532 04:57:28 -- common/autotest_common.sh@1184 -- # local i=0 00:12:49.532 04:57:28 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:49.532 04:57:28 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:49.532 04:57:28 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:51.436 04:57:30 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:51.436 04:57:30 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:51.436 04:57:30 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:51.436 04:57:30 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:51.436 04:57:30 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:51.436 04:57:30 -- common/autotest_common.sh@1194 -- # return 0 00:12:51.436 04:57:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:51.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.436 04:57:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:51.436 04:57:30 -- common/autotest_common.sh@1205 -- # local i=0 00:12:51.436 04:57:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:51.436 04:57:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:51.436 04:57:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:51.436 04:57:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:51.695 04:57:30 -- common/autotest_common.sh@1217 -- # return 0 00:12:51.695 04:57:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:51.695 04:57:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:51.695 04:57:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.695 04:57:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:51.695 04:57:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:51.695 04:57:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:51.695 04:57:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.695 04:57:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:51.695 04:57:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:51.695 04:57:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:51.695 04:57:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:51.695 04:57:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.695 04:57:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:51.695 04:57:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:51.695 04:57:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:51.695 04:57:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.695 [2024-04-23 04:57:30.632465] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:51.695 04:57:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:51.695 04:57:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:51.695 04:57:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:51.695 04:57:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.695 04:57:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:51.695 04:57:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:51.695 04:57:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:51.695 04:57:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.695 04:57:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:51.695 04:57:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:52.264 04:57:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:52.264 04:57:31 -- common/autotest_common.sh@1184 -- # local i=0 00:12:52.264 04:57:31 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:52.264 04:57:31 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:52.264 04:57:31 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:54.167 04:57:33 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:54.167 04:57:33 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:54.167 04:57:33 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:54.167 04:57:33 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:54.167 04:57:33 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:54.167 04:57:33 -- common/autotest_common.sh@1194 -- # return 0 00:12:54.167 04:57:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:54.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:54.425 04:57:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:54.425 04:57:33 -- common/autotest_common.sh@1205 -- # local i=0 00:12:54.425 04:57:33 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:54.425 04:57:33 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.425 04:57:33 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:54.425 04:57:33 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.425 04:57:33 -- common/autotest_common.sh@1217 -- # return 0 00:12:54.425 04:57:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:54.425 04:57:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.425 04:57:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.425 04:57:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.425 04:57:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:54.425 04:57:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.425 04:57:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.425 04:57:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.425 04:57:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:54.425 04:57:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:54.425 04:57:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.425 04:57:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.425 04:57:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.425 04:57:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:54.425 04:57:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.425 04:57:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.425 [2024-04-23 04:57:33.379470] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:54.425 04:57:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.425 04:57:33 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:54.425 04:57:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.425 04:57:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.425 04:57:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.425 04:57:33 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:54.425 04:57:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.425 04:57:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.425 04:57:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.425 04:57:33 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:54.993 04:57:34 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:54.993 04:57:34 -- common/autotest_common.sh@1184 -- # local i=0 00:12:54.993 04:57:34 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:54.993 04:57:34 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:54.993 04:57:34 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:57.031 04:57:36 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:57.031 04:57:36 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:57.031 04:57:36 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:57.031 04:57:36 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:57.031 04:57:36 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:57.031 04:57:36 -- common/autotest_common.sh@1194 -- # return 0 00:12:57.031 04:57:36 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:57.031 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.031 04:57:36 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:57.031 04:57:36 -- common/autotest_common.sh@1205 -- # local i=0 00:12:57.031 04:57:36 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:57.031 04:57:36 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.031 04:57:36 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:57.031 04:57:36 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.031 04:57:36 -- common/autotest_common.sh@1217 -- # return 0 00:12:57.031 04:57:36 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@99 -- # seq 1 5 00:12:57.031 04:57:36 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:57.031 04:57:36 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 [2024-04-23 04:57:36.136234] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.031 04:57:36 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:57.031 04:57:36 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:57.031 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.031 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 [2024-04-23 04:57:36.184307] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:57.290 04:57:36 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 [2024-04-23 04:57:36.232471] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:57.290 04:57:36 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 [2024-04-23 04:57:36.280653] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:57.290 04:57:36 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.290 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.290 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.290 [2024-04-23 04:57:36.328841] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.290 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.290 04:57:36 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:57.291 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.291 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.291 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.291 04:57:36 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:57.291 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.291 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.291 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.291 04:57:36 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.291 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.291 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.291 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.291 04:57:36 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.291 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.291 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.291 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.291 04:57:36 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:57.291 04:57:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.291 04:57:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.291 04:57:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.291 04:57:36 -- target/rpc.sh@110 -- # stats='{ 00:12:57.291 "tick_rate": 2700000000, 00:12:57.291 "poll_groups": [ 00:12:57.291 { 00:12:57.291 "name": "nvmf_tgt_poll_group_0", 00:12:57.291 "admin_qpairs": 2, 00:12:57.291 "io_qpairs": 84, 00:12:57.291 "current_admin_qpairs": 0, 00:12:57.291 "current_io_qpairs": 0, 00:12:57.291 "pending_bdev_io": 0, 00:12:57.291 "completed_nvme_io": 118, 00:12:57.291 "transports": [ 00:12:57.291 { 00:12:57.291 "trtype": "TCP" 00:12:57.291 } 00:12:57.291 ] 00:12:57.291 }, 00:12:57.291 { 00:12:57.291 "name": "nvmf_tgt_poll_group_1", 00:12:57.291 "admin_qpairs": 2, 00:12:57.291 "io_qpairs": 84, 00:12:57.291 "current_admin_qpairs": 0, 00:12:57.291 "current_io_qpairs": 0, 00:12:57.291 "pending_bdev_io": 0, 00:12:57.291 "completed_nvme_io": 169, 00:12:57.291 "transports": [ 00:12:57.291 { 00:12:57.291 "trtype": "TCP" 00:12:57.291 } 00:12:57.291 ] 00:12:57.291 }, 00:12:57.291 { 00:12:57.291 "name": "nvmf_tgt_poll_group_2", 00:12:57.291 "admin_qpairs": 1, 00:12:57.291 "io_qpairs": 84, 00:12:57.291 "current_admin_qpairs": 0, 00:12:57.291 "current_io_qpairs": 0, 00:12:57.291 "pending_bdev_io": 0, 00:12:57.291 "completed_nvme_io": 137, 00:12:57.291 "transports": [ 00:12:57.291 { 00:12:57.291 "trtype": "TCP" 00:12:57.291 } 00:12:57.291 ] 00:12:57.291 }, 00:12:57.291 { 00:12:57.291 "name": "nvmf_tgt_poll_group_3", 00:12:57.291 "admin_qpairs": 2, 00:12:57.291 "io_qpairs": 84, 00:12:57.291 "current_admin_qpairs": 0, 00:12:57.291 "current_io_qpairs": 0, 00:12:57.291 "pending_bdev_io": 0, 00:12:57.291 "completed_nvme_io": 262, 00:12:57.291 "transports": [ 00:12:57.291 { 00:12:57.291 "trtype": "TCP" 00:12:57.291 } 00:12:57.291 ] 00:12:57.291 } 00:12:57.291 ] 00:12:57.291 }' 00:12:57.291 04:57:36 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:57.291 04:57:36 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:57.291 04:57:36 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:57.291 04:57:36 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:57.291 04:57:36 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:57.291 04:57:36 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:57.291 04:57:36 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:57.291 04:57:36 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:57.291 04:57:36 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:57.550 04:57:36 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:57.550 04:57:36 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:57.550 04:57:36 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:57.550 04:57:36 -- target/rpc.sh@123 -- # nvmftestfini 00:12:57.550 04:57:36 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:57.550 04:57:36 -- nvmf/common.sh@117 -- # sync 00:12:57.550 04:57:36 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:12:57.550 04:57:36 -- nvmf/common.sh@120 -- # set +e 00:12:57.550 04:57:36 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:57.550 04:57:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:12:57.550 rmmod nvme_tcp 00:12:57.550 rmmod nvme_fabrics 00:12:57.550 rmmod nvme_keyring 00:12:57.550 04:57:36 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:57.550 04:57:36 -- nvmf/common.sh@124 -- # set -e 00:12:57.550 04:57:36 -- nvmf/common.sh@125 -- # return 0 00:12:57.550 04:57:36 -- nvmf/common.sh@478 -- # '[' -n 2334274 ']' 00:12:57.550 04:57:36 -- nvmf/common.sh@479 -- # killprocess 2334274 00:12:57.550 04:57:36 -- common/autotest_common.sh@936 -- # '[' -z 2334274 ']' 00:12:57.550 04:57:36 -- common/autotest_common.sh@940 -- # kill -0 2334274 00:12:57.550 04:57:36 -- common/autotest_common.sh@941 -- # uname 00:12:57.550 04:57:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:57.550 04:57:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2334274 00:12:57.550 04:57:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:57.550 04:57:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:57.550 04:57:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2334274' 00:12:57.550 killing process with pid 2334274 00:12:57.550 04:57:36 -- common/autotest_common.sh@955 -- # kill 2334274 00:12:57.550 04:57:36 -- common/autotest_common.sh@960 -- # wait 2334274 00:12:57.809 04:57:36 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:57.809 04:57:36 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:12:57.809 04:57:36 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:12:57.809 04:57:36 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:57.809 04:57:36 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:12:57.809 04:57:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:57.809 04:57:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:57.809 04:57:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:59.713 04:57:38 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:12:59.713 00:12:59.713 real 0m24.662s 00:12:59.713 user 1m19.913s 00:12:59.713 sys 0m3.776s 00:12:59.713 04:57:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:59.713 04:57:38 -- common/autotest_common.sh@10 -- # set +x 00:12:59.713 ************************************ 00:12:59.713 END TEST nvmf_rpc 00:12:59.713 ************************************ 00:12:59.713 04:57:38 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:59.713 04:57:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:59.713 04:57:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:59.713 04:57:38 -- common/autotest_common.sh@10 -- # set +x 00:12:59.972 ************************************ 00:12:59.972 START TEST nvmf_invalid 00:12:59.972 ************************************ 00:12:59.972 04:57:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:59.972 * Looking for test storage... 00:12:59.972 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:59.972 04:57:39 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:59.972 04:57:39 -- nvmf/common.sh@7 -- # uname -s 00:12:59.972 04:57:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:59.972 04:57:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:59.972 04:57:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:59.972 04:57:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:59.972 04:57:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:59.972 04:57:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:59.972 04:57:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:59.972 04:57:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:59.972 04:57:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:59.972 04:57:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:59.972 04:57:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:59.972 04:57:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:59.972 04:57:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:59.972 04:57:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:59.972 04:57:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:59.972 04:57:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:59.972 04:57:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:59.972 04:57:39 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:59.972 04:57:39 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:59.972 04:57:39 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:59.972 04:57:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.972 04:57:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.972 04:57:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.972 04:57:39 -- paths/export.sh@5 -- # export PATH 00:12:59.972 04:57:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.972 04:57:39 -- nvmf/common.sh@47 -- # : 0 00:12:59.972 04:57:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:59.972 04:57:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:59.972 04:57:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:59.972 04:57:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:59.972 04:57:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:59.972 04:57:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:59.972 04:57:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:59.972 04:57:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:59.972 04:57:39 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:59.972 04:57:39 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:59.972 04:57:39 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:59.972 04:57:39 -- target/invalid.sh@14 -- # target=foobar 00:12:59.972 04:57:39 -- target/invalid.sh@16 -- # RANDOM=0 00:12:59.972 04:57:39 -- target/invalid.sh@34 -- # nvmftestinit 00:12:59.972 04:57:39 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:12:59.972 04:57:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:59.972 04:57:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:59.972 04:57:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:59.972 04:57:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:59.972 04:57:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:59.972 04:57:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:59.972 04:57:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:59.972 04:57:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:59.972 04:57:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:59.972 04:57:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:59.973 04:57:39 -- common/autotest_common.sh@10 -- # set +x 00:13:01.878 04:57:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:01.878 04:57:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:01.878 04:57:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:01.878 04:57:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:01.878 04:57:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:01.878 04:57:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:01.878 04:57:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:01.878 04:57:40 -- nvmf/common.sh@295 -- # net_devs=() 00:13:01.878 04:57:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:01.878 04:57:40 -- nvmf/common.sh@296 -- # e810=() 00:13:01.878 04:57:40 -- nvmf/common.sh@296 -- # local -ga e810 00:13:01.878 04:57:40 -- nvmf/common.sh@297 -- # x722=() 00:13:01.878 04:57:40 -- nvmf/common.sh@297 -- # local -ga x722 00:13:01.878 04:57:40 -- nvmf/common.sh@298 -- # mlx=() 00:13:01.878 04:57:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:01.878 04:57:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:01.878 04:57:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:01.878 04:57:41 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:01.878 04:57:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:01.878 04:57:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:01.878 04:57:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:01.878 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:01.878 04:57:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:01.878 04:57:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:01.878 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:01.878 04:57:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:01.878 04:57:41 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:01.878 04:57:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:01.878 04:57:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:01.878 04:57:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:01.878 04:57:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:01.878 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:01.878 04:57:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:01.878 04:57:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:01.878 04:57:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:01.878 04:57:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:01.878 04:57:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:01.878 04:57:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:01.878 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:01.878 04:57:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:01.878 04:57:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:01.878 04:57:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:01.878 04:57:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:01.878 04:57:41 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:01.878 04:57:41 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:01.878 04:57:41 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:01.878 04:57:41 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:01.878 04:57:41 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:01.878 04:57:41 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:01.878 04:57:41 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:01.878 04:57:41 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:01.878 04:57:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:01.878 04:57:41 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:01.878 04:57:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:01.878 04:57:41 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:01.878 04:57:41 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:01.878 04:57:41 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:02.139 04:57:41 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:02.139 04:57:41 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:02.139 04:57:41 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:02.139 04:57:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:02.139 04:57:41 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:02.139 04:57:41 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:02.139 04:57:41 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:02.139 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:02.139 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:13:02.139 00:13:02.139 --- 10.0.0.2 ping statistics --- 00:13:02.139 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.139 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:13:02.139 04:57:41 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:02.139 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:02.139 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:13:02.139 00:13:02.139 --- 10.0.0.1 ping statistics --- 00:13:02.139 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.139 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:13:02.139 04:57:41 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:02.139 04:57:41 -- nvmf/common.sh@411 -- # return 0 00:13:02.139 04:57:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:02.139 04:57:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:02.139 04:57:41 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:02.139 04:57:41 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:02.139 04:57:41 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:02.139 04:57:41 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:02.139 04:57:41 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:02.139 04:57:41 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:02.139 04:57:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:02.139 04:57:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:02.139 04:57:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.139 04:57:41 -- nvmf/common.sh@470 -- # nvmfpid=2338657 00:13:02.139 04:57:41 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:02.139 04:57:41 -- nvmf/common.sh@471 -- # waitforlisten 2338657 00:13:02.139 04:57:41 -- common/autotest_common.sh@817 -- # '[' -z 2338657 ']' 00:13:02.139 04:57:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:02.139 04:57:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:02.139 04:57:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:02.139 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:02.139 04:57:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:02.139 04:57:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.139 [2024-04-23 04:57:41.206177] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:13:02.139 [2024-04-23 04:57:41.206278] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:02.139 EAL: No free 2048 kB hugepages reported on node 1 00:13:02.139 [2024-04-23 04:57:41.246051] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:13:02.139 [2024-04-23 04:57:41.272400] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:02.398 [2024-04-23 04:57:41.361182] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:02.398 [2024-04-23 04:57:41.361241] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:02.398 [2024-04-23 04:57:41.361270] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:02.398 [2024-04-23 04:57:41.361282] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:02.398 [2024-04-23 04:57:41.361292] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:02.398 [2024-04-23 04:57:41.361422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:02.398 [2024-04-23 04:57:41.361488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:02.398 [2024-04-23 04:57:41.361554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:02.398 [2024-04-23 04:57:41.361559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:02.398 04:57:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:02.399 04:57:41 -- common/autotest_common.sh@850 -- # return 0 00:13:02.399 04:57:41 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:02.399 04:57:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:02.399 04:57:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.399 04:57:41 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:02.399 04:57:41 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:02.399 04:57:41 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode30028 00:13:02.657 [2024-04-23 04:57:41.730958] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:02.657 04:57:41 -- target/invalid.sh@40 -- # out='request: 00:13:02.657 { 00:13:02.657 "nqn": "nqn.2016-06.io.spdk:cnode30028", 00:13:02.657 "tgt_name": "foobar", 00:13:02.657 "method": "nvmf_create_subsystem", 00:13:02.657 "req_id": 1 00:13:02.657 } 00:13:02.657 Got JSON-RPC error response 00:13:02.657 response: 00:13:02.657 { 00:13:02.657 "code": -32603, 00:13:02.657 "message": "Unable to find target foobar" 00:13:02.657 }' 00:13:02.657 04:57:41 -- target/invalid.sh@41 -- # [[ request: 00:13:02.657 { 00:13:02.657 "nqn": "nqn.2016-06.io.spdk:cnode30028", 00:13:02.657 "tgt_name": "foobar", 00:13:02.657 "method": "nvmf_create_subsystem", 00:13:02.657 "req_id": 1 00:13:02.657 } 00:13:02.657 Got JSON-RPC error response 00:13:02.657 response: 00:13:02.657 { 00:13:02.657 "code": -32603, 00:13:02.657 "message": "Unable to find target foobar" 00:13:02.657 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:02.657 04:57:41 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:02.657 04:57:41 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode29839 00:13:02.915 [2024-04-23 04:57:42.023975] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29839: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:02.915 04:57:42 -- target/invalid.sh@45 -- # out='request: 00:13:02.915 { 00:13:02.915 "nqn": "nqn.2016-06.io.spdk:cnode29839", 00:13:02.915 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:02.915 "method": "nvmf_create_subsystem", 00:13:02.915 "req_id": 1 00:13:02.915 } 00:13:02.915 Got JSON-RPC error response 00:13:02.915 response: 00:13:02.915 { 00:13:02.915 "code": -32602, 00:13:02.915 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:02.915 }' 00:13:02.916 04:57:42 -- target/invalid.sh@46 -- # [[ request: 00:13:02.916 { 00:13:02.916 "nqn": "nqn.2016-06.io.spdk:cnode29839", 00:13:02.916 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:02.916 "method": "nvmf_create_subsystem", 00:13:02.916 "req_id": 1 00:13:02.916 } 00:13:02.916 Got JSON-RPC error response 00:13:02.916 response: 00:13:02.916 { 00:13:02.916 "code": -32602, 00:13:02.916 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:02.916 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:02.916 04:57:42 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:02.916 04:57:42 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode8806 00:13:03.175 [2024-04-23 04:57:42.316875] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8806: invalid model number 'SPDK_Controller' 00:13:03.175 04:57:42 -- target/invalid.sh@50 -- # out='request: 00:13:03.175 { 00:13:03.175 "nqn": "nqn.2016-06.io.spdk:cnode8806", 00:13:03.175 "model_number": "SPDK_Controller\u001f", 00:13:03.175 "method": "nvmf_create_subsystem", 00:13:03.175 "req_id": 1 00:13:03.175 } 00:13:03.175 Got JSON-RPC error response 00:13:03.175 response: 00:13:03.175 { 00:13:03.175 "code": -32602, 00:13:03.175 "message": "Invalid MN SPDK_Controller\u001f" 00:13:03.175 }' 00:13:03.175 04:57:42 -- target/invalid.sh@51 -- # [[ request: 00:13:03.175 { 00:13:03.175 "nqn": "nqn.2016-06.io.spdk:cnode8806", 00:13:03.175 "model_number": "SPDK_Controller\u001f", 00:13:03.175 "method": "nvmf_create_subsystem", 00:13:03.175 "req_id": 1 00:13:03.175 } 00:13:03.175 Got JSON-RPC error response 00:13:03.175 response: 00:13:03.175 { 00:13:03.175 "code": -32602, 00:13:03.175 "message": "Invalid MN SPDK_Controller\u001f" 00:13:03.175 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:03.175 04:57:42 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:03.175 04:57:42 -- target/invalid.sh@19 -- # local length=21 ll 00:13:03.434 04:57:42 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:03.434 04:57:42 -- target/invalid.sh@21 -- # local chars 00:13:03.434 04:57:42 -- target/invalid.sh@22 -- # local string 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 44 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=, 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 73 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=I 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 83 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=S 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 91 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+='[' 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 36 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x24' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+='$' 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 78 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=N 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 71 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=G 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 87 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=W 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 72 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=H 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 97 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=a 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 83 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=S 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 102 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=f 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 72 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=H 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 79 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=O 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 87 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=W 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 107 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=k 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 50 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=2 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 72 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=H 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 77 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=M 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 110 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=n 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # printf %x 65 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:03.434 04:57:42 -- target/invalid.sh@25 -- # string+=A 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.434 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.434 04:57:42 -- target/invalid.sh@28 -- # [[ , == \- ]] 00:13:03.434 04:57:42 -- target/invalid.sh@31 -- # echo ',IS[$NGWHaSfHOWk2HMnA' 00:13:03.434 04:57:42 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s ',IS[$NGWHaSfHOWk2HMnA' nqn.2016-06.io.spdk:cnode9889 00:13:03.694 [2024-04-23 04:57:42.682126] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9889: invalid serial number ',IS[$NGWHaSfHOWk2HMnA' 00:13:03.694 04:57:42 -- target/invalid.sh@54 -- # out='request: 00:13:03.694 { 00:13:03.694 "nqn": "nqn.2016-06.io.spdk:cnode9889", 00:13:03.694 "serial_number": ",IS[$NGWHaSfHOWk2HMnA", 00:13:03.694 "method": "nvmf_create_subsystem", 00:13:03.694 "req_id": 1 00:13:03.694 } 00:13:03.694 Got JSON-RPC error response 00:13:03.694 response: 00:13:03.694 { 00:13:03.694 "code": -32602, 00:13:03.694 "message": "Invalid SN ,IS[$NGWHaSfHOWk2HMnA" 00:13:03.694 }' 00:13:03.694 04:57:42 -- target/invalid.sh@55 -- # [[ request: 00:13:03.694 { 00:13:03.694 "nqn": "nqn.2016-06.io.spdk:cnode9889", 00:13:03.694 "serial_number": ",IS[$NGWHaSfHOWk2HMnA", 00:13:03.694 "method": "nvmf_create_subsystem", 00:13:03.694 "req_id": 1 00:13:03.694 } 00:13:03.694 Got JSON-RPC error response 00:13:03.694 response: 00:13:03.694 { 00:13:03.694 "code": -32602, 00:13:03.694 "message": "Invalid SN ,IS[$NGWHaSfHOWk2HMnA" 00:13:03.694 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:03.694 04:57:42 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:03.694 04:57:42 -- target/invalid.sh@19 -- # local length=41 ll 00:13:03.694 04:57:42 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:03.694 04:57:42 -- target/invalid.sh@21 -- # local chars 00:13:03.694 04:57:42 -- target/invalid.sh@22 -- # local string 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 83 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=S 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 34 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='"' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 109 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=m 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 36 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x24' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='$' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 76 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=L 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 89 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=Y 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 72 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=H 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 37 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=% 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 91 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='[' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 107 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=k 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 36 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x24' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='$' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 103 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=g 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 118 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=v 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 62 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='>' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 72 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=H 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 96 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='`' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 69 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=E 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 65 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=A 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 60 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='<' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 56 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=8 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 50 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=2 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 99 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=c 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 53 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=5 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 66 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=B 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 35 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+='#' 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 119 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+=w 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # printf %x 61 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:13:03.694 04:57:42 -- target/invalid.sh@25 -- # string+== 00:13:03.694 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 88 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=X 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 86 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=V 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 62 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+='>' 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 109 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=m 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 65 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=A 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 68 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=D 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 81 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=Q 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 49 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=1 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 122 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=z 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 88 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=X 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 112 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=p 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 63 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+='?' 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 75 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=K 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # printf %x 46 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:03.695 04:57:42 -- target/invalid.sh@25 -- # string+=. 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:03.695 04:57:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:03.695 04:57:42 -- target/invalid.sh@28 -- # [[ S == \- ]] 00:13:03.695 04:57:42 -- target/invalid.sh@31 -- # echo 'S"m$LYH%[k$gv>H`EA<82c5B#w=XV>mADQ1zXp?K.' 00:13:03.695 04:57:42 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'S"m$LYH%[k$gv>H`EA<82c5B#w=XV>mADQ1zXp?K.' nqn.2016-06.io.spdk:cnode25428 00:13:03.953 [2024-04-23 04:57:43.087423] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25428: invalid model number 'S"m$LYH%[k$gv>H`EA<82c5B#w=XV>mADQ1zXp?K.' 00:13:03.953 04:57:43 -- target/invalid.sh@58 -- # out='request: 00:13:03.953 { 00:13:03.953 "nqn": "nqn.2016-06.io.spdk:cnode25428", 00:13:03.953 "model_number": "S\"m$LYH%[k$gv>H`EA<82c5B#w=XV>mADQ1zXp?K.", 00:13:03.953 "method": "nvmf_create_subsystem", 00:13:03.953 "req_id": 1 00:13:03.953 } 00:13:03.953 Got JSON-RPC error response 00:13:03.953 response: 00:13:03.953 { 00:13:03.953 "code": -32602, 00:13:03.953 "message": "Invalid MN S\"m$LYH%[k$gv>H`EA<82c5B#w=XV>mADQ1zXp?K." 00:13:03.953 }' 00:13:03.953 04:57:43 -- target/invalid.sh@59 -- # [[ request: 00:13:03.953 { 00:13:03.953 "nqn": "nqn.2016-06.io.spdk:cnode25428", 00:13:03.953 "model_number": "S\"m$LYH%[k$gv>H`EA<82c5B#w=XV>mADQ1zXp?K.", 00:13:03.953 "method": "nvmf_create_subsystem", 00:13:03.953 "req_id": 1 00:13:03.953 } 00:13:03.953 Got JSON-RPC error response 00:13:03.953 response: 00:13:03.953 { 00:13:03.953 "code": -32602, 00:13:03.953 "message": "Invalid MN S\"m$LYH%[k$gv>H`EA<82c5B#w=XV>mADQ1zXp?K." 00:13:03.953 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:03.953 04:57:43 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:04.226 [2024-04-23 04:57:43.324271] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:04.227 04:57:43 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:04.488 04:57:43 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:04.488 04:57:43 -- target/invalid.sh@67 -- # echo '' 00:13:04.488 04:57:43 -- target/invalid.sh@67 -- # head -n 1 00:13:04.488 04:57:43 -- target/invalid.sh@67 -- # IP= 00:13:04.488 04:57:43 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:04.746 [2024-04-23 04:57:43.825925] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:04.746 04:57:43 -- target/invalid.sh@69 -- # out='request: 00:13:04.746 { 00:13:04.746 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:04.746 "listen_address": { 00:13:04.746 "trtype": "tcp", 00:13:04.746 "traddr": "", 00:13:04.746 "trsvcid": "4421" 00:13:04.746 }, 00:13:04.746 "method": "nvmf_subsystem_remove_listener", 00:13:04.746 "req_id": 1 00:13:04.746 } 00:13:04.746 Got JSON-RPC error response 00:13:04.746 response: 00:13:04.746 { 00:13:04.746 "code": -32602, 00:13:04.746 "message": "Invalid parameters" 00:13:04.746 }' 00:13:04.746 04:57:43 -- target/invalid.sh@70 -- # [[ request: 00:13:04.746 { 00:13:04.746 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:04.746 "listen_address": { 00:13:04.746 "trtype": "tcp", 00:13:04.746 "traddr": "", 00:13:04.746 "trsvcid": "4421" 00:13:04.746 }, 00:13:04.746 "method": "nvmf_subsystem_remove_listener", 00:13:04.746 "req_id": 1 00:13:04.746 } 00:13:04.746 Got JSON-RPC error response 00:13:04.746 response: 00:13:04.746 { 00:13:04.746 "code": -32602, 00:13:04.746 "message": "Invalid parameters" 00:13:04.746 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:04.746 04:57:43 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23225 -i 0 00:13:05.004 [2024-04-23 04:57:44.066682] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23225: invalid cntlid range [0-65519] 00:13:05.004 04:57:44 -- target/invalid.sh@73 -- # out='request: 00:13:05.004 { 00:13:05.004 "nqn": "nqn.2016-06.io.spdk:cnode23225", 00:13:05.004 "min_cntlid": 0, 00:13:05.004 "method": "nvmf_create_subsystem", 00:13:05.004 "req_id": 1 00:13:05.004 } 00:13:05.004 Got JSON-RPC error response 00:13:05.004 response: 00:13:05.004 { 00:13:05.004 "code": -32602, 00:13:05.004 "message": "Invalid cntlid range [0-65519]" 00:13:05.004 }' 00:13:05.004 04:57:44 -- target/invalid.sh@74 -- # [[ request: 00:13:05.004 { 00:13:05.004 "nqn": "nqn.2016-06.io.spdk:cnode23225", 00:13:05.004 "min_cntlid": 0, 00:13:05.004 "method": "nvmf_create_subsystem", 00:13:05.004 "req_id": 1 00:13:05.004 } 00:13:05.004 Got JSON-RPC error response 00:13:05.004 response: 00:13:05.004 { 00:13:05.004 "code": -32602, 00:13:05.004 "message": "Invalid cntlid range [0-65519]" 00:13:05.004 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:05.004 04:57:44 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24310 -i 65520 00:13:05.262 [2024-04-23 04:57:44.339576] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24310: invalid cntlid range [65520-65519] 00:13:05.262 04:57:44 -- target/invalid.sh@75 -- # out='request: 00:13:05.262 { 00:13:05.262 "nqn": "nqn.2016-06.io.spdk:cnode24310", 00:13:05.262 "min_cntlid": 65520, 00:13:05.262 "method": "nvmf_create_subsystem", 00:13:05.262 "req_id": 1 00:13:05.262 } 00:13:05.262 Got JSON-RPC error response 00:13:05.262 response: 00:13:05.262 { 00:13:05.262 "code": -32602, 00:13:05.262 "message": "Invalid cntlid range [65520-65519]" 00:13:05.262 }' 00:13:05.262 04:57:44 -- target/invalid.sh@76 -- # [[ request: 00:13:05.262 { 00:13:05.262 "nqn": "nqn.2016-06.io.spdk:cnode24310", 00:13:05.262 "min_cntlid": 65520, 00:13:05.262 "method": "nvmf_create_subsystem", 00:13:05.262 "req_id": 1 00:13:05.262 } 00:13:05.262 Got JSON-RPC error response 00:13:05.262 response: 00:13:05.262 { 00:13:05.262 "code": -32602, 00:13:05.262 "message": "Invalid cntlid range [65520-65519]" 00:13:05.262 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:05.262 04:57:44 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode12972 -I 0 00:13:05.520 [2024-04-23 04:57:44.580388] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode12972: invalid cntlid range [1-0] 00:13:05.520 04:57:44 -- target/invalid.sh@77 -- # out='request: 00:13:05.520 { 00:13:05.520 "nqn": "nqn.2016-06.io.spdk:cnode12972", 00:13:05.520 "max_cntlid": 0, 00:13:05.520 "method": "nvmf_create_subsystem", 00:13:05.520 "req_id": 1 00:13:05.520 } 00:13:05.520 Got JSON-RPC error response 00:13:05.520 response: 00:13:05.520 { 00:13:05.520 "code": -32602, 00:13:05.520 "message": "Invalid cntlid range [1-0]" 00:13:05.520 }' 00:13:05.520 04:57:44 -- target/invalid.sh@78 -- # [[ request: 00:13:05.520 { 00:13:05.520 "nqn": "nqn.2016-06.io.spdk:cnode12972", 00:13:05.520 "max_cntlid": 0, 00:13:05.520 "method": "nvmf_create_subsystem", 00:13:05.520 "req_id": 1 00:13:05.520 } 00:13:05.520 Got JSON-RPC error response 00:13:05.520 response: 00:13:05.520 { 00:13:05.520 "code": -32602, 00:13:05.520 "message": "Invalid cntlid range [1-0]" 00:13:05.520 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:05.520 04:57:44 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9227 -I 65520 00:13:05.778 [2024-04-23 04:57:44.833179] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9227: invalid cntlid range [1-65520] 00:13:05.778 04:57:44 -- target/invalid.sh@79 -- # out='request: 00:13:05.778 { 00:13:05.778 "nqn": "nqn.2016-06.io.spdk:cnode9227", 00:13:05.778 "max_cntlid": 65520, 00:13:05.778 "method": "nvmf_create_subsystem", 00:13:05.778 "req_id": 1 00:13:05.778 } 00:13:05.778 Got JSON-RPC error response 00:13:05.778 response: 00:13:05.778 { 00:13:05.778 "code": -32602, 00:13:05.778 "message": "Invalid cntlid range [1-65520]" 00:13:05.778 }' 00:13:05.778 04:57:44 -- target/invalid.sh@80 -- # [[ request: 00:13:05.778 { 00:13:05.778 "nqn": "nqn.2016-06.io.spdk:cnode9227", 00:13:05.778 "max_cntlid": 65520, 00:13:05.778 "method": "nvmf_create_subsystem", 00:13:05.778 "req_id": 1 00:13:05.778 } 00:13:05.778 Got JSON-RPC error response 00:13:05.778 response: 00:13:05.778 { 00:13:05.778 "code": -32602, 00:13:05.778 "message": "Invalid cntlid range [1-65520]" 00:13:05.778 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:05.778 04:57:44 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode21466 -i 6 -I 5 00:13:06.036 [2024-04-23 04:57:45.090006] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21466: invalid cntlid range [6-5] 00:13:06.036 04:57:45 -- target/invalid.sh@83 -- # out='request: 00:13:06.036 { 00:13:06.036 "nqn": "nqn.2016-06.io.spdk:cnode21466", 00:13:06.036 "min_cntlid": 6, 00:13:06.036 "max_cntlid": 5, 00:13:06.036 "method": "nvmf_create_subsystem", 00:13:06.036 "req_id": 1 00:13:06.036 } 00:13:06.036 Got JSON-RPC error response 00:13:06.036 response: 00:13:06.036 { 00:13:06.036 "code": -32602, 00:13:06.036 "message": "Invalid cntlid range [6-5]" 00:13:06.036 }' 00:13:06.036 04:57:45 -- target/invalid.sh@84 -- # [[ request: 00:13:06.036 { 00:13:06.036 "nqn": "nqn.2016-06.io.spdk:cnode21466", 00:13:06.036 "min_cntlid": 6, 00:13:06.036 "max_cntlid": 5, 00:13:06.036 "method": "nvmf_create_subsystem", 00:13:06.036 "req_id": 1 00:13:06.036 } 00:13:06.036 Got JSON-RPC error response 00:13:06.036 response: 00:13:06.036 { 00:13:06.036 "code": -32602, 00:13:06.036 "message": "Invalid cntlid range [6-5]" 00:13:06.036 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:06.036 04:57:45 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:06.296 04:57:45 -- target/invalid.sh@87 -- # out='request: 00:13:06.296 { 00:13:06.296 "name": "foobar", 00:13:06.296 "method": "nvmf_delete_target", 00:13:06.296 "req_id": 1 00:13:06.296 } 00:13:06.296 Got JSON-RPC error response 00:13:06.296 response: 00:13:06.296 { 00:13:06.296 "code": -32602, 00:13:06.296 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:06.296 }' 00:13:06.296 04:57:45 -- target/invalid.sh@88 -- # [[ request: 00:13:06.296 { 00:13:06.296 "name": "foobar", 00:13:06.296 "method": "nvmf_delete_target", 00:13:06.296 "req_id": 1 00:13:06.296 } 00:13:06.296 Got JSON-RPC error response 00:13:06.296 response: 00:13:06.296 { 00:13:06.296 "code": -32602, 00:13:06.296 "message": "The specified target doesn't exist, cannot delete it." 00:13:06.296 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:06.296 04:57:45 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:06.296 04:57:45 -- target/invalid.sh@91 -- # nvmftestfini 00:13:06.296 04:57:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:06.296 04:57:45 -- nvmf/common.sh@117 -- # sync 00:13:06.296 04:57:45 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:06.296 04:57:45 -- nvmf/common.sh@120 -- # set +e 00:13:06.296 04:57:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:06.296 04:57:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:06.296 rmmod nvme_tcp 00:13:06.296 rmmod nvme_fabrics 00:13:06.296 rmmod nvme_keyring 00:13:06.296 04:57:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:06.296 04:57:45 -- nvmf/common.sh@124 -- # set -e 00:13:06.296 04:57:45 -- nvmf/common.sh@125 -- # return 0 00:13:06.296 04:57:45 -- nvmf/common.sh@478 -- # '[' -n 2338657 ']' 00:13:06.296 04:57:45 -- nvmf/common.sh@479 -- # killprocess 2338657 00:13:06.296 04:57:45 -- common/autotest_common.sh@936 -- # '[' -z 2338657 ']' 00:13:06.296 04:57:45 -- common/autotest_common.sh@940 -- # kill -0 2338657 00:13:06.296 04:57:45 -- common/autotest_common.sh@941 -- # uname 00:13:06.296 04:57:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:06.296 04:57:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2338657 00:13:06.296 04:57:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:06.296 04:57:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:06.296 04:57:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2338657' 00:13:06.296 killing process with pid 2338657 00:13:06.296 04:57:45 -- common/autotest_common.sh@955 -- # kill 2338657 00:13:06.296 04:57:45 -- common/autotest_common.sh@960 -- # wait 2338657 00:13:06.556 04:57:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:06.556 04:57:45 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:06.556 04:57:45 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:06.556 04:57:45 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:06.556 04:57:45 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:06.556 04:57:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:06.556 04:57:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:06.556 04:57:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:08.464 04:57:47 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:08.464 00:13:08.464 real 0m8.625s 00:13:08.464 user 0m20.389s 00:13:08.464 sys 0m2.367s 00:13:08.464 04:57:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:08.464 04:57:47 -- common/autotest_common.sh@10 -- # set +x 00:13:08.464 ************************************ 00:13:08.464 END TEST nvmf_invalid 00:13:08.464 ************************************ 00:13:08.464 04:57:47 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:08.464 04:57:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:08.464 04:57:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:08.464 04:57:47 -- common/autotest_common.sh@10 -- # set +x 00:13:08.723 ************************************ 00:13:08.723 START TEST nvmf_abort 00:13:08.723 ************************************ 00:13:08.723 04:57:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:08.723 * Looking for test storage... 00:13:08.723 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:08.723 04:57:47 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:08.723 04:57:47 -- nvmf/common.sh@7 -- # uname -s 00:13:08.723 04:57:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:08.723 04:57:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:08.723 04:57:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:08.723 04:57:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:08.723 04:57:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:08.723 04:57:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:08.723 04:57:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:08.723 04:57:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:08.723 04:57:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:08.723 04:57:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:08.723 04:57:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:08.723 04:57:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:08.723 04:57:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:08.723 04:57:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:08.723 04:57:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:08.723 04:57:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:08.723 04:57:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:08.723 04:57:47 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:08.723 04:57:47 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:08.723 04:57:47 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:08.723 04:57:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.723 04:57:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.723 04:57:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.723 04:57:47 -- paths/export.sh@5 -- # export PATH 00:13:08.723 04:57:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.723 04:57:47 -- nvmf/common.sh@47 -- # : 0 00:13:08.723 04:57:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:08.723 04:57:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:08.723 04:57:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:08.723 04:57:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:08.723 04:57:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:08.723 04:57:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:08.723 04:57:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:08.723 04:57:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:08.723 04:57:47 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:08.723 04:57:47 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:08.723 04:57:47 -- target/abort.sh@14 -- # nvmftestinit 00:13:08.723 04:57:47 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:13:08.723 04:57:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:08.723 04:57:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:08.723 04:57:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:08.723 04:57:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:08.723 04:57:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:08.723 04:57:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:08.723 04:57:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:08.723 04:57:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:08.723 04:57:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:08.723 04:57:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:08.723 04:57:47 -- common/autotest_common.sh@10 -- # set +x 00:13:11.262 04:57:49 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:11.262 04:57:49 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:11.262 04:57:49 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:11.262 04:57:49 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:11.262 04:57:49 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:11.262 04:57:49 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:11.262 04:57:49 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:11.262 04:57:49 -- nvmf/common.sh@295 -- # net_devs=() 00:13:11.262 04:57:49 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:11.262 04:57:49 -- nvmf/common.sh@296 -- # e810=() 00:13:11.262 04:57:49 -- nvmf/common.sh@296 -- # local -ga e810 00:13:11.262 04:57:49 -- nvmf/common.sh@297 -- # x722=() 00:13:11.262 04:57:49 -- nvmf/common.sh@297 -- # local -ga x722 00:13:11.262 04:57:49 -- nvmf/common.sh@298 -- # mlx=() 00:13:11.262 04:57:49 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:11.262 04:57:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:11.262 04:57:49 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:11.262 04:57:49 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:11.262 04:57:49 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:11.262 04:57:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:11.262 04:57:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:11.262 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:11.262 04:57:49 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:11.262 04:57:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:11.262 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:11.262 04:57:49 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:11.262 04:57:49 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:11.262 04:57:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.262 04:57:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:11.262 04:57:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.262 04:57:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:11.262 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:11.262 04:57:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.262 04:57:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:11.262 04:57:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.262 04:57:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:11.262 04:57:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.262 04:57:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:11.262 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:11.262 04:57:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.262 04:57:49 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:11.262 04:57:49 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:11.262 04:57:49 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:11.262 04:57:49 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:11.262 04:57:49 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:11.262 04:57:49 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:11.262 04:57:49 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:11.262 04:57:49 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:11.262 04:57:49 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:11.262 04:57:49 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:11.262 04:57:49 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:11.262 04:57:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:11.262 04:57:49 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:11.262 04:57:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:11.262 04:57:49 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:11.262 04:57:49 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:11.262 04:57:49 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:11.262 04:57:49 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:11.262 04:57:49 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:11.262 04:57:49 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:11.262 04:57:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:11.262 04:57:50 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:11.262 04:57:50 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:11.262 04:57:50 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:11.262 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:11.262 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:13:11.262 00:13:11.262 --- 10.0.0.2 ping statistics --- 00:13:11.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:11.262 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:13:11.262 04:57:50 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:11.263 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:11.263 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:13:11.263 00:13:11.263 --- 10.0.0.1 ping statistics --- 00:13:11.263 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:11.263 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:13:11.263 04:57:50 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:11.263 04:57:50 -- nvmf/common.sh@411 -- # return 0 00:13:11.263 04:57:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:11.263 04:57:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:11.263 04:57:50 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:11.263 04:57:50 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:11.263 04:57:50 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:11.263 04:57:50 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:11.263 04:57:50 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:11.263 04:57:50 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:11.263 04:57:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:11.263 04:57:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:11.263 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.263 04:57:50 -- nvmf/common.sh@470 -- # nvmfpid=2341298 00:13:11.263 04:57:50 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:11.263 04:57:50 -- nvmf/common.sh@471 -- # waitforlisten 2341298 00:13:11.263 04:57:50 -- common/autotest_common.sh@817 -- # '[' -z 2341298 ']' 00:13:11.263 04:57:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:11.263 04:57:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:11.263 04:57:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:11.263 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:11.263 04:57:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:11.263 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.263 [2024-04-23 04:57:50.090488] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:13:11.263 [2024-04-23 04:57:50.090616] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:11.263 EAL: No free 2048 kB hugepages reported on node 1 00:13:11.263 [2024-04-23 04:57:50.127836] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:13:11.263 [2024-04-23 04:57:50.158376] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:11.263 [2024-04-23 04:57:50.249917] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:11.263 [2024-04-23 04:57:50.249982] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:11.263 [2024-04-23 04:57:50.249999] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:11.263 [2024-04-23 04:57:50.250012] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:11.263 [2024-04-23 04:57:50.250024] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:11.263 [2024-04-23 04:57:50.250119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:11.263 [2024-04-23 04:57:50.250536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:11.263 [2024-04-23 04:57:50.250542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:11.263 04:57:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:11.263 04:57:50 -- common/autotest_common.sh@850 -- # return 0 00:13:11.263 04:57:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:11.263 04:57:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:11.263 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.263 04:57:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:11.263 04:57:50 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:11.263 04:57:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:11.263 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.263 [2024-04-23 04:57:50.395724] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:11.263 04:57:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:11.263 04:57:50 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:11.263 04:57:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:11.263 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.522 Malloc0 00:13:11.522 04:57:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:11.522 04:57:50 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:11.522 04:57:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:11.522 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.522 Delay0 00:13:11.522 04:57:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:11.522 04:57:50 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:11.522 04:57:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:11.522 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.522 04:57:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:11.522 04:57:50 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:11.522 04:57:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:11.522 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.522 04:57:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:11.522 04:57:50 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:11.522 04:57:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:11.522 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.522 [2024-04-23 04:57:50.460826] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.522 04:57:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:11.522 04:57:50 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:11.522 04:57:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:11.522 04:57:50 -- common/autotest_common.sh@10 -- # set +x 00:13:11.522 04:57:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:11.522 04:57:50 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:11.522 EAL: No free 2048 kB hugepages reported on node 1 00:13:11.522 [2024-04-23 04:57:50.566499] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:14.066 Initializing NVMe Controllers 00:13:14.066 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:14.066 controller IO queue size 128 less than required 00:13:14.066 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:14.066 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:14.066 Initialization complete. Launching workers. 00:13:14.066 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33375 00:13:14.066 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33436, failed to submit 62 00:13:14.066 success 33379, unsuccess 57, failed 0 00:13:14.066 04:57:52 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:14.066 04:57:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:14.066 04:57:52 -- common/autotest_common.sh@10 -- # set +x 00:13:14.066 04:57:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:14.066 04:57:52 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:14.066 04:57:52 -- target/abort.sh@38 -- # nvmftestfini 00:13:14.066 04:57:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:14.066 04:57:52 -- nvmf/common.sh@117 -- # sync 00:13:14.066 04:57:52 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:14.066 04:57:52 -- nvmf/common.sh@120 -- # set +e 00:13:14.066 04:57:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:14.066 04:57:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:14.066 rmmod nvme_tcp 00:13:14.066 rmmod nvme_fabrics 00:13:14.066 rmmod nvme_keyring 00:13:14.066 04:57:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:14.066 04:57:52 -- nvmf/common.sh@124 -- # set -e 00:13:14.066 04:57:52 -- nvmf/common.sh@125 -- # return 0 00:13:14.066 04:57:52 -- nvmf/common.sh@478 -- # '[' -n 2341298 ']' 00:13:14.066 04:57:52 -- nvmf/common.sh@479 -- # killprocess 2341298 00:13:14.066 04:57:52 -- common/autotest_common.sh@936 -- # '[' -z 2341298 ']' 00:13:14.066 04:57:52 -- common/autotest_common.sh@940 -- # kill -0 2341298 00:13:14.066 04:57:52 -- common/autotest_common.sh@941 -- # uname 00:13:14.066 04:57:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:14.066 04:57:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2341298 00:13:14.066 04:57:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:14.066 04:57:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:14.066 04:57:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2341298' 00:13:14.066 killing process with pid 2341298 00:13:14.066 04:57:52 -- common/autotest_common.sh@955 -- # kill 2341298 00:13:14.066 04:57:52 -- common/autotest_common.sh@960 -- # wait 2341298 00:13:14.066 04:57:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:14.066 04:57:53 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:14.066 04:57:53 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:14.066 04:57:53 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:14.066 04:57:53 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:14.066 04:57:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:14.066 04:57:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:14.066 04:57:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:16.000 04:57:55 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:16.000 00:13:16.000 real 0m7.339s 00:13:16.000 user 0m10.646s 00:13:16.000 sys 0m2.580s 00:13:16.000 04:57:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:16.000 04:57:55 -- common/autotest_common.sh@10 -- # set +x 00:13:16.000 ************************************ 00:13:16.000 END TEST nvmf_abort 00:13:16.000 ************************************ 00:13:16.001 04:57:55 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:16.001 04:57:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:16.001 04:57:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:16.001 04:57:55 -- common/autotest_common.sh@10 -- # set +x 00:13:16.260 ************************************ 00:13:16.260 START TEST nvmf_ns_hotplug_stress 00:13:16.260 ************************************ 00:13:16.260 04:57:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:16.260 * Looking for test storage... 00:13:16.260 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:16.260 04:57:55 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:16.260 04:57:55 -- nvmf/common.sh@7 -- # uname -s 00:13:16.260 04:57:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:16.260 04:57:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:16.260 04:57:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:16.260 04:57:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:16.260 04:57:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:16.260 04:57:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:16.261 04:57:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:16.261 04:57:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:16.261 04:57:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:16.261 04:57:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:16.261 04:57:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:16.261 04:57:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:16.261 04:57:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:16.261 04:57:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:16.261 04:57:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:16.261 04:57:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:16.261 04:57:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:16.261 04:57:55 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:16.261 04:57:55 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:16.261 04:57:55 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:16.261 04:57:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.261 04:57:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.261 04:57:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.261 04:57:55 -- paths/export.sh@5 -- # export PATH 00:13:16.261 04:57:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.261 04:57:55 -- nvmf/common.sh@47 -- # : 0 00:13:16.261 04:57:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:16.261 04:57:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:16.261 04:57:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:16.261 04:57:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:16.261 04:57:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:16.261 04:57:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:16.261 04:57:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:16.261 04:57:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:16.261 04:57:55 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:16.261 04:57:55 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:13:16.261 04:57:55 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:13:16.261 04:57:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:16.261 04:57:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:16.261 04:57:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:16.261 04:57:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:16.261 04:57:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:16.261 04:57:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:16.261 04:57:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:16.261 04:57:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:16.261 04:57:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:16.261 04:57:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:16.261 04:57:55 -- common/autotest_common.sh@10 -- # set +x 00:13:18.171 04:57:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:18.171 04:57:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:18.171 04:57:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:18.171 04:57:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:18.171 04:57:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:18.171 04:57:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:18.171 04:57:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:18.171 04:57:57 -- nvmf/common.sh@295 -- # net_devs=() 00:13:18.171 04:57:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:18.171 04:57:57 -- nvmf/common.sh@296 -- # e810=() 00:13:18.171 04:57:57 -- nvmf/common.sh@296 -- # local -ga e810 00:13:18.171 04:57:57 -- nvmf/common.sh@297 -- # x722=() 00:13:18.171 04:57:57 -- nvmf/common.sh@297 -- # local -ga x722 00:13:18.171 04:57:57 -- nvmf/common.sh@298 -- # mlx=() 00:13:18.171 04:57:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:18.171 04:57:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:18.171 04:57:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:18.171 04:57:57 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:18.171 04:57:57 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:18.171 04:57:57 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:18.171 04:57:57 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:18.171 04:57:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:18.171 04:57:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:18.171 04:57:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:18.171 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:18.172 04:57:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:18.172 04:57:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:18.172 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:18.172 04:57:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:18.172 04:57:57 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:18.172 04:57:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.172 04:57:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:18.172 04:57:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.172 04:57:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:18.172 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:18.172 04:57:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.172 04:57:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:18.172 04:57:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.172 04:57:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:18.172 04:57:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.172 04:57:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:18.172 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:18.172 04:57:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.172 04:57:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:18.172 04:57:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:18.172 04:57:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:18.172 04:57:57 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:18.172 04:57:57 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:18.172 04:57:57 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:18.172 04:57:57 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:18.172 04:57:57 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:18.172 04:57:57 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:18.172 04:57:57 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:18.172 04:57:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:18.172 04:57:57 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:18.172 04:57:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:18.172 04:57:57 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:18.172 04:57:57 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:18.172 04:57:57 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:18.172 04:57:57 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:18.172 04:57:57 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:18.172 04:57:57 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:18.172 04:57:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:18.172 04:57:57 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:18.172 04:57:57 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:18.172 04:57:57 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:18.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:18.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:13:18.172 00:13:18.172 --- 10.0.0.2 ping statistics --- 00:13:18.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:18.172 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:13:18.172 04:57:57 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:18.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:18.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:13:18.172 00:13:18.172 --- 10.0.0.1 ping statistics --- 00:13:18.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:18.172 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:13:18.172 04:57:57 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:18.172 04:57:57 -- nvmf/common.sh@411 -- # return 0 00:13:18.172 04:57:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:18.172 04:57:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:18.172 04:57:57 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:18.172 04:57:57 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:18.172 04:57:57 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:18.172 04:57:57 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:18.172 04:57:57 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:13:18.172 04:57:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:18.172 04:57:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:18.172 04:57:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.172 04:57:57 -- nvmf/common.sh@470 -- # nvmfpid=2343646 00:13:18.172 04:57:57 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:18.172 04:57:57 -- nvmf/common.sh@471 -- # waitforlisten 2343646 00:13:18.172 04:57:57 -- common/autotest_common.sh@817 -- # '[' -z 2343646 ']' 00:13:18.172 04:57:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:18.172 04:57:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:18.172 04:57:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:18.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:18.172 04:57:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:18.172 04:57:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.431 [2024-04-23 04:57:57.357434] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:13:18.431 [2024-04-23 04:57:57.357525] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:18.431 EAL: No free 2048 kB hugepages reported on node 1 00:13:18.431 [2024-04-23 04:57:57.395861] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:13:18.431 [2024-04-23 04:57:57.428470] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:18.431 [2024-04-23 04:57:57.519659] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:18.431 [2024-04-23 04:57:57.519725] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:18.431 [2024-04-23 04:57:57.519753] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:18.431 [2024-04-23 04:57:57.519767] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:18.431 [2024-04-23 04:57:57.519779] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:18.431 [2024-04-23 04:57:57.519877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:18.431 [2024-04-23 04:57:57.519942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:18.431 [2024-04-23 04:57:57.519945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:18.689 04:57:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:18.689 04:57:57 -- common/autotest_common.sh@850 -- # return 0 00:13:18.689 04:57:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:18.689 04:57:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:18.689 04:57:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.689 04:57:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:18.689 04:57:57 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:13:18.689 04:57:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:18.947 [2024-04-23 04:57:57.877208] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:18.947 04:57:57 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:19.207 04:57:58 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:19.466 [2024-04-23 04:57:58.448271] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:19.466 04:57:58 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:19.724 04:57:58 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:19.983 Malloc0 00:13:19.983 04:57:58 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:20.241 Delay0 00:13:20.241 04:57:59 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.499 04:57:59 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:20.757 NULL1 00:13:20.757 04:57:59 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:21.017 04:57:59 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=2343944 00:13:21.017 04:57:59 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:21.017 04:57:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:21.017 04:57:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.017 EAL: No free 2048 kB hugepages reported on node 1 00:13:22.397 Read completed with error (sct=0, sc=11) 00:13:22.397 04:58:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:22.397 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.397 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.397 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.397 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.397 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.397 04:58:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:13:22.397 04:58:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:22.655 true 00:13:22.655 04:58:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:22.655 04:58:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.594 04:58:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.594 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.594 04:58:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:13:23.594 04:58:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:23.852 true 00:13:23.852 04:58:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:23.852 04:58:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.109 04:58:03 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.367 04:58:03 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:13:24.367 04:58:03 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:24.625 true 00:13:24.625 04:58:03 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:24.625 04:58:03 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.561 04:58:04 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:25.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:25.561 04:58:04 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:13:25.561 04:58:04 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:25.819 true 00:13:25.819 04:58:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:25.819 04:58:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.077 04:58:05 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.336 04:58:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:13:26.336 04:58:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:26.594 true 00:13:26.594 04:58:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:26.594 04:58:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.532 04:58:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:27.790 04:58:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:13:27.790 04:58:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:28.047 true 00:13:28.047 04:58:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:28.047 04:58:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:28.304 04:58:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:28.562 04:58:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:13:28.562 04:58:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:28.820 true 00:13:28.820 04:58:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:28.820 04:58:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.757 04:58:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:29.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.015 04:58:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:13:30.015 04:58:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:30.311 true 00:13:30.311 04:58:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:30.311 04:58:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.569 04:58:09 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:30.569 04:58:09 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:13:30.569 04:58:09 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:30.827 true 00:13:30.827 04:58:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:30.827 04:58:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.763 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:31.763 04:58:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.020 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.020 04:58:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:13:32.020 04:58:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:32.277 true 00:13:32.277 04:58:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:32.277 04:58:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.534 04:58:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.791 04:58:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:13:32.791 04:58:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:33.049 true 00:13:33.049 04:58:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:33.049 04:58:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.984 04:58:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.242 04:58:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:13:34.242 04:58:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:34.499 true 00:13:34.499 04:58:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:34.499 04:58:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.769 04:58:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.028 04:58:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:13:35.028 04:58:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:35.285 true 00:13:35.285 04:58:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:35.285 04:58:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.543 04:58:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.801 04:58:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:13:35.801 04:58:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:36.058 true 00:13:36.058 04:58:15 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:36.059 04:58:15 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.996 04:58:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.255 04:58:16 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:13:37.255 04:58:16 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:37.513 true 00:13:37.513 04:58:16 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:37.513 04:58:16 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.770 04:58:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.029 04:58:17 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:13:38.029 04:58:17 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:38.287 true 00:13:38.287 04:58:17 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:38.287 04:58:17 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.223 04:58:18 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.223 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:39.223 04:58:18 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:13:39.223 04:58:18 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:39.481 true 00:13:39.481 04:58:18 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:39.481 04:58:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.739 04:58:18 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.998 04:58:19 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:13:39.998 04:58:19 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:40.256 true 00:13:40.256 04:58:19 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:40.256 04:58:19 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.195 04:58:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:41.453 04:58:20 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:13:41.453 04:58:20 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:41.711 true 00:13:41.711 04:58:20 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:41.711 04:58:20 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.970 04:58:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.227 04:58:21 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:13:42.227 04:58:21 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:42.485 true 00:13:42.485 04:58:21 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:42.485 04:58:21 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.422 04:58:22 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.422 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.422 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.422 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.422 04:58:22 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:13:43.422 04:58:22 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:43.680 true 00:13:43.680 04:58:22 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:43.680 04:58:22 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.938 04:58:23 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.196 04:58:23 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:13:44.196 04:58:23 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:44.454 true 00:13:44.454 04:58:23 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:44.454 04:58:23 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.452 04:58:24 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.710 04:58:24 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:13:45.710 04:58:24 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:45.968 true 00:13:45.968 04:58:24 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:45.968 04:58:24 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:46.227 04:58:25 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.485 04:58:25 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:13:46.485 04:58:25 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:46.743 true 00:13:46.743 04:58:25 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:46.743 04:58:25 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.679 04:58:26 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.679 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:47.679 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:47.937 04:58:26 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:13:47.937 04:58:26 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:48.196 true 00:13:48.196 04:58:27 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:48.196 04:58:27 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.454 04:58:27 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.713 04:58:27 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:13:48.713 04:58:27 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:48.713 true 00:13:48.713 04:58:27 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:48.713 04:58:27 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:49.650 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:49.650 04:58:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.650 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:49.907 04:58:28 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:13:49.907 04:58:28 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:50.164 true 00:13:50.164 04:58:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:50.164 04:58:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.422 04:58:29 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.680 04:58:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:13:50.680 04:58:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:50.938 true 00:13:50.938 04:58:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:50.938 04:58:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:51.874 Initializing NVMe Controllers 00:13:51.874 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:51.874 Controller IO queue size 128, less than required. 00:13:51.874 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:51.874 Controller IO queue size 128, less than required. 00:13:51.874 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:51.874 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:51.874 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:51.874 Initialization complete. Launching workers. 00:13:51.874 ======================================================== 00:13:51.874 Latency(us) 00:13:51.874 Device Information : IOPS MiB/s Average min max 00:13:51.874 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 702.13 0.34 101160.89 2549.89 1012915.05 00:13:51.874 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10847.75 5.30 11799.17 1801.45 481161.33 00:13:51.874 ======================================================== 00:13:51.874 Total : 11549.88 5.64 17231.56 1801.45 1012915.05 00:13:51.874 00:13:51.874 04:58:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:52.133 04:58:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:13:52.133 04:58:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:52.391 true 00:13:52.391 04:58:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2343944 00:13:52.391 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (2343944) - No such process 00:13:52.391 04:58:31 -- target/ns_hotplug_stress.sh@44 -- # wait 2343944 00:13:52.391 04:58:31 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:13:52.391 04:58:31 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:13:52.391 04:58:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:52.391 04:58:31 -- nvmf/common.sh@117 -- # sync 00:13:52.391 04:58:31 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:52.391 04:58:31 -- nvmf/common.sh@120 -- # set +e 00:13:52.391 04:58:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:52.391 04:58:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:52.391 rmmod nvme_tcp 00:13:52.391 rmmod nvme_fabrics 00:13:52.391 rmmod nvme_keyring 00:13:52.391 04:58:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:52.391 04:58:31 -- nvmf/common.sh@124 -- # set -e 00:13:52.391 04:58:31 -- nvmf/common.sh@125 -- # return 0 00:13:52.391 04:58:31 -- nvmf/common.sh@478 -- # '[' -n 2343646 ']' 00:13:52.391 04:58:31 -- nvmf/common.sh@479 -- # killprocess 2343646 00:13:52.391 04:58:31 -- common/autotest_common.sh@936 -- # '[' -z 2343646 ']' 00:13:52.391 04:58:31 -- common/autotest_common.sh@940 -- # kill -0 2343646 00:13:52.391 04:58:31 -- common/autotest_common.sh@941 -- # uname 00:13:52.391 04:58:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:52.391 04:58:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2343646 00:13:52.649 04:58:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:52.649 04:58:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:52.649 04:58:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2343646' 00:13:52.649 killing process with pid 2343646 00:13:52.649 04:58:31 -- common/autotest_common.sh@955 -- # kill 2343646 00:13:52.649 04:58:31 -- common/autotest_common.sh@960 -- # wait 2343646 00:13:52.909 04:58:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:52.909 04:58:31 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:52.909 04:58:31 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:52.910 04:58:31 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:52.910 04:58:31 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:52.910 04:58:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.910 04:58:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.910 04:58:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:54.820 04:58:33 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:54.820 00:13:54.820 real 0m38.667s 00:13:54.820 user 2m27.142s 00:13:54.820 sys 0m11.117s 00:13:54.820 04:58:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:54.820 04:58:33 -- common/autotest_common.sh@10 -- # set +x 00:13:54.820 ************************************ 00:13:54.820 END TEST nvmf_ns_hotplug_stress 00:13:54.820 ************************************ 00:13:54.820 04:58:33 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:54.820 04:58:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:54.820 04:58:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:54.820 04:58:33 -- common/autotest_common.sh@10 -- # set +x 00:13:54.820 ************************************ 00:13:54.820 START TEST nvmf_connect_stress 00:13:54.820 ************************************ 00:13:54.820 04:58:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:55.077 * Looking for test storage... 00:13:55.077 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:55.077 04:58:34 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:55.077 04:58:34 -- nvmf/common.sh@7 -- # uname -s 00:13:55.077 04:58:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:55.077 04:58:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:55.077 04:58:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:55.077 04:58:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:55.077 04:58:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:55.077 04:58:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:55.077 04:58:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:55.077 04:58:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:55.077 04:58:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:55.077 04:58:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:55.077 04:58:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.077 04:58:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.077 04:58:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:55.077 04:58:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:55.077 04:58:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:55.077 04:58:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:55.077 04:58:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:55.077 04:58:34 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:55.077 04:58:34 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:55.077 04:58:34 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:55.077 04:58:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.077 04:58:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.077 04:58:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.077 04:58:34 -- paths/export.sh@5 -- # export PATH 00:13:55.077 04:58:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.077 04:58:34 -- nvmf/common.sh@47 -- # : 0 00:13:55.077 04:58:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:55.077 04:58:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:55.077 04:58:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:55.078 04:58:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:55.078 04:58:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:55.078 04:58:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:55.078 04:58:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:55.078 04:58:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:55.078 04:58:34 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:55.078 04:58:34 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:13:55.078 04:58:34 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:55.078 04:58:34 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:55.078 04:58:34 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:55.078 04:58:34 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:55.078 04:58:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:55.078 04:58:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:55.078 04:58:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.078 04:58:34 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:55.078 04:58:34 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:55.078 04:58:34 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:55.078 04:58:34 -- common/autotest_common.sh@10 -- # set +x 00:13:56.986 04:58:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:56.986 04:58:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:56.986 04:58:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:56.986 04:58:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:56.986 04:58:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:56.986 04:58:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:56.986 04:58:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:56.986 04:58:35 -- nvmf/common.sh@295 -- # net_devs=() 00:13:56.986 04:58:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:56.986 04:58:35 -- nvmf/common.sh@296 -- # e810=() 00:13:56.986 04:58:35 -- nvmf/common.sh@296 -- # local -ga e810 00:13:56.986 04:58:35 -- nvmf/common.sh@297 -- # x722=() 00:13:56.986 04:58:35 -- nvmf/common.sh@297 -- # local -ga x722 00:13:56.986 04:58:35 -- nvmf/common.sh@298 -- # mlx=() 00:13:56.986 04:58:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:56.986 04:58:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:56.986 04:58:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:56.986 04:58:35 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:56.986 04:58:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:56.986 04:58:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:56.986 04:58:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:56.986 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:56.986 04:58:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:56.986 04:58:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:56.986 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:56.986 04:58:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:56.986 04:58:35 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:56.986 04:58:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:56.986 04:58:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.986 04:58:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:56.986 04:58:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.987 04:58:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:56.987 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:56.987 04:58:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.987 04:58:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:56.987 04:58:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.987 04:58:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:56.987 04:58:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.987 04:58:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:56.987 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:56.987 04:58:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.987 04:58:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:56.987 04:58:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:56.987 04:58:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:56.987 04:58:35 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:56.987 04:58:35 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:56.987 04:58:35 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:56.987 04:58:35 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:56.987 04:58:35 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:56.987 04:58:35 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:56.987 04:58:35 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:56.987 04:58:35 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:56.987 04:58:35 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:56.987 04:58:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:56.987 04:58:35 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:56.987 04:58:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:56.987 04:58:35 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:56.987 04:58:35 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:56.987 04:58:35 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:56.987 04:58:35 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:56.987 04:58:35 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:56.987 04:58:35 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:56.987 04:58:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:56.987 04:58:35 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:56.987 04:58:35 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:56.987 04:58:35 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:56.987 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:56.987 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:13:56.987 00:13:56.987 --- 10.0.0.2 ping statistics --- 00:13:56.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.987 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:13:56.987 04:58:36 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:56.987 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:56.987 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:13:56.987 00:13:56.987 --- 10.0.0.1 ping statistics --- 00:13:56.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.987 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:13:56.987 04:58:36 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:56.987 04:58:36 -- nvmf/common.sh@411 -- # return 0 00:13:56.987 04:58:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:56.987 04:58:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:56.987 04:58:36 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:56.987 04:58:36 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:56.987 04:58:36 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:56.987 04:58:36 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:56.987 04:58:36 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:56.987 04:58:36 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:56.987 04:58:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:56.987 04:58:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:56.987 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:56.987 04:58:36 -- nvmf/common.sh@470 -- # nvmfpid=2349662 00:13:56.987 04:58:36 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:56.987 04:58:36 -- nvmf/common.sh@471 -- # waitforlisten 2349662 00:13:56.987 04:58:36 -- common/autotest_common.sh@817 -- # '[' -z 2349662 ']' 00:13:56.987 04:58:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:56.987 04:58:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:56.987 04:58:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:56.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:56.987 04:58:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:56.987 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:56.987 [2024-04-23 04:58:36.076150] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:13:56.987 [2024-04-23 04:58:36.076241] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:56.987 EAL: No free 2048 kB hugepages reported on node 1 00:13:56.987 [2024-04-23 04:58:36.115235] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:13:56.987 [2024-04-23 04:58:36.142041] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:57.247 [2024-04-23 04:58:36.229889] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:57.247 [2024-04-23 04:58:36.229951] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:57.247 [2024-04-23 04:58:36.229965] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:57.247 [2024-04-23 04:58:36.229977] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:57.247 [2024-04-23 04:58:36.229987] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:57.247 [2024-04-23 04:58:36.230084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:57.247 [2024-04-23 04:58:36.230147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:57.247 [2024-04-23 04:58:36.230150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:57.247 04:58:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:57.247 04:58:36 -- common/autotest_common.sh@850 -- # return 0 00:13:57.247 04:58:36 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:57.247 04:58:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:57.247 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:57.247 04:58:36 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:57.247 04:58:36 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:57.247 04:58:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.247 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:57.247 [2024-04-23 04:58:36.374645] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:57.247 04:58:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.247 04:58:36 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:57.247 04:58:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.247 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:57.247 04:58:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.247 04:58:36 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:57.247 04:58:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.247 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:57.247 [2024-04-23 04:58:36.401657] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:57.247 04:58:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.247 04:58:36 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:57.247 04:58:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.247 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:57.506 NULL1 00:13:57.506 04:58:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.506 04:58:36 -- target/connect_stress.sh@21 -- # PERF_PID=2349723 00:13:57.506 04:58:36 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:57.506 04:58:36 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:57.506 04:58:36 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:57.506 04:58:36 -- target/connect_stress.sh@28 -- # cat 00:13:57.506 04:58:36 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:57.506 04:58:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:57.506 04:58:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.506 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:57.767 04:58:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.767 04:58:36 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:57.767 04:58:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:57.767 04:58:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.767 04:58:36 -- common/autotest_common.sh@10 -- # set +x 00:13:58.025 04:58:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:58.025 04:58:37 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:58.025 04:58:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:58.025 04:58:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:58.025 04:58:37 -- common/autotest_common.sh@10 -- # set +x 00:13:58.284 04:58:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:58.284 04:58:37 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:58.284 04:58:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:58.284 04:58:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:58.284 04:58:37 -- common/autotest_common.sh@10 -- # set +x 00:13:58.861 04:58:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:58.861 04:58:37 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:58.861 04:58:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:58.861 04:58:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:58.861 04:58:37 -- common/autotest_common.sh@10 -- # set +x 00:13:59.120 04:58:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:59.120 04:58:38 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:59.120 04:58:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:59.120 04:58:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:59.120 04:58:38 -- common/autotest_common.sh@10 -- # set +x 00:13:59.378 04:58:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:59.378 04:58:38 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:59.378 04:58:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:59.378 04:58:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:59.378 04:58:38 -- common/autotest_common.sh@10 -- # set +x 00:13:59.637 04:58:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:59.637 04:58:38 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:59.637 04:58:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:59.637 04:58:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:59.637 04:58:38 -- common/autotest_common.sh@10 -- # set +x 00:13:59.896 04:58:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:59.896 04:58:39 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:13:59.896 04:58:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:59.896 04:58:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:59.896 04:58:39 -- common/autotest_common.sh@10 -- # set +x 00:14:00.466 04:58:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.466 04:58:39 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:00.466 04:58:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:00.466 04:58:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.466 04:58:39 -- common/autotest_common.sh@10 -- # set +x 00:14:00.755 04:58:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.755 04:58:39 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:00.755 04:58:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:00.755 04:58:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.755 04:58:39 -- common/autotest_common.sh@10 -- # set +x 00:14:01.013 04:58:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:01.013 04:58:39 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:01.013 04:58:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:01.013 04:58:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:01.013 04:58:39 -- common/autotest_common.sh@10 -- # set +x 00:14:01.272 04:58:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:01.272 04:58:40 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:01.272 04:58:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:01.272 04:58:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:01.272 04:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:01.531 04:58:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:01.531 04:58:40 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:01.531 04:58:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:01.531 04:58:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:01.531 04:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:02.098 04:58:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:02.098 04:58:40 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:02.098 04:58:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.098 04:58:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:02.098 04:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:02.356 04:58:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:02.356 04:58:41 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:02.356 04:58:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.356 04:58:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:02.356 04:58:41 -- common/autotest_common.sh@10 -- # set +x 00:14:02.616 04:58:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:02.616 04:58:41 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:02.616 04:58:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.616 04:58:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:02.616 04:58:41 -- common/autotest_common.sh@10 -- # set +x 00:14:02.875 04:58:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:02.875 04:58:41 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:02.875 04:58:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.875 04:58:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:02.875 04:58:41 -- common/autotest_common.sh@10 -- # set +x 00:14:03.133 04:58:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:03.133 04:58:42 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:03.133 04:58:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:03.133 04:58:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:03.134 04:58:42 -- common/autotest_common.sh@10 -- # set +x 00:14:03.702 04:58:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:03.702 04:58:42 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:03.702 04:58:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:03.702 04:58:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:03.702 04:58:42 -- common/autotest_common.sh@10 -- # set +x 00:14:03.960 04:58:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:03.960 04:58:42 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:03.960 04:58:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:03.960 04:58:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:03.960 04:58:42 -- common/autotest_common.sh@10 -- # set +x 00:14:04.223 04:58:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.223 04:58:43 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:04.223 04:58:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.223 04:58:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.223 04:58:43 -- common/autotest_common.sh@10 -- # set +x 00:14:04.486 04:58:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.486 04:58:43 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:04.486 04:58:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.486 04:58:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.486 04:58:43 -- common/autotest_common.sh@10 -- # set +x 00:14:04.746 04:58:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.746 04:58:43 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:04.746 04:58:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.746 04:58:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.746 04:58:43 -- common/autotest_common.sh@10 -- # set +x 00:14:05.311 04:58:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:05.311 04:58:44 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:05.311 04:58:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:05.311 04:58:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:05.311 04:58:44 -- common/autotest_common.sh@10 -- # set +x 00:14:05.569 04:58:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:05.570 04:58:44 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:05.570 04:58:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:05.570 04:58:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:05.570 04:58:44 -- common/autotest_common.sh@10 -- # set +x 00:14:05.830 04:58:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:05.830 04:58:44 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:05.830 04:58:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:05.830 04:58:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:05.830 04:58:44 -- common/autotest_common.sh@10 -- # set +x 00:14:06.090 04:58:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:06.090 04:58:45 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:06.090 04:58:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:06.090 04:58:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:06.090 04:58:45 -- common/autotest_common.sh@10 -- # set +x 00:14:06.349 04:58:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:06.349 04:58:45 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:06.349 04:58:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:06.349 04:58:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:06.349 04:58:45 -- common/autotest_common.sh@10 -- # set +x 00:14:06.916 04:58:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:06.916 04:58:45 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:06.916 04:58:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:06.916 04:58:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:06.916 04:58:45 -- common/autotest_common.sh@10 -- # set +x 00:14:07.176 04:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.176 04:58:46 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:07.176 04:58:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:07.176 04:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:07.176 04:58:46 -- common/autotest_common.sh@10 -- # set +x 00:14:07.436 04:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.436 04:58:46 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:07.436 04:58:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:07.436 04:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:07.436 04:58:46 -- common/autotest_common.sh@10 -- # set +x 00:14:07.436 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:07.695 04:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.695 04:58:46 -- target/connect_stress.sh@34 -- # kill -0 2349723 00:14:07.695 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2349723) - No such process 00:14:07.695 04:58:46 -- target/connect_stress.sh@38 -- # wait 2349723 00:14:07.695 04:58:46 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:07.695 04:58:46 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:07.695 04:58:46 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:07.695 04:58:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:07.695 04:58:46 -- nvmf/common.sh@117 -- # sync 00:14:07.695 04:58:46 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:07.695 04:58:46 -- nvmf/common.sh@120 -- # set +e 00:14:07.695 04:58:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:07.695 04:58:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:07.695 rmmod nvme_tcp 00:14:07.695 rmmod nvme_fabrics 00:14:07.695 rmmod nvme_keyring 00:14:07.695 04:58:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:07.695 04:58:46 -- nvmf/common.sh@124 -- # set -e 00:14:07.695 04:58:46 -- nvmf/common.sh@125 -- # return 0 00:14:07.695 04:58:46 -- nvmf/common.sh@478 -- # '[' -n 2349662 ']' 00:14:07.695 04:58:46 -- nvmf/common.sh@479 -- # killprocess 2349662 00:14:07.695 04:58:46 -- common/autotest_common.sh@936 -- # '[' -z 2349662 ']' 00:14:07.695 04:58:46 -- common/autotest_common.sh@940 -- # kill -0 2349662 00:14:07.695 04:58:46 -- common/autotest_common.sh@941 -- # uname 00:14:07.695 04:58:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:07.695 04:58:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2349662 00:14:07.695 04:58:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:07.695 04:58:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:07.695 04:58:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2349662' 00:14:07.695 killing process with pid 2349662 00:14:07.695 04:58:46 -- common/autotest_common.sh@955 -- # kill 2349662 00:14:07.695 04:58:46 -- common/autotest_common.sh@960 -- # wait 2349662 00:14:07.954 04:58:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:07.954 04:58:47 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:07.954 04:58:47 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:07.954 04:58:47 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:07.954 04:58:47 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:07.954 04:58:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:07.954 04:58:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:07.954 04:58:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.492 04:58:49 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:10.492 00:14:10.492 real 0m15.108s 00:14:10.492 user 0m38.238s 00:14:10.492 sys 0m5.748s 00:14:10.492 04:58:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:10.492 04:58:49 -- common/autotest_common.sh@10 -- # set +x 00:14:10.492 ************************************ 00:14:10.492 END TEST nvmf_connect_stress 00:14:10.492 ************************************ 00:14:10.492 04:58:49 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:10.492 04:58:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:10.492 04:58:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:10.492 04:58:49 -- common/autotest_common.sh@10 -- # set +x 00:14:10.492 ************************************ 00:14:10.492 START TEST nvmf_fused_ordering 00:14:10.492 ************************************ 00:14:10.492 04:58:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:10.492 * Looking for test storage... 00:14:10.492 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:10.492 04:58:49 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:10.492 04:58:49 -- nvmf/common.sh@7 -- # uname -s 00:14:10.492 04:58:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:10.492 04:58:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:10.492 04:58:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:10.492 04:58:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:10.492 04:58:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:10.492 04:58:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:10.492 04:58:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:10.492 04:58:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:10.492 04:58:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:10.492 04:58:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:10.492 04:58:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.492 04:58:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.492 04:58:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:10.492 04:58:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:10.492 04:58:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:10.492 04:58:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:10.492 04:58:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:10.492 04:58:49 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:10.492 04:58:49 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:10.492 04:58:49 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:10.492 04:58:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.492 04:58:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.492 04:58:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.492 04:58:49 -- paths/export.sh@5 -- # export PATH 00:14:10.492 04:58:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.492 04:58:49 -- nvmf/common.sh@47 -- # : 0 00:14:10.492 04:58:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:10.492 04:58:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:10.492 04:58:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:10.492 04:58:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:10.492 04:58:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:10.493 04:58:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:10.493 04:58:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:10.493 04:58:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:10.493 04:58:49 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:10.493 04:58:49 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:14:10.493 04:58:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:10.493 04:58:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:10.493 04:58:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:10.493 04:58:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:10.493 04:58:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.493 04:58:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.493 04:58:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.493 04:58:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:10.493 04:58:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:10.493 04:58:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:10.493 04:58:49 -- common/autotest_common.sh@10 -- # set +x 00:14:12.399 04:58:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:12.399 04:58:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:12.399 04:58:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:12.399 04:58:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:12.399 04:58:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:12.399 04:58:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:12.399 04:58:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:12.399 04:58:51 -- nvmf/common.sh@295 -- # net_devs=() 00:14:12.399 04:58:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:12.399 04:58:51 -- nvmf/common.sh@296 -- # e810=() 00:14:12.399 04:58:51 -- nvmf/common.sh@296 -- # local -ga e810 00:14:12.399 04:58:51 -- nvmf/common.sh@297 -- # x722=() 00:14:12.399 04:58:51 -- nvmf/common.sh@297 -- # local -ga x722 00:14:12.399 04:58:51 -- nvmf/common.sh@298 -- # mlx=() 00:14:12.399 04:58:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:12.399 04:58:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:12.399 04:58:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:12.399 04:58:51 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:14:12.399 04:58:51 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:12.399 04:58:51 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:12.399 04:58:51 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:12.399 04:58:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:12.399 04:58:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:12.400 04:58:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:12.400 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:12.400 04:58:51 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:12.400 04:58:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:12.400 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:12.400 04:58:51 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:12.400 04:58:51 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:12.400 04:58:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.400 04:58:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:12.400 04:58:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.400 04:58:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:12.400 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:12.400 04:58:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.400 04:58:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:12.400 04:58:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.400 04:58:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:12.400 04:58:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.400 04:58:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:12.400 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:12.400 04:58:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.400 04:58:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:12.400 04:58:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:12.400 04:58:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:14:12.400 04:58:51 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:12.400 04:58:51 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:12.400 04:58:51 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:12.400 04:58:51 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:14:12.400 04:58:51 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:12.400 04:58:51 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:12.400 04:58:51 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:14:12.400 04:58:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:12.400 04:58:51 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:12.400 04:58:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:14:12.400 04:58:51 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:14:12.400 04:58:51 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:14:12.400 04:58:51 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:12.400 04:58:51 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:12.400 04:58:51 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:12.400 04:58:51 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:14:12.400 04:58:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:12.400 04:58:51 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:12.400 04:58:51 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:12.400 04:58:51 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:14:12.400 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:12.400 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:14:12.400 00:14:12.400 --- 10.0.0.2 ping statistics --- 00:14:12.400 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.400 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:14:12.400 04:58:51 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:12.400 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:12.400 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.063 ms 00:14:12.400 00:14:12.400 --- 10.0.0.1 ping statistics --- 00:14:12.400 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.400 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:14:12.400 04:58:51 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:12.400 04:58:51 -- nvmf/common.sh@411 -- # return 0 00:14:12.400 04:58:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:12.400 04:58:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:12.400 04:58:51 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:14:12.400 04:58:51 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:12.400 04:58:51 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:14:12.400 04:58:51 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:14:12.400 04:58:51 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:12.400 04:58:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:12.400 04:58:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:12.400 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.400 04:58:51 -- nvmf/common.sh@470 -- # nvmfpid=2352952 00:14:12.400 04:58:51 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:12.400 04:58:51 -- nvmf/common.sh@471 -- # waitforlisten 2352952 00:14:12.400 04:58:51 -- common/autotest_common.sh@817 -- # '[' -z 2352952 ']' 00:14:12.400 04:58:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:12.400 04:58:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:12.400 04:58:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:12.400 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:12.400 04:58:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:12.400 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.400 [2024-04-23 04:58:51.412316] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:14:12.400 [2024-04-23 04:58:51.412414] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:12.400 EAL: No free 2048 kB hugepages reported on node 1 00:14:12.400 [2024-04-23 04:58:51.453373] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:14:12.400 [2024-04-23 04:58:51.479641] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:12.400 [2024-04-23 04:58:51.562479] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:12.400 [2024-04-23 04:58:51.562563] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:12.400 [2024-04-23 04:58:51.562577] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:12.400 [2024-04-23 04:58:51.562588] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:12.400 [2024-04-23 04:58:51.562598] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:12.400 [2024-04-23 04:58:51.562625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:12.658 04:58:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:12.658 04:58:51 -- common/autotest_common.sh@850 -- # return 0 00:14:12.659 04:58:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:12.659 04:58:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:12.659 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.659 04:58:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:12.659 04:58:51 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:12.659 04:58:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:12.659 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.659 [2024-04-23 04:58:51.694821] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:12.659 04:58:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:12.659 04:58:51 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:12.659 04:58:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:12.659 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.659 04:58:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:12.659 04:58:51 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:12.659 04:58:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:12.659 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.659 [2024-04-23 04:58:51.711031] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:12.659 04:58:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:12.659 04:58:51 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:12.659 04:58:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:12.659 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.659 NULL1 00:14:12.659 04:58:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:12.659 04:58:51 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:12.659 04:58:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:12.659 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.659 04:58:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:12.659 04:58:51 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:12.659 04:58:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:12.659 04:58:51 -- common/autotest_common.sh@10 -- # set +x 00:14:12.659 04:58:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:12.659 04:58:51 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:12.659 [2024-04-23 04:58:51.755234] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:14:12.659 [2024-04-23 04:58:51.755277] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2352978 ] 00:14:12.659 EAL: No free 2048 kB hugepages reported on node 1 00:14:12.659 [2024-04-23 04:58:51.788081] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:14:13.227 Attached to nqn.2016-06.io.spdk:cnode1 00:14:13.227 Namespace ID: 1 size: 1GB 00:14:13.227 fused_ordering(0) 00:14:13.227 fused_ordering(1) 00:14:13.227 fused_ordering(2) 00:14:13.227 fused_ordering(3) 00:14:13.227 fused_ordering(4) 00:14:13.227 fused_ordering(5) 00:14:13.227 fused_ordering(6) 00:14:13.227 fused_ordering(7) 00:14:13.227 fused_ordering(8) 00:14:13.227 fused_ordering(9) 00:14:13.227 fused_ordering(10) 00:14:13.227 fused_ordering(11) 00:14:13.227 fused_ordering(12) 00:14:13.227 fused_ordering(13) 00:14:13.227 fused_ordering(14) 00:14:13.227 fused_ordering(15) 00:14:13.227 fused_ordering(16) 00:14:13.227 fused_ordering(17) 00:14:13.227 fused_ordering(18) 00:14:13.227 fused_ordering(19) 00:14:13.227 fused_ordering(20) 00:14:13.227 fused_ordering(21) 00:14:13.227 fused_ordering(22) 00:14:13.227 fused_ordering(23) 00:14:13.227 fused_ordering(24) 00:14:13.227 fused_ordering(25) 00:14:13.227 fused_ordering(26) 00:14:13.227 fused_ordering(27) 00:14:13.227 fused_ordering(28) 00:14:13.227 fused_ordering(29) 00:14:13.227 fused_ordering(30) 00:14:13.227 fused_ordering(31) 00:14:13.227 fused_ordering(32) 00:14:13.227 fused_ordering(33) 00:14:13.227 fused_ordering(34) 00:14:13.227 fused_ordering(35) 00:14:13.227 fused_ordering(36) 00:14:13.227 fused_ordering(37) 00:14:13.227 fused_ordering(38) 00:14:13.227 fused_ordering(39) 00:14:13.227 fused_ordering(40) 00:14:13.227 fused_ordering(41) 00:14:13.227 fused_ordering(42) 00:14:13.227 fused_ordering(43) 00:14:13.227 fused_ordering(44) 00:14:13.227 fused_ordering(45) 00:14:13.227 fused_ordering(46) 00:14:13.227 fused_ordering(47) 00:14:13.227 fused_ordering(48) 00:14:13.227 fused_ordering(49) 00:14:13.227 fused_ordering(50) 00:14:13.227 fused_ordering(51) 00:14:13.227 fused_ordering(52) 00:14:13.227 fused_ordering(53) 00:14:13.227 fused_ordering(54) 00:14:13.227 fused_ordering(55) 00:14:13.227 fused_ordering(56) 00:14:13.227 fused_ordering(57) 00:14:13.227 fused_ordering(58) 00:14:13.227 fused_ordering(59) 00:14:13.227 fused_ordering(60) 00:14:13.227 fused_ordering(61) 00:14:13.227 fused_ordering(62) 00:14:13.227 fused_ordering(63) 00:14:13.227 fused_ordering(64) 00:14:13.227 fused_ordering(65) 00:14:13.227 fused_ordering(66) 00:14:13.227 fused_ordering(67) 00:14:13.227 fused_ordering(68) 00:14:13.227 fused_ordering(69) 00:14:13.227 fused_ordering(70) 00:14:13.227 fused_ordering(71) 00:14:13.227 fused_ordering(72) 00:14:13.227 fused_ordering(73) 00:14:13.227 fused_ordering(74) 00:14:13.227 fused_ordering(75) 00:14:13.227 fused_ordering(76) 00:14:13.227 fused_ordering(77) 00:14:13.227 fused_ordering(78) 00:14:13.227 fused_ordering(79) 00:14:13.227 fused_ordering(80) 00:14:13.227 fused_ordering(81) 00:14:13.227 fused_ordering(82) 00:14:13.227 fused_ordering(83) 00:14:13.227 fused_ordering(84) 00:14:13.227 fused_ordering(85) 00:14:13.227 fused_ordering(86) 00:14:13.227 fused_ordering(87) 00:14:13.227 fused_ordering(88) 00:14:13.227 fused_ordering(89) 00:14:13.227 fused_ordering(90) 00:14:13.227 fused_ordering(91) 00:14:13.227 fused_ordering(92) 00:14:13.227 fused_ordering(93) 00:14:13.227 fused_ordering(94) 00:14:13.227 fused_ordering(95) 00:14:13.227 fused_ordering(96) 00:14:13.227 fused_ordering(97) 00:14:13.227 fused_ordering(98) 00:14:13.227 fused_ordering(99) 00:14:13.227 fused_ordering(100) 00:14:13.227 fused_ordering(101) 00:14:13.227 fused_ordering(102) 00:14:13.227 fused_ordering(103) 00:14:13.227 fused_ordering(104) 00:14:13.227 fused_ordering(105) 00:14:13.227 fused_ordering(106) 00:14:13.227 fused_ordering(107) 00:14:13.227 fused_ordering(108) 00:14:13.227 fused_ordering(109) 00:14:13.227 fused_ordering(110) 00:14:13.227 fused_ordering(111) 00:14:13.227 fused_ordering(112) 00:14:13.227 fused_ordering(113) 00:14:13.227 fused_ordering(114) 00:14:13.227 fused_ordering(115) 00:14:13.227 fused_ordering(116) 00:14:13.227 fused_ordering(117) 00:14:13.227 fused_ordering(118) 00:14:13.227 fused_ordering(119) 00:14:13.227 fused_ordering(120) 00:14:13.227 fused_ordering(121) 00:14:13.227 fused_ordering(122) 00:14:13.227 fused_ordering(123) 00:14:13.227 fused_ordering(124) 00:14:13.227 fused_ordering(125) 00:14:13.227 fused_ordering(126) 00:14:13.227 fused_ordering(127) 00:14:13.227 fused_ordering(128) 00:14:13.227 fused_ordering(129) 00:14:13.227 fused_ordering(130) 00:14:13.227 fused_ordering(131) 00:14:13.227 fused_ordering(132) 00:14:13.227 fused_ordering(133) 00:14:13.227 fused_ordering(134) 00:14:13.227 fused_ordering(135) 00:14:13.227 fused_ordering(136) 00:14:13.227 fused_ordering(137) 00:14:13.227 fused_ordering(138) 00:14:13.227 fused_ordering(139) 00:14:13.227 fused_ordering(140) 00:14:13.227 fused_ordering(141) 00:14:13.227 fused_ordering(142) 00:14:13.227 fused_ordering(143) 00:14:13.227 fused_ordering(144) 00:14:13.227 fused_ordering(145) 00:14:13.227 fused_ordering(146) 00:14:13.227 fused_ordering(147) 00:14:13.227 fused_ordering(148) 00:14:13.227 fused_ordering(149) 00:14:13.227 fused_ordering(150) 00:14:13.227 fused_ordering(151) 00:14:13.227 fused_ordering(152) 00:14:13.227 fused_ordering(153) 00:14:13.227 fused_ordering(154) 00:14:13.227 fused_ordering(155) 00:14:13.227 fused_ordering(156) 00:14:13.227 fused_ordering(157) 00:14:13.227 fused_ordering(158) 00:14:13.227 fused_ordering(159) 00:14:13.227 fused_ordering(160) 00:14:13.227 fused_ordering(161) 00:14:13.227 fused_ordering(162) 00:14:13.227 fused_ordering(163) 00:14:13.227 fused_ordering(164) 00:14:13.227 fused_ordering(165) 00:14:13.227 fused_ordering(166) 00:14:13.227 fused_ordering(167) 00:14:13.227 fused_ordering(168) 00:14:13.227 fused_ordering(169) 00:14:13.227 fused_ordering(170) 00:14:13.227 fused_ordering(171) 00:14:13.227 fused_ordering(172) 00:14:13.227 fused_ordering(173) 00:14:13.227 fused_ordering(174) 00:14:13.227 fused_ordering(175) 00:14:13.227 fused_ordering(176) 00:14:13.227 fused_ordering(177) 00:14:13.227 fused_ordering(178) 00:14:13.227 fused_ordering(179) 00:14:13.227 fused_ordering(180) 00:14:13.227 fused_ordering(181) 00:14:13.227 fused_ordering(182) 00:14:13.227 fused_ordering(183) 00:14:13.227 fused_ordering(184) 00:14:13.227 fused_ordering(185) 00:14:13.227 fused_ordering(186) 00:14:13.227 fused_ordering(187) 00:14:13.227 fused_ordering(188) 00:14:13.227 fused_ordering(189) 00:14:13.227 fused_ordering(190) 00:14:13.227 fused_ordering(191) 00:14:13.227 fused_ordering(192) 00:14:13.227 fused_ordering(193) 00:14:13.227 fused_ordering(194) 00:14:13.227 fused_ordering(195) 00:14:13.227 fused_ordering(196) 00:14:13.227 fused_ordering(197) 00:14:13.227 fused_ordering(198) 00:14:13.227 fused_ordering(199) 00:14:13.227 fused_ordering(200) 00:14:13.227 fused_ordering(201) 00:14:13.227 fused_ordering(202) 00:14:13.227 fused_ordering(203) 00:14:13.227 fused_ordering(204) 00:14:13.227 fused_ordering(205) 00:14:13.796 fused_ordering(206) 00:14:13.796 fused_ordering(207) 00:14:13.796 fused_ordering(208) 00:14:13.796 fused_ordering(209) 00:14:13.796 fused_ordering(210) 00:14:13.796 fused_ordering(211) 00:14:13.796 fused_ordering(212) 00:14:13.796 fused_ordering(213) 00:14:13.796 fused_ordering(214) 00:14:13.796 fused_ordering(215) 00:14:13.796 fused_ordering(216) 00:14:13.796 fused_ordering(217) 00:14:13.796 fused_ordering(218) 00:14:13.796 fused_ordering(219) 00:14:13.796 fused_ordering(220) 00:14:13.796 fused_ordering(221) 00:14:13.796 fused_ordering(222) 00:14:13.796 fused_ordering(223) 00:14:13.796 fused_ordering(224) 00:14:13.796 fused_ordering(225) 00:14:13.796 fused_ordering(226) 00:14:13.796 fused_ordering(227) 00:14:13.796 fused_ordering(228) 00:14:13.796 fused_ordering(229) 00:14:13.796 fused_ordering(230) 00:14:13.796 fused_ordering(231) 00:14:13.796 fused_ordering(232) 00:14:13.796 fused_ordering(233) 00:14:13.796 fused_ordering(234) 00:14:13.796 fused_ordering(235) 00:14:13.796 fused_ordering(236) 00:14:13.796 fused_ordering(237) 00:14:13.796 fused_ordering(238) 00:14:13.796 fused_ordering(239) 00:14:13.796 fused_ordering(240) 00:14:13.796 fused_ordering(241) 00:14:13.796 fused_ordering(242) 00:14:13.796 fused_ordering(243) 00:14:13.796 fused_ordering(244) 00:14:13.796 fused_ordering(245) 00:14:13.796 fused_ordering(246) 00:14:13.796 fused_ordering(247) 00:14:13.796 fused_ordering(248) 00:14:13.796 fused_ordering(249) 00:14:13.796 fused_ordering(250) 00:14:13.796 fused_ordering(251) 00:14:13.796 fused_ordering(252) 00:14:13.796 fused_ordering(253) 00:14:13.796 fused_ordering(254) 00:14:13.796 fused_ordering(255) 00:14:13.796 fused_ordering(256) 00:14:13.796 fused_ordering(257) 00:14:13.796 fused_ordering(258) 00:14:13.796 fused_ordering(259) 00:14:13.796 fused_ordering(260) 00:14:13.796 fused_ordering(261) 00:14:13.796 fused_ordering(262) 00:14:13.796 fused_ordering(263) 00:14:13.796 fused_ordering(264) 00:14:13.796 fused_ordering(265) 00:14:13.796 fused_ordering(266) 00:14:13.796 fused_ordering(267) 00:14:13.796 fused_ordering(268) 00:14:13.796 fused_ordering(269) 00:14:13.796 fused_ordering(270) 00:14:13.796 fused_ordering(271) 00:14:13.796 fused_ordering(272) 00:14:13.796 fused_ordering(273) 00:14:13.796 fused_ordering(274) 00:14:13.796 fused_ordering(275) 00:14:13.796 fused_ordering(276) 00:14:13.796 fused_ordering(277) 00:14:13.796 fused_ordering(278) 00:14:13.796 fused_ordering(279) 00:14:13.796 fused_ordering(280) 00:14:13.796 fused_ordering(281) 00:14:13.796 fused_ordering(282) 00:14:13.796 fused_ordering(283) 00:14:13.796 fused_ordering(284) 00:14:13.796 fused_ordering(285) 00:14:13.796 fused_ordering(286) 00:14:13.796 fused_ordering(287) 00:14:13.796 fused_ordering(288) 00:14:13.796 fused_ordering(289) 00:14:13.796 fused_ordering(290) 00:14:13.796 fused_ordering(291) 00:14:13.796 fused_ordering(292) 00:14:13.796 fused_ordering(293) 00:14:13.796 fused_ordering(294) 00:14:13.796 fused_ordering(295) 00:14:13.796 fused_ordering(296) 00:14:13.796 fused_ordering(297) 00:14:13.796 fused_ordering(298) 00:14:13.796 fused_ordering(299) 00:14:13.796 fused_ordering(300) 00:14:13.796 fused_ordering(301) 00:14:13.796 fused_ordering(302) 00:14:13.796 fused_ordering(303) 00:14:13.796 fused_ordering(304) 00:14:13.796 fused_ordering(305) 00:14:13.796 fused_ordering(306) 00:14:13.796 fused_ordering(307) 00:14:13.796 fused_ordering(308) 00:14:13.796 fused_ordering(309) 00:14:13.796 fused_ordering(310) 00:14:13.796 fused_ordering(311) 00:14:13.796 fused_ordering(312) 00:14:13.796 fused_ordering(313) 00:14:13.796 fused_ordering(314) 00:14:13.796 fused_ordering(315) 00:14:13.796 fused_ordering(316) 00:14:13.796 fused_ordering(317) 00:14:13.796 fused_ordering(318) 00:14:13.796 fused_ordering(319) 00:14:13.796 fused_ordering(320) 00:14:13.796 fused_ordering(321) 00:14:13.796 fused_ordering(322) 00:14:13.796 fused_ordering(323) 00:14:13.796 fused_ordering(324) 00:14:13.796 fused_ordering(325) 00:14:13.796 fused_ordering(326) 00:14:13.796 fused_ordering(327) 00:14:13.796 fused_ordering(328) 00:14:13.796 fused_ordering(329) 00:14:13.796 fused_ordering(330) 00:14:13.796 fused_ordering(331) 00:14:13.796 fused_ordering(332) 00:14:13.796 fused_ordering(333) 00:14:13.796 fused_ordering(334) 00:14:13.796 fused_ordering(335) 00:14:13.796 fused_ordering(336) 00:14:13.796 fused_ordering(337) 00:14:13.796 fused_ordering(338) 00:14:13.796 fused_ordering(339) 00:14:13.796 fused_ordering(340) 00:14:13.796 fused_ordering(341) 00:14:13.796 fused_ordering(342) 00:14:13.796 fused_ordering(343) 00:14:13.796 fused_ordering(344) 00:14:13.796 fused_ordering(345) 00:14:13.796 fused_ordering(346) 00:14:13.796 fused_ordering(347) 00:14:13.796 fused_ordering(348) 00:14:13.796 fused_ordering(349) 00:14:13.796 fused_ordering(350) 00:14:13.796 fused_ordering(351) 00:14:13.796 fused_ordering(352) 00:14:13.796 fused_ordering(353) 00:14:13.796 fused_ordering(354) 00:14:13.796 fused_ordering(355) 00:14:13.796 fused_ordering(356) 00:14:13.796 fused_ordering(357) 00:14:13.796 fused_ordering(358) 00:14:13.796 fused_ordering(359) 00:14:13.796 fused_ordering(360) 00:14:13.796 fused_ordering(361) 00:14:13.796 fused_ordering(362) 00:14:13.796 fused_ordering(363) 00:14:13.796 fused_ordering(364) 00:14:13.796 fused_ordering(365) 00:14:13.796 fused_ordering(366) 00:14:13.796 fused_ordering(367) 00:14:13.796 fused_ordering(368) 00:14:13.796 fused_ordering(369) 00:14:13.796 fused_ordering(370) 00:14:13.796 fused_ordering(371) 00:14:13.796 fused_ordering(372) 00:14:13.796 fused_ordering(373) 00:14:13.796 fused_ordering(374) 00:14:13.796 fused_ordering(375) 00:14:13.796 fused_ordering(376) 00:14:13.796 fused_ordering(377) 00:14:13.796 fused_ordering(378) 00:14:13.796 fused_ordering(379) 00:14:13.796 fused_ordering(380) 00:14:13.796 fused_ordering(381) 00:14:13.796 fused_ordering(382) 00:14:13.796 fused_ordering(383) 00:14:13.796 fused_ordering(384) 00:14:13.796 fused_ordering(385) 00:14:13.796 fused_ordering(386) 00:14:13.796 fused_ordering(387) 00:14:13.796 fused_ordering(388) 00:14:13.796 fused_ordering(389) 00:14:13.796 fused_ordering(390) 00:14:13.796 fused_ordering(391) 00:14:13.796 fused_ordering(392) 00:14:13.796 fused_ordering(393) 00:14:13.796 fused_ordering(394) 00:14:13.796 fused_ordering(395) 00:14:13.796 fused_ordering(396) 00:14:13.796 fused_ordering(397) 00:14:13.796 fused_ordering(398) 00:14:13.796 fused_ordering(399) 00:14:13.796 fused_ordering(400) 00:14:13.797 fused_ordering(401) 00:14:13.797 fused_ordering(402) 00:14:13.797 fused_ordering(403) 00:14:13.797 fused_ordering(404) 00:14:13.797 fused_ordering(405) 00:14:13.797 fused_ordering(406) 00:14:13.797 fused_ordering(407) 00:14:13.797 fused_ordering(408) 00:14:13.797 fused_ordering(409) 00:14:13.797 fused_ordering(410) 00:14:14.364 fused_ordering(411) 00:14:14.364 fused_ordering(412) 00:14:14.364 fused_ordering(413) 00:14:14.364 fused_ordering(414) 00:14:14.364 fused_ordering(415) 00:14:14.364 fused_ordering(416) 00:14:14.364 fused_ordering(417) 00:14:14.364 fused_ordering(418) 00:14:14.364 fused_ordering(419) 00:14:14.364 fused_ordering(420) 00:14:14.364 fused_ordering(421) 00:14:14.364 fused_ordering(422) 00:14:14.364 fused_ordering(423) 00:14:14.364 fused_ordering(424) 00:14:14.364 fused_ordering(425) 00:14:14.364 fused_ordering(426) 00:14:14.364 fused_ordering(427) 00:14:14.364 fused_ordering(428) 00:14:14.364 fused_ordering(429) 00:14:14.364 fused_ordering(430) 00:14:14.364 fused_ordering(431) 00:14:14.364 fused_ordering(432) 00:14:14.364 fused_ordering(433) 00:14:14.364 fused_ordering(434) 00:14:14.364 fused_ordering(435) 00:14:14.364 fused_ordering(436) 00:14:14.364 fused_ordering(437) 00:14:14.364 fused_ordering(438) 00:14:14.364 fused_ordering(439) 00:14:14.364 fused_ordering(440) 00:14:14.364 fused_ordering(441) 00:14:14.364 fused_ordering(442) 00:14:14.364 fused_ordering(443) 00:14:14.364 fused_ordering(444) 00:14:14.364 fused_ordering(445) 00:14:14.364 fused_ordering(446) 00:14:14.364 fused_ordering(447) 00:14:14.364 fused_ordering(448) 00:14:14.365 fused_ordering(449) 00:14:14.365 fused_ordering(450) 00:14:14.365 fused_ordering(451) 00:14:14.365 fused_ordering(452) 00:14:14.365 fused_ordering(453) 00:14:14.365 fused_ordering(454) 00:14:14.365 fused_ordering(455) 00:14:14.365 fused_ordering(456) 00:14:14.365 fused_ordering(457) 00:14:14.365 fused_ordering(458) 00:14:14.365 fused_ordering(459) 00:14:14.365 fused_ordering(460) 00:14:14.365 fused_ordering(461) 00:14:14.365 fused_ordering(462) 00:14:14.365 fused_ordering(463) 00:14:14.365 fused_ordering(464) 00:14:14.365 fused_ordering(465) 00:14:14.365 fused_ordering(466) 00:14:14.365 fused_ordering(467) 00:14:14.365 fused_ordering(468) 00:14:14.365 fused_ordering(469) 00:14:14.365 fused_ordering(470) 00:14:14.365 fused_ordering(471) 00:14:14.365 fused_ordering(472) 00:14:14.365 fused_ordering(473) 00:14:14.365 fused_ordering(474) 00:14:14.365 fused_ordering(475) 00:14:14.365 fused_ordering(476) 00:14:14.365 fused_ordering(477) 00:14:14.365 fused_ordering(478) 00:14:14.365 fused_ordering(479) 00:14:14.365 fused_ordering(480) 00:14:14.365 fused_ordering(481) 00:14:14.365 fused_ordering(482) 00:14:14.365 fused_ordering(483) 00:14:14.365 fused_ordering(484) 00:14:14.365 fused_ordering(485) 00:14:14.365 fused_ordering(486) 00:14:14.365 fused_ordering(487) 00:14:14.365 fused_ordering(488) 00:14:14.365 fused_ordering(489) 00:14:14.365 fused_ordering(490) 00:14:14.365 fused_ordering(491) 00:14:14.365 fused_ordering(492) 00:14:14.365 fused_ordering(493) 00:14:14.365 fused_ordering(494) 00:14:14.365 fused_ordering(495) 00:14:14.365 fused_ordering(496) 00:14:14.365 fused_ordering(497) 00:14:14.365 fused_ordering(498) 00:14:14.365 fused_ordering(499) 00:14:14.365 fused_ordering(500) 00:14:14.365 fused_ordering(501) 00:14:14.365 fused_ordering(502) 00:14:14.365 fused_ordering(503) 00:14:14.365 fused_ordering(504) 00:14:14.365 fused_ordering(505) 00:14:14.365 fused_ordering(506) 00:14:14.365 fused_ordering(507) 00:14:14.365 fused_ordering(508) 00:14:14.365 fused_ordering(509) 00:14:14.365 fused_ordering(510) 00:14:14.365 fused_ordering(511) 00:14:14.365 fused_ordering(512) 00:14:14.365 fused_ordering(513) 00:14:14.365 fused_ordering(514) 00:14:14.365 fused_ordering(515) 00:14:14.365 fused_ordering(516) 00:14:14.365 fused_ordering(517) 00:14:14.365 fused_ordering(518) 00:14:14.365 fused_ordering(519) 00:14:14.365 fused_ordering(520) 00:14:14.365 fused_ordering(521) 00:14:14.365 fused_ordering(522) 00:14:14.365 fused_ordering(523) 00:14:14.365 fused_ordering(524) 00:14:14.365 fused_ordering(525) 00:14:14.365 fused_ordering(526) 00:14:14.365 fused_ordering(527) 00:14:14.365 fused_ordering(528) 00:14:14.365 fused_ordering(529) 00:14:14.365 fused_ordering(530) 00:14:14.365 fused_ordering(531) 00:14:14.365 fused_ordering(532) 00:14:14.365 fused_ordering(533) 00:14:14.365 fused_ordering(534) 00:14:14.365 fused_ordering(535) 00:14:14.365 fused_ordering(536) 00:14:14.365 fused_ordering(537) 00:14:14.365 fused_ordering(538) 00:14:14.365 fused_ordering(539) 00:14:14.365 fused_ordering(540) 00:14:14.365 fused_ordering(541) 00:14:14.365 fused_ordering(542) 00:14:14.365 fused_ordering(543) 00:14:14.365 fused_ordering(544) 00:14:14.365 fused_ordering(545) 00:14:14.365 fused_ordering(546) 00:14:14.365 fused_ordering(547) 00:14:14.365 fused_ordering(548) 00:14:14.365 fused_ordering(549) 00:14:14.365 fused_ordering(550) 00:14:14.365 fused_ordering(551) 00:14:14.365 fused_ordering(552) 00:14:14.365 fused_ordering(553) 00:14:14.365 fused_ordering(554) 00:14:14.365 fused_ordering(555) 00:14:14.365 fused_ordering(556) 00:14:14.365 fused_ordering(557) 00:14:14.365 fused_ordering(558) 00:14:14.365 fused_ordering(559) 00:14:14.365 fused_ordering(560) 00:14:14.365 fused_ordering(561) 00:14:14.365 fused_ordering(562) 00:14:14.365 fused_ordering(563) 00:14:14.365 fused_ordering(564) 00:14:14.365 fused_ordering(565) 00:14:14.365 fused_ordering(566) 00:14:14.365 fused_ordering(567) 00:14:14.365 fused_ordering(568) 00:14:14.365 fused_ordering(569) 00:14:14.365 fused_ordering(570) 00:14:14.365 fused_ordering(571) 00:14:14.365 fused_ordering(572) 00:14:14.365 fused_ordering(573) 00:14:14.365 fused_ordering(574) 00:14:14.365 fused_ordering(575) 00:14:14.365 fused_ordering(576) 00:14:14.365 fused_ordering(577) 00:14:14.365 fused_ordering(578) 00:14:14.365 fused_ordering(579) 00:14:14.365 fused_ordering(580) 00:14:14.365 fused_ordering(581) 00:14:14.365 fused_ordering(582) 00:14:14.365 fused_ordering(583) 00:14:14.365 fused_ordering(584) 00:14:14.365 fused_ordering(585) 00:14:14.365 fused_ordering(586) 00:14:14.365 fused_ordering(587) 00:14:14.365 fused_ordering(588) 00:14:14.365 fused_ordering(589) 00:14:14.365 fused_ordering(590) 00:14:14.365 fused_ordering(591) 00:14:14.365 fused_ordering(592) 00:14:14.365 fused_ordering(593) 00:14:14.365 fused_ordering(594) 00:14:14.365 fused_ordering(595) 00:14:14.365 fused_ordering(596) 00:14:14.365 fused_ordering(597) 00:14:14.365 fused_ordering(598) 00:14:14.365 fused_ordering(599) 00:14:14.365 fused_ordering(600) 00:14:14.365 fused_ordering(601) 00:14:14.365 fused_ordering(602) 00:14:14.365 fused_ordering(603) 00:14:14.365 fused_ordering(604) 00:14:14.365 fused_ordering(605) 00:14:14.365 fused_ordering(606) 00:14:14.365 fused_ordering(607) 00:14:14.365 fused_ordering(608) 00:14:14.365 fused_ordering(609) 00:14:14.365 fused_ordering(610) 00:14:14.365 fused_ordering(611) 00:14:14.365 fused_ordering(612) 00:14:14.365 fused_ordering(613) 00:14:14.365 fused_ordering(614) 00:14:14.365 fused_ordering(615) 00:14:14.934 fused_ordering(616) 00:14:14.934 fused_ordering(617) 00:14:14.934 fused_ordering(618) 00:14:14.934 fused_ordering(619) 00:14:14.934 fused_ordering(620) 00:14:14.934 fused_ordering(621) 00:14:14.934 fused_ordering(622) 00:14:14.934 fused_ordering(623) 00:14:14.934 fused_ordering(624) 00:14:14.934 fused_ordering(625) 00:14:14.934 fused_ordering(626) 00:14:14.934 fused_ordering(627) 00:14:14.934 fused_ordering(628) 00:14:14.934 fused_ordering(629) 00:14:14.934 fused_ordering(630) 00:14:14.934 fused_ordering(631) 00:14:14.934 fused_ordering(632) 00:14:14.934 fused_ordering(633) 00:14:14.934 fused_ordering(634) 00:14:14.934 fused_ordering(635) 00:14:14.934 fused_ordering(636) 00:14:14.934 fused_ordering(637) 00:14:14.934 fused_ordering(638) 00:14:14.934 fused_ordering(639) 00:14:14.934 fused_ordering(640) 00:14:14.934 fused_ordering(641) 00:14:14.934 fused_ordering(642) 00:14:14.934 fused_ordering(643) 00:14:14.934 fused_ordering(644) 00:14:14.934 fused_ordering(645) 00:14:14.934 fused_ordering(646) 00:14:14.934 fused_ordering(647) 00:14:14.934 fused_ordering(648) 00:14:14.934 fused_ordering(649) 00:14:14.934 fused_ordering(650) 00:14:14.934 fused_ordering(651) 00:14:14.934 fused_ordering(652) 00:14:14.934 fused_ordering(653) 00:14:14.934 fused_ordering(654) 00:14:14.934 fused_ordering(655) 00:14:14.934 fused_ordering(656) 00:14:14.934 fused_ordering(657) 00:14:14.934 fused_ordering(658) 00:14:14.934 fused_ordering(659) 00:14:14.934 fused_ordering(660) 00:14:14.934 fused_ordering(661) 00:14:14.934 fused_ordering(662) 00:14:14.934 fused_ordering(663) 00:14:14.934 fused_ordering(664) 00:14:14.934 fused_ordering(665) 00:14:14.934 fused_ordering(666) 00:14:14.934 fused_ordering(667) 00:14:14.934 fused_ordering(668) 00:14:14.934 fused_ordering(669) 00:14:14.934 fused_ordering(670) 00:14:14.934 fused_ordering(671) 00:14:14.934 fused_ordering(672) 00:14:14.934 fused_ordering(673) 00:14:14.934 fused_ordering(674) 00:14:14.934 fused_ordering(675) 00:14:14.934 fused_ordering(676) 00:14:14.934 fused_ordering(677) 00:14:14.934 fused_ordering(678) 00:14:14.934 fused_ordering(679) 00:14:14.934 fused_ordering(680) 00:14:14.934 fused_ordering(681) 00:14:14.934 fused_ordering(682) 00:14:14.934 fused_ordering(683) 00:14:14.934 fused_ordering(684) 00:14:14.934 fused_ordering(685) 00:14:14.934 fused_ordering(686) 00:14:14.934 fused_ordering(687) 00:14:14.934 fused_ordering(688) 00:14:14.934 fused_ordering(689) 00:14:14.934 fused_ordering(690) 00:14:14.934 fused_ordering(691) 00:14:14.934 fused_ordering(692) 00:14:14.934 fused_ordering(693) 00:14:14.934 fused_ordering(694) 00:14:14.934 fused_ordering(695) 00:14:14.934 fused_ordering(696) 00:14:14.934 fused_ordering(697) 00:14:14.934 fused_ordering(698) 00:14:14.934 fused_ordering(699) 00:14:14.934 fused_ordering(700) 00:14:14.934 fused_ordering(701) 00:14:14.934 fused_ordering(702) 00:14:14.934 fused_ordering(703) 00:14:14.934 fused_ordering(704) 00:14:14.934 fused_ordering(705) 00:14:14.934 fused_ordering(706) 00:14:14.934 fused_ordering(707) 00:14:14.934 fused_ordering(708) 00:14:14.934 fused_ordering(709) 00:14:14.934 fused_ordering(710) 00:14:14.934 fused_ordering(711) 00:14:14.934 fused_ordering(712) 00:14:14.934 fused_ordering(713) 00:14:14.934 fused_ordering(714) 00:14:14.934 fused_ordering(715) 00:14:14.934 fused_ordering(716) 00:14:14.934 fused_ordering(717) 00:14:14.934 fused_ordering(718) 00:14:14.934 fused_ordering(719) 00:14:14.934 fused_ordering(720) 00:14:14.934 fused_ordering(721) 00:14:14.934 fused_ordering(722) 00:14:14.934 fused_ordering(723) 00:14:14.934 fused_ordering(724) 00:14:14.934 fused_ordering(725) 00:14:14.934 fused_ordering(726) 00:14:14.934 fused_ordering(727) 00:14:14.934 fused_ordering(728) 00:14:14.934 fused_ordering(729) 00:14:14.934 fused_ordering(730) 00:14:14.934 fused_ordering(731) 00:14:14.934 fused_ordering(732) 00:14:14.934 fused_ordering(733) 00:14:14.934 fused_ordering(734) 00:14:14.934 fused_ordering(735) 00:14:14.934 fused_ordering(736) 00:14:14.934 fused_ordering(737) 00:14:14.934 fused_ordering(738) 00:14:14.934 fused_ordering(739) 00:14:14.934 fused_ordering(740) 00:14:14.934 fused_ordering(741) 00:14:14.934 fused_ordering(742) 00:14:14.934 fused_ordering(743) 00:14:14.934 fused_ordering(744) 00:14:14.934 fused_ordering(745) 00:14:14.934 fused_ordering(746) 00:14:14.934 fused_ordering(747) 00:14:14.934 fused_ordering(748) 00:14:14.934 fused_ordering(749) 00:14:14.934 fused_ordering(750) 00:14:14.934 fused_ordering(751) 00:14:14.934 fused_ordering(752) 00:14:14.934 fused_ordering(753) 00:14:14.934 fused_ordering(754) 00:14:14.934 fused_ordering(755) 00:14:14.934 fused_ordering(756) 00:14:14.934 fused_ordering(757) 00:14:14.934 fused_ordering(758) 00:14:14.934 fused_ordering(759) 00:14:14.934 fused_ordering(760) 00:14:14.934 fused_ordering(761) 00:14:14.934 fused_ordering(762) 00:14:14.934 fused_ordering(763) 00:14:14.934 fused_ordering(764) 00:14:14.934 fused_ordering(765) 00:14:14.934 fused_ordering(766) 00:14:14.934 fused_ordering(767) 00:14:14.934 fused_ordering(768) 00:14:14.934 fused_ordering(769) 00:14:14.934 fused_ordering(770) 00:14:14.934 fused_ordering(771) 00:14:14.934 fused_ordering(772) 00:14:14.934 fused_ordering(773) 00:14:14.934 fused_ordering(774) 00:14:14.934 fused_ordering(775) 00:14:14.934 fused_ordering(776) 00:14:14.934 fused_ordering(777) 00:14:14.934 fused_ordering(778) 00:14:14.934 fused_ordering(779) 00:14:14.934 fused_ordering(780) 00:14:14.934 fused_ordering(781) 00:14:14.934 fused_ordering(782) 00:14:14.934 fused_ordering(783) 00:14:14.934 fused_ordering(784) 00:14:14.934 fused_ordering(785) 00:14:14.934 fused_ordering(786) 00:14:14.934 fused_ordering(787) 00:14:14.934 fused_ordering(788) 00:14:14.934 fused_ordering(789) 00:14:14.934 fused_ordering(790) 00:14:14.934 fused_ordering(791) 00:14:14.934 fused_ordering(792) 00:14:14.934 fused_ordering(793) 00:14:14.934 fused_ordering(794) 00:14:14.934 fused_ordering(795) 00:14:14.934 fused_ordering(796) 00:14:14.934 fused_ordering(797) 00:14:14.934 fused_ordering(798) 00:14:14.934 fused_ordering(799) 00:14:14.934 fused_ordering(800) 00:14:14.934 fused_ordering(801) 00:14:14.934 fused_ordering(802) 00:14:14.934 fused_ordering(803) 00:14:14.934 fused_ordering(804) 00:14:14.934 fused_ordering(805) 00:14:14.934 fused_ordering(806) 00:14:14.934 fused_ordering(807) 00:14:14.934 fused_ordering(808) 00:14:14.935 fused_ordering(809) 00:14:14.935 fused_ordering(810) 00:14:14.935 fused_ordering(811) 00:14:14.935 fused_ordering(812) 00:14:14.935 fused_ordering(813) 00:14:14.935 fused_ordering(814) 00:14:14.935 fused_ordering(815) 00:14:14.935 fused_ordering(816) 00:14:14.935 fused_ordering(817) 00:14:14.935 fused_ordering(818) 00:14:14.935 fused_ordering(819) 00:14:14.935 fused_ordering(820) 00:14:15.502 fused_ordering(821) 00:14:15.502 fused_ordering(822) 00:14:15.502 fused_ordering(823) 00:14:15.502 fused_ordering(824) 00:14:15.502 fused_ordering(825) 00:14:15.502 fused_ordering(826) 00:14:15.502 fused_ordering(827) 00:14:15.502 fused_ordering(828) 00:14:15.502 fused_ordering(829) 00:14:15.502 fused_ordering(830) 00:14:15.502 fused_ordering(831) 00:14:15.502 fused_ordering(832) 00:14:15.502 fused_ordering(833) 00:14:15.502 fused_ordering(834) 00:14:15.502 fused_ordering(835) 00:14:15.502 fused_ordering(836) 00:14:15.502 fused_ordering(837) 00:14:15.502 fused_ordering(838) 00:14:15.502 fused_ordering(839) 00:14:15.502 fused_ordering(840) 00:14:15.502 fused_ordering(841) 00:14:15.502 fused_ordering(842) 00:14:15.502 fused_ordering(843) 00:14:15.502 fused_ordering(844) 00:14:15.502 fused_ordering(845) 00:14:15.502 fused_ordering(846) 00:14:15.502 fused_ordering(847) 00:14:15.502 fused_ordering(848) 00:14:15.502 fused_ordering(849) 00:14:15.502 fused_ordering(850) 00:14:15.502 fused_ordering(851) 00:14:15.502 fused_ordering(852) 00:14:15.502 fused_ordering(853) 00:14:15.502 fused_ordering(854) 00:14:15.502 fused_ordering(855) 00:14:15.502 fused_ordering(856) 00:14:15.502 fused_ordering(857) 00:14:15.502 fused_ordering(858) 00:14:15.502 fused_ordering(859) 00:14:15.502 fused_ordering(860) 00:14:15.502 fused_ordering(861) 00:14:15.502 fused_ordering(862) 00:14:15.502 fused_ordering(863) 00:14:15.503 fused_ordering(864) 00:14:15.503 fused_ordering(865) 00:14:15.503 fused_ordering(866) 00:14:15.503 fused_ordering(867) 00:14:15.503 fused_ordering(868) 00:14:15.503 fused_ordering(869) 00:14:15.503 fused_ordering(870) 00:14:15.503 fused_ordering(871) 00:14:15.503 fused_ordering(872) 00:14:15.503 fused_ordering(873) 00:14:15.503 fused_ordering(874) 00:14:15.503 fused_ordering(875) 00:14:15.503 fused_ordering(876) 00:14:15.503 fused_ordering(877) 00:14:15.503 fused_ordering(878) 00:14:15.503 fused_ordering(879) 00:14:15.503 fused_ordering(880) 00:14:15.503 fused_ordering(881) 00:14:15.503 fused_ordering(882) 00:14:15.503 fused_ordering(883) 00:14:15.503 fused_ordering(884) 00:14:15.503 fused_ordering(885) 00:14:15.503 fused_ordering(886) 00:14:15.503 fused_ordering(887) 00:14:15.503 fused_ordering(888) 00:14:15.503 fused_ordering(889) 00:14:15.503 fused_ordering(890) 00:14:15.503 fused_ordering(891) 00:14:15.503 fused_ordering(892) 00:14:15.503 fused_ordering(893) 00:14:15.503 fused_ordering(894) 00:14:15.503 fused_ordering(895) 00:14:15.503 fused_ordering(896) 00:14:15.503 fused_ordering(897) 00:14:15.503 fused_ordering(898) 00:14:15.503 fused_ordering(899) 00:14:15.503 fused_ordering(900) 00:14:15.503 fused_ordering(901) 00:14:15.503 fused_ordering(902) 00:14:15.503 fused_ordering(903) 00:14:15.503 fused_ordering(904) 00:14:15.503 fused_ordering(905) 00:14:15.503 fused_ordering(906) 00:14:15.503 fused_ordering(907) 00:14:15.503 fused_ordering(908) 00:14:15.503 fused_ordering(909) 00:14:15.503 fused_ordering(910) 00:14:15.503 fused_ordering(911) 00:14:15.503 fused_ordering(912) 00:14:15.503 fused_ordering(913) 00:14:15.503 fused_ordering(914) 00:14:15.503 fused_ordering(915) 00:14:15.503 fused_ordering(916) 00:14:15.503 fused_ordering(917) 00:14:15.503 fused_ordering(918) 00:14:15.503 fused_ordering(919) 00:14:15.503 fused_ordering(920) 00:14:15.503 fused_ordering(921) 00:14:15.503 fused_ordering(922) 00:14:15.503 fused_ordering(923) 00:14:15.503 fused_ordering(924) 00:14:15.503 fused_ordering(925) 00:14:15.503 fused_ordering(926) 00:14:15.503 fused_ordering(927) 00:14:15.503 fused_ordering(928) 00:14:15.503 fused_ordering(929) 00:14:15.503 fused_ordering(930) 00:14:15.503 fused_ordering(931) 00:14:15.503 fused_ordering(932) 00:14:15.503 fused_ordering(933) 00:14:15.503 fused_ordering(934) 00:14:15.503 fused_ordering(935) 00:14:15.503 fused_ordering(936) 00:14:15.503 fused_ordering(937) 00:14:15.503 fused_ordering(938) 00:14:15.503 fused_ordering(939) 00:14:15.503 fused_ordering(940) 00:14:15.503 fused_ordering(941) 00:14:15.503 fused_ordering(942) 00:14:15.503 fused_ordering(943) 00:14:15.503 fused_ordering(944) 00:14:15.503 fused_ordering(945) 00:14:15.503 fused_ordering(946) 00:14:15.503 fused_ordering(947) 00:14:15.503 fused_ordering(948) 00:14:15.503 fused_ordering(949) 00:14:15.503 fused_ordering(950) 00:14:15.503 fused_ordering(951) 00:14:15.503 fused_ordering(952) 00:14:15.503 fused_ordering(953) 00:14:15.503 fused_ordering(954) 00:14:15.503 fused_ordering(955) 00:14:15.503 fused_ordering(956) 00:14:15.503 fused_ordering(957) 00:14:15.503 fused_ordering(958) 00:14:15.503 fused_ordering(959) 00:14:15.503 fused_ordering(960) 00:14:15.503 fused_ordering(961) 00:14:15.503 fused_ordering(962) 00:14:15.503 fused_ordering(963) 00:14:15.503 fused_ordering(964) 00:14:15.503 fused_ordering(965) 00:14:15.503 fused_ordering(966) 00:14:15.503 fused_ordering(967) 00:14:15.503 fused_ordering(968) 00:14:15.503 fused_ordering(969) 00:14:15.503 fused_ordering(970) 00:14:15.503 fused_ordering(971) 00:14:15.503 fused_ordering(972) 00:14:15.503 fused_ordering(973) 00:14:15.503 fused_ordering(974) 00:14:15.503 fused_ordering(975) 00:14:15.503 fused_ordering(976) 00:14:15.503 fused_ordering(977) 00:14:15.503 fused_ordering(978) 00:14:15.503 fused_ordering(979) 00:14:15.503 fused_ordering(980) 00:14:15.503 fused_ordering(981) 00:14:15.503 fused_ordering(982) 00:14:15.503 fused_ordering(983) 00:14:15.503 fused_ordering(984) 00:14:15.503 fused_ordering(985) 00:14:15.503 fused_ordering(986) 00:14:15.503 fused_ordering(987) 00:14:15.503 fused_ordering(988) 00:14:15.503 fused_ordering(989) 00:14:15.503 fused_ordering(990) 00:14:15.503 fused_ordering(991) 00:14:15.503 fused_ordering(992) 00:14:15.503 fused_ordering(993) 00:14:15.503 fused_ordering(994) 00:14:15.503 fused_ordering(995) 00:14:15.503 fused_ordering(996) 00:14:15.503 fused_ordering(997) 00:14:15.503 fused_ordering(998) 00:14:15.503 fused_ordering(999) 00:14:15.503 fused_ordering(1000) 00:14:15.503 fused_ordering(1001) 00:14:15.503 fused_ordering(1002) 00:14:15.503 fused_ordering(1003) 00:14:15.503 fused_ordering(1004) 00:14:15.503 fused_ordering(1005) 00:14:15.503 fused_ordering(1006) 00:14:15.503 fused_ordering(1007) 00:14:15.503 fused_ordering(1008) 00:14:15.503 fused_ordering(1009) 00:14:15.503 fused_ordering(1010) 00:14:15.503 fused_ordering(1011) 00:14:15.503 fused_ordering(1012) 00:14:15.503 fused_ordering(1013) 00:14:15.503 fused_ordering(1014) 00:14:15.503 fused_ordering(1015) 00:14:15.503 fused_ordering(1016) 00:14:15.503 fused_ordering(1017) 00:14:15.503 fused_ordering(1018) 00:14:15.503 fused_ordering(1019) 00:14:15.503 fused_ordering(1020) 00:14:15.503 fused_ordering(1021) 00:14:15.503 fused_ordering(1022) 00:14:15.503 fused_ordering(1023) 00:14:15.503 04:58:54 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:15.503 04:58:54 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:15.503 04:58:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:15.503 04:58:54 -- nvmf/common.sh@117 -- # sync 00:14:15.503 04:58:54 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:15.503 04:58:54 -- nvmf/common.sh@120 -- # set +e 00:14:15.503 04:58:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:15.503 04:58:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:15.503 rmmod nvme_tcp 00:14:15.503 rmmod nvme_fabrics 00:14:15.503 rmmod nvme_keyring 00:14:15.503 04:58:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:15.503 04:58:54 -- nvmf/common.sh@124 -- # set -e 00:14:15.503 04:58:54 -- nvmf/common.sh@125 -- # return 0 00:14:15.503 04:58:54 -- nvmf/common.sh@478 -- # '[' -n 2352952 ']' 00:14:15.503 04:58:54 -- nvmf/common.sh@479 -- # killprocess 2352952 00:14:15.503 04:58:54 -- common/autotest_common.sh@936 -- # '[' -z 2352952 ']' 00:14:15.503 04:58:54 -- common/autotest_common.sh@940 -- # kill -0 2352952 00:14:15.503 04:58:54 -- common/autotest_common.sh@941 -- # uname 00:14:15.503 04:58:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:15.503 04:58:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2352952 00:14:15.762 04:58:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:15.762 04:58:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:15.762 04:58:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2352952' 00:14:15.762 killing process with pid 2352952 00:14:15.762 04:58:54 -- common/autotest_common.sh@955 -- # kill 2352952 00:14:15.763 04:58:54 -- common/autotest_common.sh@960 -- # wait 2352952 00:14:15.763 04:58:54 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:15.763 04:58:54 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:15.763 04:58:54 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:15.763 04:58:54 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:15.763 04:58:54 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:15.763 04:58:54 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:15.763 04:58:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:15.763 04:58:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:18.324 04:58:56 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:18.324 00:14:18.324 real 0m7.730s 00:14:18.324 user 0m5.404s 00:14:18.324 sys 0m3.455s 00:14:18.324 04:58:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:18.324 04:58:56 -- common/autotest_common.sh@10 -- # set +x 00:14:18.324 ************************************ 00:14:18.324 END TEST nvmf_fused_ordering 00:14:18.324 ************************************ 00:14:18.324 04:58:56 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:18.324 04:58:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:18.324 04:58:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:18.324 04:58:56 -- common/autotest_common.sh@10 -- # set +x 00:14:18.324 ************************************ 00:14:18.324 START TEST nvmf_delete_subsystem 00:14:18.324 ************************************ 00:14:18.324 04:58:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:18.324 * Looking for test storage... 00:14:18.324 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:18.324 04:58:57 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:18.324 04:58:57 -- nvmf/common.sh@7 -- # uname -s 00:14:18.324 04:58:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:18.324 04:58:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:18.324 04:58:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:18.324 04:58:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:18.324 04:58:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:18.324 04:58:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:18.324 04:58:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:18.324 04:58:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:18.324 04:58:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:18.324 04:58:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:18.324 04:58:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:18.324 04:58:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:18.324 04:58:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:18.324 04:58:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:18.324 04:58:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:18.324 04:58:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:18.324 04:58:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:18.324 04:58:57 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:18.324 04:58:57 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:18.324 04:58:57 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:18.324 04:58:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.324 04:58:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.324 04:58:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.324 04:58:57 -- paths/export.sh@5 -- # export PATH 00:14:18.324 04:58:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.324 04:58:57 -- nvmf/common.sh@47 -- # : 0 00:14:18.324 04:58:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:18.324 04:58:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:18.324 04:58:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:18.324 04:58:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:18.324 04:58:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:18.324 04:58:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:18.324 04:58:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:18.324 04:58:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:18.324 04:58:57 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:18.324 04:58:57 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:14:18.324 04:58:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:18.324 04:58:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:18.324 04:58:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:18.324 04:58:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:18.324 04:58:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:18.324 04:58:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:18.324 04:58:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:18.324 04:58:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:18.324 04:58:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:18.324 04:58:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:18.324 04:58:57 -- common/autotest_common.sh@10 -- # set +x 00:14:20.229 04:58:59 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:20.229 04:58:59 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:20.229 04:58:59 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:20.229 04:58:59 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:20.229 04:58:59 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:20.229 04:58:59 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:20.229 04:58:59 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:20.229 04:58:59 -- nvmf/common.sh@295 -- # net_devs=() 00:14:20.229 04:58:59 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:20.229 04:58:59 -- nvmf/common.sh@296 -- # e810=() 00:14:20.229 04:58:59 -- nvmf/common.sh@296 -- # local -ga e810 00:14:20.229 04:58:59 -- nvmf/common.sh@297 -- # x722=() 00:14:20.229 04:58:59 -- nvmf/common.sh@297 -- # local -ga x722 00:14:20.229 04:58:59 -- nvmf/common.sh@298 -- # mlx=() 00:14:20.229 04:58:59 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:20.229 04:58:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:20.229 04:58:59 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:20.229 04:58:59 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:20.229 04:58:59 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:20.229 04:58:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:20.229 04:58:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:20.229 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:20.229 04:58:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:20.229 04:58:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:20.229 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:20.229 04:58:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:20.229 04:58:59 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:20.229 04:58:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:20.229 04:58:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:20.229 04:58:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:20.229 04:58:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:20.229 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:20.229 04:58:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:20.229 04:58:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:20.229 04:58:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:20.229 04:58:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:20.229 04:58:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:20.229 04:58:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:20.229 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:20.229 04:58:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:20.229 04:58:59 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:20.229 04:58:59 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:20.229 04:58:59 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:14:20.229 04:58:59 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:20.229 04:58:59 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:20.229 04:58:59 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:20.229 04:58:59 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:14:20.229 04:58:59 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:20.229 04:58:59 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:20.229 04:58:59 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:14:20.229 04:58:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:20.229 04:58:59 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:20.229 04:58:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:14:20.229 04:58:59 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:14:20.229 04:58:59 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:14:20.229 04:58:59 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:20.229 04:58:59 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:20.229 04:58:59 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:20.229 04:58:59 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:14:20.229 04:58:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:20.229 04:58:59 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:20.229 04:58:59 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:20.229 04:58:59 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:14:20.229 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:20.229 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:14:20.229 00:14:20.229 --- 10.0.0.2 ping statistics --- 00:14:20.229 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:20.229 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:14:20.229 04:58:59 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:20.229 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:20.229 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:14:20.229 00:14:20.229 --- 10.0.0.1 ping statistics --- 00:14:20.229 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:20.229 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:14:20.229 04:58:59 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:20.229 04:58:59 -- nvmf/common.sh@411 -- # return 0 00:14:20.229 04:58:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:20.229 04:58:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:20.229 04:58:59 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:14:20.229 04:58:59 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:20.229 04:58:59 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:14:20.229 04:58:59 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:14:20.229 04:58:59 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:20.229 04:58:59 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:20.229 04:58:59 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:20.229 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.229 04:58:59 -- nvmf/common.sh@470 -- # nvmfpid=2355311 00:14:20.229 04:58:59 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:20.229 04:58:59 -- nvmf/common.sh@471 -- # waitforlisten 2355311 00:14:20.229 04:58:59 -- common/autotest_common.sh@817 -- # '[' -z 2355311 ']' 00:14:20.229 04:58:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:20.229 04:58:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:20.229 04:58:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:20.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:20.229 04:58:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:20.229 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.229 [2024-04-23 04:58:59.378107] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:14:20.229 [2024-04-23 04:58:59.378206] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:20.488 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.488 [2024-04-23 04:58:59.417111] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:14:20.488 [2024-04-23 04:58:59.443601] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:20.488 [2024-04-23 04:58:59.526985] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:20.488 [2024-04-23 04:58:59.527072] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:20.488 [2024-04-23 04:58:59.527086] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:20.488 [2024-04-23 04:58:59.527097] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:20.488 [2024-04-23 04:58:59.527107] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:20.488 [2024-04-23 04:58:59.527232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:20.488 [2024-04-23 04:58:59.527237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.488 04:58:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:20.488 04:58:59 -- common/autotest_common.sh@850 -- # return 0 00:14:20.488 04:58:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:20.488 04:58:59 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:20.488 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.748 04:58:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:20.748 04:58:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.748 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.748 [2024-04-23 04:58:59.676969] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:20.748 04:58:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:20.748 04:58:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.748 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.748 04:58:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:20.748 04:58:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.748 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.748 [2024-04-23 04:58:59.693185] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:20.748 04:58:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:20.748 04:58:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.748 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.748 NULL1 00:14:20.748 04:58:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:20.748 04:58:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.748 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.748 Delay0 00:14:20.748 04:58:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.748 04:58:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.748 04:58:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.748 04:58:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@28 -- # perf_pid=2355336 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:20.748 04:58:59 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:20.748 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.748 [2024-04-23 04:58:59.767899] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:22.654 04:59:01 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:22.654 04:59:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:22.654 04:59:01 -- common/autotest_common.sh@10 -- # set +x 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 [2024-04-23 04:59:01.899083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff3a8000c00 is same with the state(5) to be set 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Write completed with error (sct=0, sc=8) 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.915 starting I/O failed: -6 00:14:22.915 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 Write completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 Read completed with error (sct=0, sc=8) 00:14:22.916 starting I/O failed: -6 00:14:22.916 starting I/O failed: -6 00:14:22.916 starting I/O failed: -6 00:14:22.916 starting I/O failed: -6 00:14:22.916 starting I/O failed: -6 00:14:22.916 starting I/O failed: -6 00:14:22.916 starting I/O failed: -6 00:14:23.854 [2024-04-23 04:59:02.867072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xacd1c0 is same with the state(5) to be set 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 [2024-04-23 04:59:02.897101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac79f0 is same with the state(5) to be set 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 [2024-04-23 04:59:02.897358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xae5bf0 is same with the state(5) to be set 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 [2024-04-23 04:59:02.901862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff3a800c510 is same with the state(5) to be set 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Write completed with error (sct=0, sc=8) 00:14:23.854 Read completed with error (sct=0, sc=8) 00:14:23.854 04:59:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.854 [2024-04-23 04:59:02.902560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff3a800bf90 is same with the state(5) to be set 00:14:23.854 04:59:02 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:23.854 04:59:02 -- target/delete_subsystem.sh@35 -- # kill -0 2355336 00:14:23.854 04:59:02 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:23.854 [2024-04-23 04:59:02.903107] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xacd1c0 (9): Bad file descriptor 00:14:23.854 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:23.854 Initializing NVMe Controllers 00:14:23.854 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:23.855 Controller IO queue size 128, less than required. 00:14:23.855 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:23.855 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:23.855 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:23.855 Initialization complete. Launching workers. 00:14:23.855 ======================================================== 00:14:23.855 Latency(us) 00:14:23.855 Device Information : IOPS MiB/s Average min max 00:14:23.855 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 167.68 0.08 978283.48 555.53 1996799.13 00:14:23.855 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 161.23 0.08 947567.71 654.14 2004867.54 00:14:23.855 ======================================================== 00:14:23.855 Total : 328.92 0.16 963226.73 555.53 2004867.54 00:14:23.855 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@35 -- # kill -0 2355336 00:14:24.426 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2355336) - No such process 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@45 -- # NOT wait 2355336 00:14:24.426 04:59:03 -- common/autotest_common.sh@638 -- # local es=0 00:14:24.426 04:59:03 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 2355336 00:14:24.426 04:59:03 -- common/autotest_common.sh@626 -- # local arg=wait 00:14:24.426 04:59:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:24.426 04:59:03 -- common/autotest_common.sh@630 -- # type -t wait 00:14:24.426 04:59:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:24.426 04:59:03 -- common/autotest_common.sh@641 -- # wait 2355336 00:14:24.426 04:59:03 -- common/autotest_common.sh@641 -- # es=1 00:14:24.426 04:59:03 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:24.426 04:59:03 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:24.426 04:59:03 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:24.426 04:59:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:24.426 04:59:03 -- common/autotest_common.sh@10 -- # set +x 00:14:24.426 04:59:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:24.426 04:59:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:24.426 04:59:03 -- common/autotest_common.sh@10 -- # set +x 00:14:24.426 [2024-04-23 04:59:03.424019] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:24.426 04:59:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.426 04:59:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:24.426 04:59:03 -- common/autotest_common.sh@10 -- # set +x 00:14:24.426 04:59:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@54 -- # perf_pid=2355744 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:24.426 04:59:03 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:24.426 EAL: No free 2048 kB hugepages reported on node 1 00:14:24.426 [2024-04-23 04:59:03.480346] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:24.993 04:59:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:24.993 04:59:03 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:24.993 04:59:03 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:25.561 04:59:04 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:25.561 04:59:04 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:25.561 04:59:04 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:25.819 04:59:04 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:25.819 04:59:04 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:25.819 04:59:04 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:26.385 04:59:05 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:26.386 04:59:05 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:26.386 04:59:05 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:26.955 04:59:05 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:26.955 04:59:05 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:26.955 04:59:05 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:27.522 04:59:06 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:27.522 04:59:06 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:27.522 04:59:06 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:27.522 Initializing NVMe Controllers 00:14:27.522 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:27.522 Controller IO queue size 128, less than required. 00:14:27.522 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:27.522 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:27.522 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:27.522 Initialization complete. Launching workers. 00:14:27.522 ======================================================== 00:14:27.522 Latency(us) 00:14:27.522 Device Information : IOPS MiB/s Average min max 00:14:27.522 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004407.43 1000188.98 1043353.12 00:14:27.522 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1006689.76 1000210.85 1042522.13 00:14:27.522 ======================================================== 00:14:27.522 Total : 256.00 0.12 1005548.59 1000188.98 1043353.12 00:14:27.522 00:14:28.092 04:59:06 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:28.092 04:59:06 -- target/delete_subsystem.sh@57 -- # kill -0 2355744 00:14:28.092 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2355744) - No such process 00:14:28.092 04:59:06 -- target/delete_subsystem.sh@67 -- # wait 2355744 00:14:28.092 04:59:06 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:28.092 04:59:06 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:28.092 04:59:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:28.092 04:59:06 -- nvmf/common.sh@117 -- # sync 00:14:28.092 04:59:06 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:28.092 04:59:06 -- nvmf/common.sh@120 -- # set +e 00:14:28.092 04:59:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:28.092 04:59:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:28.092 rmmod nvme_tcp 00:14:28.092 rmmod nvme_fabrics 00:14:28.092 rmmod nvme_keyring 00:14:28.092 04:59:07 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:28.092 04:59:07 -- nvmf/common.sh@124 -- # set -e 00:14:28.092 04:59:07 -- nvmf/common.sh@125 -- # return 0 00:14:28.092 04:59:07 -- nvmf/common.sh@478 -- # '[' -n 2355311 ']' 00:14:28.092 04:59:07 -- nvmf/common.sh@479 -- # killprocess 2355311 00:14:28.092 04:59:07 -- common/autotest_common.sh@936 -- # '[' -z 2355311 ']' 00:14:28.092 04:59:07 -- common/autotest_common.sh@940 -- # kill -0 2355311 00:14:28.092 04:59:07 -- common/autotest_common.sh@941 -- # uname 00:14:28.092 04:59:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:28.092 04:59:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2355311 00:14:28.092 04:59:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:28.092 04:59:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:28.092 04:59:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2355311' 00:14:28.092 killing process with pid 2355311 00:14:28.092 04:59:07 -- common/autotest_common.sh@955 -- # kill 2355311 00:14:28.092 04:59:07 -- common/autotest_common.sh@960 -- # wait 2355311 00:14:28.352 04:59:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:28.352 04:59:07 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:28.352 04:59:07 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:28.352 04:59:07 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:28.352 04:59:07 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:28.352 04:59:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:28.352 04:59:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:28.352 04:59:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:30.260 04:59:09 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:30.260 00:14:30.260 real 0m12.250s 00:14:30.260 user 0m27.662s 00:14:30.260 sys 0m2.975s 00:14:30.260 04:59:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:30.260 04:59:09 -- common/autotest_common.sh@10 -- # set +x 00:14:30.260 ************************************ 00:14:30.260 END TEST nvmf_delete_subsystem 00:14:30.260 ************************************ 00:14:30.260 04:59:09 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=tcp 00:14:30.260 04:59:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:30.260 04:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:30.260 04:59:09 -- common/autotest_common.sh@10 -- # set +x 00:14:30.518 ************************************ 00:14:30.518 START TEST nvmf_ns_masking 00:14:30.518 ************************************ 00:14:30.518 04:59:09 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=tcp 00:14:30.518 * Looking for test storage... 00:14:30.519 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:30.519 04:59:09 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:30.519 04:59:09 -- nvmf/common.sh@7 -- # uname -s 00:14:30.519 04:59:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:30.519 04:59:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:30.519 04:59:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:30.519 04:59:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:30.519 04:59:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:30.519 04:59:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:30.519 04:59:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:30.519 04:59:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:30.519 04:59:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:30.519 04:59:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:30.519 04:59:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:30.519 04:59:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:30.519 04:59:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:30.519 04:59:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:30.519 04:59:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:30.519 04:59:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:30.519 04:59:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:30.519 04:59:09 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:30.519 04:59:09 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:30.519 04:59:09 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:30.519 04:59:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:30.519 04:59:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:30.519 04:59:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:30.519 04:59:09 -- paths/export.sh@5 -- # export PATH 00:14:30.519 04:59:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:30.519 04:59:09 -- nvmf/common.sh@47 -- # : 0 00:14:30.519 04:59:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:30.519 04:59:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:30.519 04:59:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:30.519 04:59:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:30.519 04:59:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:30.519 04:59:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:30.519 04:59:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:30.519 04:59:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:30.519 04:59:09 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:30.519 04:59:09 -- target/ns_masking.sh@11 -- # loops=5 00:14:30.519 04:59:09 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:14:30.519 04:59:09 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:14:30.519 04:59:09 -- target/ns_masking.sh@15 -- # uuidgen 00:14:30.519 04:59:09 -- target/ns_masking.sh@15 -- # HOSTID=4237986c-6594-4842-bb94-17722771653f 00:14:30.519 04:59:09 -- target/ns_masking.sh@44 -- # nvmftestinit 00:14:30.519 04:59:09 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:14:30.519 04:59:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:30.519 04:59:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:30.519 04:59:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:30.519 04:59:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:30.519 04:59:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:30.519 04:59:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:30.519 04:59:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:30.519 04:59:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:30.519 04:59:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:30.519 04:59:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:30.519 04:59:09 -- common/autotest_common.sh@10 -- # set +x 00:14:32.426 04:59:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:32.426 04:59:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:32.426 04:59:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:32.426 04:59:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:32.426 04:59:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:32.426 04:59:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:32.426 04:59:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:32.426 04:59:11 -- nvmf/common.sh@295 -- # net_devs=() 00:14:32.426 04:59:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:32.426 04:59:11 -- nvmf/common.sh@296 -- # e810=() 00:14:32.426 04:59:11 -- nvmf/common.sh@296 -- # local -ga e810 00:14:32.426 04:59:11 -- nvmf/common.sh@297 -- # x722=() 00:14:32.426 04:59:11 -- nvmf/common.sh@297 -- # local -ga x722 00:14:32.426 04:59:11 -- nvmf/common.sh@298 -- # mlx=() 00:14:32.426 04:59:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:32.426 04:59:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:32.426 04:59:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:32.426 04:59:11 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:32.426 04:59:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:32.426 04:59:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.426 04:59:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:32.426 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:32.426 04:59:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.426 04:59:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:32.426 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:32.426 04:59:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:32.426 04:59:11 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.426 04:59:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.426 04:59:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.426 04:59:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.426 04:59:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:32.426 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:32.426 04:59:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.426 04:59:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.426 04:59:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.426 04:59:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.426 04:59:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.426 04:59:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:32.426 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:32.426 04:59:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.426 04:59:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:32.426 04:59:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:32.426 04:59:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:14:32.426 04:59:11 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:14:32.426 04:59:11 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:32.426 04:59:11 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:32.426 04:59:11 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:32.426 04:59:11 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:14:32.426 04:59:11 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:32.426 04:59:11 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:32.426 04:59:11 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:14:32.426 04:59:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:32.426 04:59:11 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:32.426 04:59:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:14:32.426 04:59:11 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:14:32.426 04:59:11 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:14:32.426 04:59:11 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:32.426 04:59:11 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:32.426 04:59:11 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:32.426 04:59:11 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:14:32.426 04:59:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:32.685 04:59:11 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:32.685 04:59:11 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:32.685 04:59:11 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:14:32.685 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:32.685 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.145 ms 00:14:32.685 00:14:32.685 --- 10.0.0.2 ping statistics --- 00:14:32.685 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:32.685 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:14:32.685 04:59:11 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:32.685 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:32.685 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:14:32.685 00:14:32.685 --- 10.0.0.1 ping statistics --- 00:14:32.685 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:32.685 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:14:32.685 04:59:11 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:32.685 04:59:11 -- nvmf/common.sh@411 -- # return 0 00:14:32.685 04:59:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:32.685 04:59:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:32.685 04:59:11 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:14:32.685 04:59:11 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:14:32.685 04:59:11 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:32.685 04:59:11 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:14:32.685 04:59:11 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:14:32.685 04:59:11 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:14:32.685 04:59:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:32.685 04:59:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:32.685 04:59:11 -- common/autotest_common.sh@10 -- # set +x 00:14:32.685 04:59:11 -- nvmf/common.sh@470 -- # nvmfpid=2358089 00:14:32.685 04:59:11 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:32.685 04:59:11 -- nvmf/common.sh@471 -- # waitforlisten 2358089 00:14:32.685 04:59:11 -- common/autotest_common.sh@817 -- # '[' -z 2358089 ']' 00:14:32.685 04:59:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:32.685 04:59:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:32.685 04:59:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:32.685 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:32.685 04:59:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:32.685 04:59:11 -- common/autotest_common.sh@10 -- # set +x 00:14:32.685 [2024-04-23 04:59:11.700069] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:14:32.685 [2024-04-23 04:59:11.700153] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:32.685 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.686 [2024-04-23 04:59:11.738904] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:14:32.686 [2024-04-23 04:59:11.769845] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:32.944 [2024-04-23 04:59:11.863540] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:32.944 [2024-04-23 04:59:11.863601] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:32.944 [2024-04-23 04:59:11.863618] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:32.944 [2024-04-23 04:59:11.863631] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:32.944 [2024-04-23 04:59:11.863643] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:32.944 [2024-04-23 04:59:11.863731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:32.944 [2024-04-23 04:59:11.863798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:32.944 [2024-04-23 04:59:11.863868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:32.944 [2024-04-23 04:59:11.863871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:32.944 04:59:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:32.944 04:59:11 -- common/autotest_common.sh@850 -- # return 0 00:14:32.944 04:59:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:32.944 04:59:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:32.944 04:59:11 -- common/autotest_common.sh@10 -- # set +x 00:14:32.944 04:59:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:32.944 04:59:12 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:33.202 [2024-04-23 04:59:12.241066] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:33.202 04:59:12 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:14:33.202 04:59:12 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:14:33.202 04:59:12 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:14:33.459 Malloc1 00:14:33.459 04:59:12 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:14:33.719 Malloc2 00:14:33.719 04:59:12 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:34.019 04:59:13 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:14:34.276 04:59:13 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:34.535 [2024-04-23 04:59:13.512455] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:34.535 04:59:13 -- target/ns_masking.sh@61 -- # connect 00:14:34.535 04:59:13 -- target/ns_masking.sh@18 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 4237986c-6594-4842-bb94-17722771653f -a 10.0.0.2 -s 4420 -i 4 00:14:34.793 04:59:13 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:14:34.793 04:59:13 -- common/autotest_common.sh@1184 -- # local i=0 00:14:34.793 04:59:13 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:34.793 04:59:13 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:34.793 04:59:13 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:36.699 04:59:15 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:36.699 04:59:15 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:36.699 04:59:15 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:36.699 04:59:15 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:36.699 04:59:15 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:36.699 04:59:15 -- common/autotest_common.sh@1194 -- # return 0 00:14:36.699 04:59:15 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:14:36.699 04:59:15 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:36.699 04:59:15 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:14:36.699 04:59:15 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:14:36.699 04:59:15 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:14:36.699 04:59:15 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:36.699 04:59:15 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:36.699 [ 0]:0x1 00:14:36.699 04:59:15 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:36.699 04:59:15 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:36.958 04:59:15 -- target/ns_masking.sh@40 -- # nguid=f0398ca26917445d964ee74a759bee24 00:14:36.958 04:59:15 -- target/ns_masking.sh@41 -- # [[ f0398ca26917445d964ee74a759bee24 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:36.958 04:59:15 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:14:37.215 04:59:16 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:14:37.215 04:59:16 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:37.215 04:59:16 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:37.215 [ 0]:0x1 00:14:37.215 04:59:16 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:37.215 04:59:16 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:37.215 04:59:16 -- target/ns_masking.sh@40 -- # nguid=f0398ca26917445d964ee74a759bee24 00:14:37.215 04:59:16 -- target/ns_masking.sh@41 -- # [[ f0398ca26917445d964ee74a759bee24 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:37.215 04:59:16 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:14:37.215 04:59:16 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:37.215 04:59:16 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:37.215 [ 1]:0x2 00:14:37.215 04:59:16 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:37.215 04:59:16 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:37.215 04:59:16 -- target/ns_masking.sh@40 -- # nguid=0883d710b4f04a568ae3732310b83da0 00:14:37.215 04:59:16 -- target/ns_masking.sh@41 -- # [[ 0883d710b4f04a568ae3732310b83da0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:37.215 04:59:16 -- target/ns_masking.sh@69 -- # disconnect 00:14:37.215 04:59:16 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:37.215 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:37.215 04:59:16 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.472 04:59:16 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:14:37.730 04:59:16 -- target/ns_masking.sh@77 -- # connect 1 00:14:37.730 04:59:16 -- target/ns_masking.sh@18 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 4237986c-6594-4842-bb94-17722771653f -a 10.0.0.2 -s 4420 -i 4 00:14:37.989 04:59:16 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:14:37.989 04:59:16 -- common/autotest_common.sh@1184 -- # local i=0 00:14:37.989 04:59:16 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:37.989 04:59:16 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:14:37.989 04:59:16 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:14:37.989 04:59:16 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:39.891 04:59:18 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:39.891 04:59:18 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:39.891 04:59:18 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:39.891 04:59:18 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:39.891 04:59:18 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:39.891 04:59:18 -- common/autotest_common.sh@1194 -- # return 0 00:14:39.891 04:59:18 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:14:39.891 04:59:18 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:39.891 04:59:18 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:14:39.891 04:59:18 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:14:39.891 04:59:18 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:14:39.891 04:59:18 -- common/autotest_common.sh@638 -- # local es=0 00:14:39.891 04:59:18 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:39.891 04:59:18 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:39.891 04:59:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.891 04:59:18 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:39.891 04:59:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.891 04:59:18 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:39.891 04:59:18 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:39.891 04:59:18 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:39.891 04:59:18 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:39.891 04:59:18 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:39.891 04:59:18 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:39.891 04:59:18 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:39.891 04:59:18 -- common/autotest_common.sh@641 -- # es=1 00:14:39.891 04:59:18 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:39.891 04:59:18 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:39.891 04:59:18 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:39.891 04:59:18 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:14:39.891 04:59:18 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:39.891 04:59:18 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:39.891 [ 0]:0x2 00:14:39.891 04:59:18 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:39.891 04:59:18 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:39.891 04:59:19 -- target/ns_masking.sh@40 -- # nguid=0883d710b4f04a568ae3732310b83da0 00:14:39.891 04:59:19 -- target/ns_masking.sh@41 -- # [[ 0883d710b4f04a568ae3732310b83da0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:39.891 04:59:19 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:40.148 04:59:19 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:14:40.148 04:59:19 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:40.148 04:59:19 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:40.148 [ 0]:0x1 00:14:40.148 04:59:19 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:40.148 04:59:19 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:40.148 04:59:19 -- target/ns_masking.sh@40 -- # nguid=f0398ca26917445d964ee74a759bee24 00:14:40.148 04:59:19 -- target/ns_masking.sh@41 -- # [[ f0398ca26917445d964ee74a759bee24 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:40.148 04:59:19 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:14:40.148 04:59:19 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:40.148 04:59:19 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:40.148 [ 1]:0x2 00:14:40.406 04:59:19 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:40.406 04:59:19 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:40.406 04:59:19 -- target/ns_masking.sh@40 -- # nguid=0883d710b4f04a568ae3732310b83da0 00:14:40.406 04:59:19 -- target/ns_masking.sh@41 -- # [[ 0883d710b4f04a568ae3732310b83da0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:40.406 04:59:19 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:40.665 04:59:19 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:14:40.665 04:59:19 -- common/autotest_common.sh@638 -- # local es=0 00:14:40.665 04:59:19 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:40.665 04:59:19 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:40.665 04:59:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:40.665 04:59:19 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:40.665 04:59:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:40.665 04:59:19 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:40.665 04:59:19 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:40.665 04:59:19 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:40.665 04:59:19 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:40.665 04:59:19 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:40.665 04:59:19 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:40.665 04:59:19 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:40.665 04:59:19 -- common/autotest_common.sh@641 -- # es=1 00:14:40.665 04:59:19 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:40.665 04:59:19 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:40.665 04:59:19 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:40.665 04:59:19 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:14:40.665 04:59:19 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:40.665 04:59:19 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:40.665 [ 0]:0x2 00:14:40.665 04:59:19 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:40.665 04:59:19 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:40.665 04:59:19 -- target/ns_masking.sh@40 -- # nguid=0883d710b4f04a568ae3732310b83da0 00:14:40.665 04:59:19 -- target/ns_masking.sh@41 -- # [[ 0883d710b4f04a568ae3732310b83da0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:40.665 04:59:19 -- target/ns_masking.sh@91 -- # disconnect 00:14:40.665 04:59:19 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:40.665 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:40.665 04:59:19 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:40.924 04:59:19 -- target/ns_masking.sh@95 -- # connect 2 00:14:40.924 04:59:19 -- target/ns_masking.sh@18 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 4237986c-6594-4842-bb94-17722771653f -a 10.0.0.2 -s 4420 -i 4 00:14:40.924 04:59:20 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:40.924 04:59:20 -- common/autotest_common.sh@1184 -- # local i=0 00:14:40.924 04:59:20 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:40.924 04:59:20 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:14:40.924 04:59:20 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:14:40.924 04:59:20 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:43.458 04:59:22 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:43.458 04:59:22 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:43.458 04:59:22 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:43.458 04:59:22 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:14:43.458 04:59:22 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:43.458 04:59:22 -- common/autotest_common.sh@1194 -- # return 0 00:14:43.458 04:59:22 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:14:43.458 04:59:22 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:43.458 04:59:22 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:14:43.458 04:59:22 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:14:43.458 04:59:22 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:14:43.458 04:59:22 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.458 04:59:22 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:43.458 [ 0]:0x1 00:14:43.458 04:59:22 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:43.458 04:59:22 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.458 04:59:22 -- target/ns_masking.sh@40 -- # nguid=f0398ca26917445d964ee74a759bee24 00:14:43.458 04:59:22 -- target/ns_masking.sh@41 -- # [[ f0398ca26917445d964ee74a759bee24 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.458 04:59:22 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:14:43.458 04:59:22 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.458 04:59:22 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:43.458 [ 1]:0x2 00:14:43.458 04:59:22 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:43.458 04:59:22 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.458 04:59:22 -- target/ns_masking.sh@40 -- # nguid=0883d710b4f04a568ae3732310b83da0 00:14:43.459 04:59:22 -- target/ns_masking.sh@41 -- # [[ 0883d710b4f04a568ae3732310b83da0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.459 04:59:22 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:43.717 04:59:22 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:14:43.717 04:59:22 -- common/autotest_common.sh@638 -- # local es=0 00:14:43.717 04:59:22 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:43.717 04:59:22 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:43.717 04:59:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.717 04:59:22 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:43.717 04:59:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.717 04:59:22 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:43.717 04:59:22 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.717 04:59:22 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:43.717 04:59:22 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:43.717 04:59:22 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.717 04:59:22 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:43.717 04:59:22 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.717 04:59:22 -- common/autotest_common.sh@641 -- # es=1 00:14:43.717 04:59:22 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:43.717 04:59:22 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:43.717 04:59:22 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:43.717 04:59:22 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:14:43.717 04:59:22 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.717 04:59:22 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:43.717 [ 0]:0x2 00:14:43.717 04:59:22 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:43.717 04:59:22 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.717 04:59:22 -- target/ns_masking.sh@40 -- # nguid=0883d710b4f04a568ae3732310b83da0 00:14:43.717 04:59:22 -- target/ns_masking.sh@41 -- # [[ 0883d710b4f04a568ae3732310b83da0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.717 04:59:22 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:43.717 04:59:22 -- common/autotest_common.sh@638 -- # local es=0 00:14:43.717 04:59:22 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:43.717 04:59:22 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:43.717 04:59:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.717 04:59:22 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:43.717 04:59:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.717 04:59:22 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:43.717 04:59:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.717 04:59:22 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:43.717 04:59:22 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:43.717 04:59:22 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:43.974 [2024-04-23 04:59:23.010631] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:14:43.974 request: 00:14:43.974 { 00:14:43.974 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:14:43.974 "nsid": 2, 00:14:43.974 "host": "nqn.2016-06.io.spdk:host1", 00:14:43.974 "method": "nvmf_ns_remove_host", 00:14:43.974 "req_id": 1 00:14:43.974 } 00:14:43.974 Got JSON-RPC error response 00:14:43.974 response: 00:14:43.974 { 00:14:43.974 "code": -32602, 00:14:43.974 "message": "Invalid parameters" 00:14:43.974 } 00:14:43.974 04:59:23 -- common/autotest_common.sh@641 -- # es=1 00:14:43.974 04:59:23 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:43.974 04:59:23 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:43.974 04:59:23 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:43.974 04:59:23 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:14:43.974 04:59:23 -- common/autotest_common.sh@638 -- # local es=0 00:14:43.974 04:59:23 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:43.974 04:59:23 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:43.974 04:59:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.974 04:59:23 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:43.974 04:59:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.974 04:59:23 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:43.974 04:59:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.974 04:59:23 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:43.974 04:59:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:43.974 04:59:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.974 04:59:23 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:43.974 04:59:23 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.974 04:59:23 -- common/autotest_common.sh@641 -- # es=1 00:14:43.974 04:59:23 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:43.974 04:59:23 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:43.974 04:59:23 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:43.974 04:59:23 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:14:43.974 04:59:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.974 04:59:23 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:43.974 [ 0]:0x2 00:14:43.974 04:59:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:43.974 04:59:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.974 04:59:23 -- target/ns_masking.sh@40 -- # nguid=0883d710b4f04a568ae3732310b83da0 00:14:43.974 04:59:23 -- target/ns_masking.sh@41 -- # [[ 0883d710b4f04a568ae3732310b83da0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.974 04:59:23 -- target/ns_masking.sh@108 -- # disconnect 00:14:43.974 04:59:23 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:44.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:44.230 04:59:23 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:44.488 04:59:23 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:14:44.488 04:59:23 -- target/ns_masking.sh@114 -- # nvmftestfini 00:14:44.488 04:59:23 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:44.488 04:59:23 -- nvmf/common.sh@117 -- # sync 00:14:44.488 04:59:23 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:44.488 04:59:23 -- nvmf/common.sh@120 -- # set +e 00:14:44.488 04:59:23 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:44.488 04:59:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:44.488 rmmod nvme_tcp 00:14:44.488 rmmod nvme_fabrics 00:14:44.488 rmmod nvme_keyring 00:14:44.488 04:59:23 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:44.488 04:59:23 -- nvmf/common.sh@124 -- # set -e 00:14:44.488 04:59:23 -- nvmf/common.sh@125 -- # return 0 00:14:44.488 04:59:23 -- nvmf/common.sh@478 -- # '[' -n 2358089 ']' 00:14:44.488 04:59:23 -- nvmf/common.sh@479 -- # killprocess 2358089 00:14:44.488 04:59:23 -- common/autotest_common.sh@936 -- # '[' -z 2358089 ']' 00:14:44.488 04:59:23 -- common/autotest_common.sh@940 -- # kill -0 2358089 00:14:44.488 04:59:23 -- common/autotest_common.sh@941 -- # uname 00:14:44.488 04:59:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:44.488 04:59:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2358089 00:14:44.488 04:59:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:44.488 04:59:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:44.488 04:59:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2358089' 00:14:44.488 killing process with pid 2358089 00:14:44.488 04:59:23 -- common/autotest_common.sh@955 -- # kill 2358089 00:14:44.488 04:59:23 -- common/autotest_common.sh@960 -- # wait 2358089 00:14:44.747 04:59:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:44.747 04:59:23 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:44.747 04:59:23 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:44.747 04:59:23 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:44.747 04:59:23 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:44.747 04:59:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.747 04:59:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.747 04:59:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.283 04:59:25 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:47.283 00:14:47.283 real 0m16.376s 00:14:47.283 user 0m50.838s 00:14:47.283 sys 0m3.678s 00:14:47.283 04:59:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:47.283 04:59:25 -- common/autotest_common.sh@10 -- # set +x 00:14:47.283 ************************************ 00:14:47.283 END TEST nvmf_ns_masking 00:14:47.283 ************************************ 00:14:47.283 04:59:25 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:14:47.283 04:59:25 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:47.283 04:59:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:47.283 04:59:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:47.283 04:59:25 -- common/autotest_common.sh@10 -- # set +x 00:14:47.283 ************************************ 00:14:47.283 START TEST nvmf_nvme_cli 00:14:47.283 ************************************ 00:14:47.283 04:59:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:47.283 * Looking for test storage... 00:14:47.283 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:47.283 04:59:25 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:47.283 04:59:25 -- nvmf/common.sh@7 -- # uname -s 00:14:47.283 04:59:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:47.283 04:59:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:47.283 04:59:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:47.283 04:59:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:47.283 04:59:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:47.283 04:59:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:47.283 04:59:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:47.284 04:59:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:47.284 04:59:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:47.284 04:59:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:47.284 04:59:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.284 04:59:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.284 04:59:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:47.284 04:59:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:47.284 04:59:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:47.284 04:59:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:47.284 04:59:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:47.284 04:59:26 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:47.284 04:59:26 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:47.284 04:59:26 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:47.284 04:59:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.284 04:59:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.284 04:59:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.284 04:59:26 -- paths/export.sh@5 -- # export PATH 00:14:47.284 04:59:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.284 04:59:26 -- nvmf/common.sh@47 -- # : 0 00:14:47.284 04:59:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:47.284 04:59:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:47.284 04:59:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:47.284 04:59:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:47.284 04:59:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:47.284 04:59:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:47.284 04:59:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:47.284 04:59:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:47.284 04:59:26 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:47.284 04:59:26 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:47.284 04:59:26 -- target/nvme_cli.sh@14 -- # devs=() 00:14:47.284 04:59:26 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:47.284 04:59:26 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:14:47.284 04:59:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:47.284 04:59:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:47.284 04:59:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:47.284 04:59:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:47.284 04:59:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:47.284 04:59:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:47.284 04:59:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.284 04:59:26 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:47.284 04:59:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:47.284 04:59:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:47.284 04:59:26 -- common/autotest_common.sh@10 -- # set +x 00:14:49.193 04:59:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:49.193 04:59:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:49.193 04:59:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:49.193 04:59:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:49.193 04:59:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:49.193 04:59:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:49.193 04:59:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:49.193 04:59:27 -- nvmf/common.sh@295 -- # net_devs=() 00:14:49.193 04:59:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:49.193 04:59:27 -- nvmf/common.sh@296 -- # e810=() 00:14:49.193 04:59:27 -- nvmf/common.sh@296 -- # local -ga e810 00:14:49.193 04:59:27 -- nvmf/common.sh@297 -- # x722=() 00:14:49.193 04:59:27 -- nvmf/common.sh@297 -- # local -ga x722 00:14:49.193 04:59:27 -- nvmf/common.sh@298 -- # mlx=() 00:14:49.193 04:59:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:49.193 04:59:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:49.193 04:59:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:49.193 04:59:27 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:49.193 04:59:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:49.193 04:59:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:49.193 04:59:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:49.193 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:49.193 04:59:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:49.193 04:59:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:49.193 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:49.193 04:59:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:49.193 04:59:27 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:49.193 04:59:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:49.193 04:59:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:49.193 04:59:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:49.193 04:59:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:49.193 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:49.193 04:59:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:49.193 04:59:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:49.193 04:59:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:49.193 04:59:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:49.193 04:59:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:49.193 04:59:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:49.193 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:49.193 04:59:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:49.193 04:59:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:49.193 04:59:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:49.193 04:59:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:14:49.193 04:59:27 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:14:49.193 04:59:27 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:49.193 04:59:27 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:49.193 04:59:27 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:49.193 04:59:27 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:14:49.193 04:59:27 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:49.193 04:59:27 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:49.193 04:59:27 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:14:49.193 04:59:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:49.193 04:59:27 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:49.193 04:59:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:14:49.193 04:59:27 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:14:49.193 04:59:27 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:14:49.193 04:59:27 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:49.194 04:59:28 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:49.194 04:59:28 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:49.194 04:59:28 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:14:49.194 04:59:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:49.194 04:59:28 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:49.194 04:59:28 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:49.194 04:59:28 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:14:49.194 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:49.194 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:14:49.194 00:14:49.194 --- 10.0.0.2 ping statistics --- 00:14:49.194 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:49.194 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:14:49.194 04:59:28 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:49.194 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:49.194 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:14:49.194 00:14:49.194 --- 10.0.0.1 ping statistics --- 00:14:49.194 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:49.194 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:14:49.194 04:59:28 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:49.194 04:59:28 -- nvmf/common.sh@411 -- # return 0 00:14:49.194 04:59:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:49.194 04:59:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:49.194 04:59:28 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:14:49.194 04:59:28 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:14:49.194 04:59:28 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:49.194 04:59:28 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:14:49.194 04:59:28 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:14:49.194 04:59:28 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:49.194 04:59:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:49.194 04:59:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:49.194 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.194 04:59:28 -- nvmf/common.sh@470 -- # nvmfpid=2361641 00:14:49.194 04:59:28 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:49.194 04:59:28 -- nvmf/common.sh@471 -- # waitforlisten 2361641 00:14:49.194 04:59:28 -- common/autotest_common.sh@817 -- # '[' -z 2361641 ']' 00:14:49.194 04:59:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:49.194 04:59:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:49.194 04:59:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:49.194 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:49.194 04:59:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:49.194 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.194 [2024-04-23 04:59:28.145989] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:14:49.194 [2024-04-23 04:59:28.146075] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:49.194 EAL: No free 2048 kB hugepages reported on node 1 00:14:49.194 [2024-04-23 04:59:28.190015] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:14:49.194 [2024-04-23 04:59:28.221281] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:49.194 [2024-04-23 04:59:28.314043] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:49.194 [2024-04-23 04:59:28.314110] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:49.194 [2024-04-23 04:59:28.314146] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:49.194 [2024-04-23 04:59:28.314161] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:49.194 [2024-04-23 04:59:28.314174] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:49.194 [2024-04-23 04:59:28.314274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:49.194 [2024-04-23 04:59:28.314338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:49.194 [2024-04-23 04:59:28.314390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:49.194 [2024-04-23 04:59:28.314393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:49.454 04:59:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:49.454 04:59:28 -- common/autotest_common.sh@850 -- # return 0 00:14:49.454 04:59:28 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:49.454 04:59:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:49.454 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.454 04:59:28 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:49.454 04:59:28 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:49.454 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.454 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.454 [2024-04-23 04:59:28.477426] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:49.454 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.454 04:59:28 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:49.454 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.454 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.454 Malloc0 00:14:49.454 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.454 04:59:28 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:49.454 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.454 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.454 Malloc1 00:14:49.454 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.454 04:59:28 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:49.454 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.455 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.455 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.455 04:59:28 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:49.455 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.455 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.455 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.455 04:59:28 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:49.455 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.455 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.455 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.455 04:59:28 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:49.455 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.455 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.455 [2024-04-23 04:59:28.563181] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:49.455 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.455 04:59:28 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:49.455 04:59:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.455 04:59:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.455 04:59:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.455 04:59:28 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:49.713 00:14:49.714 Discovery Log Number of Records 2, Generation counter 2 00:14:49.714 =====Discovery Log Entry 0====== 00:14:49.714 trtype: tcp 00:14:49.714 adrfam: ipv4 00:14:49.714 subtype: current discovery subsystem 00:14:49.714 treq: not required 00:14:49.714 portid: 0 00:14:49.714 trsvcid: 4420 00:14:49.714 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:49.714 traddr: 10.0.0.2 00:14:49.714 eflags: explicit discovery connections, duplicate discovery information 00:14:49.714 sectype: none 00:14:49.714 =====Discovery Log Entry 1====== 00:14:49.714 trtype: tcp 00:14:49.714 adrfam: ipv4 00:14:49.714 subtype: nvme subsystem 00:14:49.714 treq: not required 00:14:49.714 portid: 0 00:14:49.714 trsvcid: 4420 00:14:49.714 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:49.714 traddr: 10.0.0.2 00:14:49.714 eflags: none 00:14:49.714 sectype: none 00:14:49.714 04:59:28 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:49.714 04:59:28 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:49.714 04:59:28 -- nvmf/common.sh@511 -- # local dev _ 00:14:49.714 04:59:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:49.714 04:59:28 -- nvmf/common.sh@510 -- # nvme list 00:14:49.714 04:59:28 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:14:49.714 04:59:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:49.714 04:59:28 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:14:49.714 04:59:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:49.714 04:59:28 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:49.714 04:59:28 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:50.283 04:59:29 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:50.283 04:59:29 -- common/autotest_common.sh@1184 -- # local i=0 00:14:50.283 04:59:29 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:50.283 04:59:29 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:14:50.283 04:59:29 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:14:50.283 04:59:29 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:52.211 04:59:31 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:52.211 04:59:31 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:52.211 04:59:31 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:52.211 04:59:31 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:14:52.211 04:59:31 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:52.211 04:59:31 -- common/autotest_common.sh@1194 -- # return 0 00:14:52.211 04:59:31 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:52.211 04:59:31 -- nvmf/common.sh@511 -- # local dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@510 -- # nvme list 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:14:52.211 /dev/nvme0n1 ]] 00:14:52.211 04:59:31 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:52.211 04:59:31 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:52.211 04:59:31 -- nvmf/common.sh@511 -- # local dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@510 -- # nvme list 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:52.211 04:59:31 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:14:52.211 04:59:31 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:52.211 04:59:31 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:52.211 04:59:31 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:52.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:52.211 04:59:31 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:52.211 04:59:31 -- common/autotest_common.sh@1205 -- # local i=0 00:14:52.211 04:59:31 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:52.211 04:59:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:52.472 04:59:31 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:52.472 04:59:31 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:52.472 04:59:31 -- common/autotest_common.sh@1217 -- # return 0 00:14:52.472 04:59:31 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:52.472 04:59:31 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:52.472 04:59:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:52.472 04:59:31 -- common/autotest_common.sh@10 -- # set +x 00:14:52.472 04:59:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:52.472 04:59:31 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:52.472 04:59:31 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:52.472 04:59:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:52.472 04:59:31 -- nvmf/common.sh@117 -- # sync 00:14:52.472 04:59:31 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:52.472 04:59:31 -- nvmf/common.sh@120 -- # set +e 00:14:52.472 04:59:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:52.472 04:59:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:52.472 rmmod nvme_tcp 00:14:52.472 rmmod nvme_fabrics 00:14:52.472 rmmod nvme_keyring 00:14:52.472 04:59:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:52.472 04:59:31 -- nvmf/common.sh@124 -- # set -e 00:14:52.472 04:59:31 -- nvmf/common.sh@125 -- # return 0 00:14:52.472 04:59:31 -- nvmf/common.sh@478 -- # '[' -n 2361641 ']' 00:14:52.472 04:59:31 -- nvmf/common.sh@479 -- # killprocess 2361641 00:14:52.472 04:59:31 -- common/autotest_common.sh@936 -- # '[' -z 2361641 ']' 00:14:52.472 04:59:31 -- common/autotest_common.sh@940 -- # kill -0 2361641 00:14:52.472 04:59:31 -- common/autotest_common.sh@941 -- # uname 00:14:52.472 04:59:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:52.472 04:59:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2361641 00:14:52.472 04:59:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:52.472 04:59:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:52.472 04:59:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2361641' 00:14:52.472 killing process with pid 2361641 00:14:52.472 04:59:31 -- common/autotest_common.sh@955 -- # kill 2361641 00:14:52.472 04:59:31 -- common/autotest_common.sh@960 -- # wait 2361641 00:14:52.730 04:59:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:52.730 04:59:31 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:52.730 04:59:31 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:52.730 04:59:31 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:52.730 04:59:31 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:52.730 04:59:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:52.730 04:59:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:52.730 04:59:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:54.633 04:59:33 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:54.633 00:14:54.633 real 0m7.846s 00:14:54.633 user 0m14.156s 00:14:54.633 sys 0m2.025s 00:14:54.633 04:59:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:54.633 04:59:33 -- common/autotest_common.sh@10 -- # set +x 00:14:54.633 ************************************ 00:14:54.633 END TEST nvmf_nvme_cli 00:14:54.633 ************************************ 00:14:54.892 04:59:33 -- nvmf/nvmf.sh@40 -- # [[ 1 -eq 1 ]] 00:14:54.892 04:59:33 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:14:54.892 04:59:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:54.892 04:59:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:54.892 04:59:33 -- common/autotest_common.sh@10 -- # set +x 00:14:54.892 ************************************ 00:14:54.892 START TEST nvmf_vfio_user 00:14:54.892 ************************************ 00:14:54.892 04:59:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:14:54.892 * Looking for test storage... 00:14:54.892 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:54.892 04:59:33 -- nvmf/common.sh@7 -- # uname -s 00:14:54.892 04:59:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:54.892 04:59:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:54.892 04:59:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:54.892 04:59:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:54.892 04:59:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:54.892 04:59:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:54.892 04:59:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:54.892 04:59:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:54.892 04:59:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:54.892 04:59:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:54.892 04:59:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:54.892 04:59:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:54.892 04:59:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:54.892 04:59:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:54.892 04:59:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:54.892 04:59:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:54.892 04:59:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:54.892 04:59:33 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:54.892 04:59:33 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:54.892 04:59:33 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:54.892 04:59:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.892 04:59:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.892 04:59:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.892 04:59:33 -- paths/export.sh@5 -- # export PATH 00:14:54.892 04:59:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.892 04:59:33 -- nvmf/common.sh@47 -- # : 0 00:14:54.892 04:59:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:54.892 04:59:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:54.892 04:59:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:54.892 04:59:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:54.892 04:59:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:54.892 04:59:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:54.892 04:59:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:54.892 04:59:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2362456 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2362456' 00:14:54.892 Process pid: 2362456 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:14:54.892 04:59:33 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2362456 00:14:54.892 04:59:33 -- common/autotest_common.sh@817 -- # '[' -z 2362456 ']' 00:14:54.892 04:59:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:54.892 04:59:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:54.892 04:59:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:54.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:54.892 04:59:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:54.892 04:59:33 -- common/autotest_common.sh@10 -- # set +x 00:14:54.892 [2024-04-23 04:59:34.016591] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:14:54.892 [2024-04-23 04:59:34.016689] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:54.892 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.892 [2024-04-23 04:59:34.052698] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:14:55.151 [2024-04-23 04:59:34.083459] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:55.151 [2024-04-23 04:59:34.173602] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:55.151 [2024-04-23 04:59:34.173657] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:55.151 [2024-04-23 04:59:34.173680] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:55.151 [2024-04-23 04:59:34.173691] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:55.151 [2024-04-23 04:59:34.173701] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:55.151 [2024-04-23 04:59:34.176540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.151 [2024-04-23 04:59:34.176595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:55.151 [2024-04-23 04:59:34.176672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:55.151 [2024-04-23 04:59:34.176675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:55.151 04:59:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:55.151 04:59:34 -- common/autotest_common.sh@850 -- # return 0 00:14:55.151 04:59:34 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:14:56.524 04:59:35 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:14:56.524 04:59:35 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:14:56.524 04:59:35 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:14:56.524 04:59:35 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:14:56.524 04:59:35 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:14:56.524 04:59:35 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:14:56.782 Malloc1 00:14:56.782 04:59:35 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:14:57.040 04:59:36 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:14:57.297 04:59:36 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:14:57.555 04:59:36 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:14:57.555 04:59:36 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:14:57.555 04:59:36 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:14:57.813 Malloc2 00:14:57.813 04:59:36 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:14:58.071 04:59:37 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:14:58.329 04:59:37 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:14:58.589 04:59:37 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:14:58.589 04:59:37 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:14:58.589 04:59:37 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:14:58.589 04:59:37 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:14:58.589 04:59:37 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:14:58.589 04:59:37 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:14:58.589 [2024-04-23 04:59:37.580771] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:14:58.589 [2024-04-23 04:59:37.580813] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2362878 ] 00:14:58.589 EAL: No free 2048 kB hugepages reported on node 1 00:14:58.589 [2024-04-23 04:59:37.599264] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:14:58.589 [2024-04-23 04:59:37.616849] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:14:58.589 [2024-04-23 04:59:37.624991] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:14:58.589 [2024-04-23 04:59:37.625020] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fd9c7b2c000 00:14:58.589 [2024-04-23 04:59:37.626003] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.626981] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.627984] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.628989] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.629989] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.631000] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.631999] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.633005] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:58.589 [2024-04-23 04:59:37.634013] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:14:58.589 [2024-04-23 04:59:37.634033] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fd9c68dd000 00:14:58.589 [2024-04-23 04:59:37.635149] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:14:58.589 [2024-04-23 04:59:37.651106] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:14:58.589 [2024-04-23 04:59:37.651144] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:14:58.589 [2024-04-23 04:59:37.656138] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:14:58.589 [2024-04-23 04:59:37.656190] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:14:58.589 [2024-04-23 04:59:37.656284] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:14:58.589 [2024-04-23 04:59:37.656318] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:14:58.589 [2024-04-23 04:59:37.656329] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:14:58.589 [2024-04-23 04:59:37.657134] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:14:58.589 [2024-04-23 04:59:37.657154] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:14:58.589 [2024-04-23 04:59:37.657166] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:14:58.589 [2024-04-23 04:59:37.658132] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:14:58.589 [2024-04-23 04:59:37.658150] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:14:58.589 [2024-04-23 04:59:37.658164] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:14:58.589 [2024-04-23 04:59:37.659135] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:14:58.589 [2024-04-23 04:59:37.659153] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:14:58.589 [2024-04-23 04:59:37.660139] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:14:58.589 [2024-04-23 04:59:37.660158] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:14:58.589 [2024-04-23 04:59:37.660168] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:14:58.589 [2024-04-23 04:59:37.660179] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:14:58.590 [2024-04-23 04:59:37.660293] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:14:58.590 [2024-04-23 04:59:37.660302] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:14:58.590 [2024-04-23 04:59:37.660311] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:14:58.590 [2024-04-23 04:59:37.661148] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:14:58.590 [2024-04-23 04:59:37.662148] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:14:58.590 [2024-04-23 04:59:37.663155] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:14:58.590 [2024-04-23 04:59:37.664150] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:58.590 [2024-04-23 04:59:37.664242] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:14:58.590 [2024-04-23 04:59:37.665166] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:14:58.590 [2024-04-23 04:59:37.665184] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:14:58.590 [2024-04-23 04:59:37.665193] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665217] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:14:58.590 [2024-04-23 04:59:37.665234] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665265] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:58.590 [2024-04-23 04:59:37.665275] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:58.590 [2024-04-23 04:59:37.665297] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.665356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.665375] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:14:58.590 [2024-04-23 04:59:37.665383] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:14:58.590 [2024-04-23 04:59:37.665391] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:14:58.590 [2024-04-23 04:59:37.665398] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:14:58.590 [2024-04-23 04:59:37.665406] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:14:58.590 [2024-04-23 04:59:37.665414] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:14:58.590 [2024-04-23 04:59:37.665421] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665434] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665449] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.665465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.665487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:14:58.590 [2024-04-23 04:59:37.665521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:14:58.590 [2024-04-23 04:59:37.665535] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:14:58.590 [2024-04-23 04:59:37.665547] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:14:58.590 [2024-04-23 04:59:37.665556] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665572] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665587] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.665621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.665634] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:14:58.590 [2024-04-23 04:59:37.665642] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665660] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665671] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665685] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.665701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.665753] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665767] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665781] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:14:58.590 [2024-04-23 04:59:37.665789] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:14:58.590 [2024-04-23 04:59:37.665798] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.665827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.665844] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:14:58.590 [2024-04-23 04:59:37.665860] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665874] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665888] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:58.590 [2024-04-23 04:59:37.665897] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:58.590 [2024-04-23 04:59:37.665906] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.665930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.665954] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665968] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.665979] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:58.590 [2024-04-23 04:59:37.665987] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:58.590 [2024-04-23 04:59:37.665996] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.666013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.666028] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.666039] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.666054] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.666065] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.666073] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.666082] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:14:58.590 [2024-04-23 04:59:37.666089] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:14:58.590 [2024-04-23 04:59:37.666097] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:14:58.590 [2024-04-23 04:59:37.666125] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.666143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.666162] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.666174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.666189] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.666201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.666216] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:14:58.590 [2024-04-23 04:59:37.666227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:14:58.590 [2024-04-23 04:59:37.666249] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:14:58.590 [2024-04-23 04:59:37.666258] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:14:58.590 [2024-04-23 04:59:37.666264] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:14:58.590 [2024-04-23 04:59:37.666270] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:14:58.590 [2024-04-23 04:59:37.666279] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:14:58.591 [2024-04-23 04:59:37.666290] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:14:58.591 [2024-04-23 04:59:37.666298] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:14:58.591 [2024-04-23 04:59:37.666307] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:14:58.591 [2024-04-23 04:59:37.666317] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:14:58.591 [2024-04-23 04:59:37.666325] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:58.591 [2024-04-23 04:59:37.666333] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:58.591 [2024-04-23 04:59:37.666345] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:14:58.591 [2024-04-23 04:59:37.666352] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:14:58.591 [2024-04-23 04:59:37.666361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:14:58.591 [2024-04-23 04:59:37.666372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:14:58.591 [2024-04-23 04:59:37.666392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:14:58.591 [2024-04-23 04:59:37.666407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:14:58.591 [2024-04-23 04:59:37.666419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:14:58.591 ===================================================== 00:14:58.591 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:14:58.591 ===================================================== 00:14:58.591 Controller Capabilities/Features 00:14:58.591 ================================ 00:14:58.591 Vendor ID: 4e58 00:14:58.591 Subsystem Vendor ID: 4e58 00:14:58.591 Serial Number: SPDK1 00:14:58.591 Model Number: SPDK bdev Controller 00:14:58.591 Firmware Version: 24.05 00:14:58.591 Recommended Arb Burst: 6 00:14:58.591 IEEE OUI Identifier: 8d 6b 50 00:14:58.591 Multi-path I/O 00:14:58.591 May have multiple subsystem ports: Yes 00:14:58.591 May have multiple controllers: Yes 00:14:58.591 Associated with SR-IOV VF: No 00:14:58.591 Max Data Transfer Size: 131072 00:14:58.591 Max Number of Namespaces: 32 00:14:58.591 Max Number of I/O Queues: 127 00:14:58.591 NVMe Specification Version (VS): 1.3 00:14:58.591 NVMe Specification Version (Identify): 1.3 00:14:58.591 Maximum Queue Entries: 256 00:14:58.591 Contiguous Queues Required: Yes 00:14:58.591 Arbitration Mechanisms Supported 00:14:58.591 Weighted Round Robin: Not Supported 00:14:58.591 Vendor Specific: Not Supported 00:14:58.591 Reset Timeout: 15000 ms 00:14:58.591 Doorbell Stride: 4 bytes 00:14:58.591 NVM Subsystem Reset: Not Supported 00:14:58.591 Command Sets Supported 00:14:58.591 NVM Command Set: Supported 00:14:58.591 Boot Partition: Not Supported 00:14:58.591 Memory Page Size Minimum: 4096 bytes 00:14:58.591 Memory Page Size Maximum: 4096 bytes 00:14:58.591 Persistent Memory Region: Not Supported 00:14:58.591 Optional Asynchronous Events Supported 00:14:58.591 Namespace Attribute Notices: Supported 00:14:58.591 Firmware Activation Notices: Not Supported 00:14:58.591 ANA Change Notices: Not Supported 00:14:58.591 PLE Aggregate Log Change Notices: Not Supported 00:14:58.591 LBA Status Info Alert Notices: Not Supported 00:14:58.591 EGE Aggregate Log Change Notices: Not Supported 00:14:58.591 Normal NVM Subsystem Shutdown event: Not Supported 00:14:58.591 Zone Descriptor Change Notices: Not Supported 00:14:58.591 Discovery Log Change Notices: Not Supported 00:14:58.591 Controller Attributes 00:14:58.591 128-bit Host Identifier: Supported 00:14:58.591 Non-Operational Permissive Mode: Not Supported 00:14:58.591 NVM Sets: Not Supported 00:14:58.591 Read Recovery Levels: Not Supported 00:14:58.591 Endurance Groups: Not Supported 00:14:58.591 Predictable Latency Mode: Not Supported 00:14:58.591 Traffic Based Keep ALive: Not Supported 00:14:58.591 Namespace Granularity: Not Supported 00:14:58.591 SQ Associations: Not Supported 00:14:58.591 UUID List: Not Supported 00:14:58.591 Multi-Domain Subsystem: Not Supported 00:14:58.591 Fixed Capacity Management: Not Supported 00:14:58.591 Variable Capacity Management: Not Supported 00:14:58.591 Delete Endurance Group: Not Supported 00:14:58.591 Delete NVM Set: Not Supported 00:14:58.591 Extended LBA Formats Supported: Not Supported 00:14:58.591 Flexible Data Placement Supported: Not Supported 00:14:58.591 00:14:58.591 Controller Memory Buffer Support 00:14:58.591 ================================ 00:14:58.591 Supported: No 00:14:58.591 00:14:58.591 Persistent Memory Region Support 00:14:58.591 ================================ 00:14:58.591 Supported: No 00:14:58.591 00:14:58.591 Admin Command Set Attributes 00:14:58.591 ============================ 00:14:58.591 Security Send/Receive: Not Supported 00:14:58.591 Format NVM: Not Supported 00:14:58.591 Firmware Activate/Download: Not Supported 00:14:58.591 Namespace Management: Not Supported 00:14:58.591 Device Self-Test: Not Supported 00:14:58.591 Directives: Not Supported 00:14:58.591 NVMe-MI: Not Supported 00:14:58.591 Virtualization Management: Not Supported 00:14:58.591 Doorbell Buffer Config: Not Supported 00:14:58.591 Get LBA Status Capability: Not Supported 00:14:58.591 Command & Feature Lockdown Capability: Not Supported 00:14:58.591 Abort Command Limit: 4 00:14:58.591 Async Event Request Limit: 4 00:14:58.591 Number of Firmware Slots: N/A 00:14:58.591 Firmware Slot 1 Read-Only: N/A 00:14:58.591 Firmware Activation Without Reset: N/A 00:14:58.591 Multiple Update Detection Support: N/A 00:14:58.591 Firmware Update Granularity: No Information Provided 00:14:58.591 Per-Namespace SMART Log: No 00:14:58.591 Asymmetric Namespace Access Log Page: Not Supported 00:14:58.591 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:14:58.591 Command Effects Log Page: Supported 00:14:58.591 Get Log Page Extended Data: Supported 00:14:58.591 Telemetry Log Pages: Not Supported 00:14:58.591 Persistent Event Log Pages: Not Supported 00:14:58.591 Supported Log Pages Log Page: May Support 00:14:58.591 Commands Supported & Effects Log Page: Not Supported 00:14:58.591 Feature Identifiers & Effects Log Page:May Support 00:14:58.591 NVMe-MI Commands & Effects Log Page: May Support 00:14:58.591 Data Area 4 for Telemetry Log: Not Supported 00:14:58.591 Error Log Page Entries Supported: 128 00:14:58.591 Keep Alive: Supported 00:14:58.591 Keep Alive Granularity: 10000 ms 00:14:58.591 00:14:58.591 NVM Command Set Attributes 00:14:58.591 ========================== 00:14:58.591 Submission Queue Entry Size 00:14:58.591 Max: 64 00:14:58.591 Min: 64 00:14:58.591 Completion Queue Entry Size 00:14:58.591 Max: 16 00:14:58.591 Min: 16 00:14:58.591 Number of Namespaces: 32 00:14:58.591 Compare Command: Supported 00:14:58.591 Write Uncorrectable Command: Not Supported 00:14:58.591 Dataset Management Command: Supported 00:14:58.591 Write Zeroes Command: Supported 00:14:58.591 Set Features Save Field: Not Supported 00:14:58.591 Reservations: Not Supported 00:14:58.591 Timestamp: Not Supported 00:14:58.591 Copy: Supported 00:14:58.591 Volatile Write Cache: Present 00:14:58.591 Atomic Write Unit (Normal): 1 00:14:58.591 Atomic Write Unit (PFail): 1 00:14:58.591 Atomic Compare & Write Unit: 1 00:14:58.591 Fused Compare & Write: Supported 00:14:58.591 Scatter-Gather List 00:14:58.591 SGL Command Set: Supported (Dword aligned) 00:14:58.591 SGL Keyed: Not Supported 00:14:58.591 SGL Bit Bucket Descriptor: Not Supported 00:14:58.591 SGL Metadata Pointer: Not Supported 00:14:58.591 Oversized SGL: Not Supported 00:14:58.591 SGL Metadata Address: Not Supported 00:14:58.591 SGL Offset: Not Supported 00:14:58.591 Transport SGL Data Block: Not Supported 00:14:58.591 Replay Protected Memory Block: Not Supported 00:14:58.591 00:14:58.591 Firmware Slot Information 00:14:58.591 ========================= 00:14:58.591 Active slot: 1 00:14:58.591 Slot 1 Firmware Revision: 24.05 00:14:58.591 00:14:58.591 00:14:58.591 Commands Supported and Effects 00:14:58.591 ============================== 00:14:58.591 Admin Commands 00:14:58.591 -------------- 00:14:58.591 Get Log Page (02h): Supported 00:14:58.591 Identify (06h): Supported 00:14:58.591 Abort (08h): Supported 00:14:58.591 Set Features (09h): Supported 00:14:58.591 Get Features (0Ah): Supported 00:14:58.591 Asynchronous Event Request (0Ch): Supported 00:14:58.591 Keep Alive (18h): Supported 00:14:58.591 I/O Commands 00:14:58.591 ------------ 00:14:58.592 Flush (00h): Supported LBA-Change 00:14:58.592 Write (01h): Supported LBA-Change 00:14:58.592 Read (02h): Supported 00:14:58.592 Compare (05h): Supported 00:14:58.592 Write Zeroes (08h): Supported LBA-Change 00:14:58.592 Dataset Management (09h): Supported LBA-Change 00:14:58.592 Copy (19h): Supported LBA-Change 00:14:58.592 Unknown (79h): Supported LBA-Change 00:14:58.592 Unknown (7Ah): Supported 00:14:58.592 00:14:58.592 Error Log 00:14:58.592 ========= 00:14:58.592 00:14:58.592 Arbitration 00:14:58.592 =========== 00:14:58.592 Arbitration Burst: 1 00:14:58.592 00:14:58.592 Power Management 00:14:58.592 ================ 00:14:58.592 Number of Power States: 1 00:14:58.592 Current Power State: Power State #0 00:14:58.592 Power State #0: 00:14:58.592 Max Power: 0.00 W 00:14:58.592 Non-Operational State: Operational 00:14:58.592 Entry Latency: Not Reported 00:14:58.592 Exit Latency: Not Reported 00:14:58.592 Relative Read Throughput: 0 00:14:58.592 Relative Read Latency: 0 00:14:58.592 Relative Write Throughput: 0 00:14:58.592 Relative Write Latency: 0 00:14:58.592 Idle Power: Not Reported 00:14:58.592 Active Power: Not Reported 00:14:58.592 Non-Operational Permissive Mode: Not Supported 00:14:58.592 00:14:58.592 Health Information 00:14:58.592 ================== 00:14:58.592 Critical Warnings: 00:14:58.592 Available Spare Space: OK 00:14:58.592 Temperature: OK 00:14:58.592 Device Reliability: OK 00:14:58.592 Read Only: No 00:14:58.592 Volatile Memory Backup: OK 00:14:58.592 Current Temperature: 0 Kelvin (-2[2024-04-23 04:59:37.666567] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:14:58.592 [2024-04-23 04:59:37.666584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:14:58.592 [2024-04-23 04:59:37.666625] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:14:58.592 [2024-04-23 04:59:37.666643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:58.592 [2024-04-23 04:59:37.666654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:58.592 [2024-04-23 04:59:37.666664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:58.592 [2024-04-23 04:59:37.666674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:58.592 [2024-04-23 04:59:37.670529] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:14:58.592 [2024-04-23 04:59:37.670552] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:14:58.592 [2024-04-23 04:59:37.671191] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:58.592 [2024-04-23 04:59:37.671266] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:14:58.592 [2024-04-23 04:59:37.671280] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:14:58.592 [2024-04-23 04:59:37.672202] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:14:58.592 [2024-04-23 04:59:37.672224] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:14:58.592 [2024-04-23 04:59:37.672281] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:14:58.592 [2024-04-23 04:59:37.674239] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:14:58.592 73 Celsius) 00:14:58.592 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:14:58.592 Available Spare: 0% 00:14:58.592 Available Spare Threshold: 0% 00:14:58.592 Life Percentage Used: 0% 00:14:58.592 Data Units Read: 0 00:14:58.592 Data Units Written: 0 00:14:58.592 Host Read Commands: 0 00:14:58.592 Host Write Commands: 0 00:14:58.592 Controller Busy Time: 0 minutes 00:14:58.592 Power Cycles: 0 00:14:58.592 Power On Hours: 0 hours 00:14:58.592 Unsafe Shutdowns: 0 00:14:58.592 Unrecoverable Media Errors: 0 00:14:58.592 Lifetime Error Log Entries: 0 00:14:58.592 Warning Temperature Time: 0 minutes 00:14:58.592 Critical Temperature Time: 0 minutes 00:14:58.592 00:14:58.592 Number of Queues 00:14:58.592 ================ 00:14:58.592 Number of I/O Submission Queues: 127 00:14:58.592 Number of I/O Completion Queues: 127 00:14:58.592 00:14:58.592 Active Namespaces 00:14:58.592 ================= 00:14:58.592 Namespace ID:1 00:14:58.592 Error Recovery Timeout: Unlimited 00:14:58.592 Command Set Identifier: NVM (00h) 00:14:58.592 Deallocate: Supported 00:14:58.592 Deallocated/Unwritten Error: Not Supported 00:14:58.592 Deallocated Read Value: Unknown 00:14:58.592 Deallocate in Write Zeroes: Not Supported 00:14:58.592 Deallocated Guard Field: 0xFFFF 00:14:58.592 Flush: Supported 00:14:58.592 Reservation: Supported 00:14:58.592 Namespace Sharing Capabilities: Multiple Controllers 00:14:58.592 Size (in LBAs): 131072 (0GiB) 00:14:58.592 Capacity (in LBAs): 131072 (0GiB) 00:14:58.592 Utilization (in LBAs): 131072 (0GiB) 00:14:58.592 NGUID: 5E0B731E10F04489BE1B919BDCE1F3E3 00:14:58.592 UUID: 5e0b731e-10f0-4489-be1b-919bdce1f3e3 00:14:58.592 Thin Provisioning: Not Supported 00:14:58.592 Per-NS Atomic Units: Yes 00:14:58.592 Atomic Boundary Size (Normal): 0 00:14:58.592 Atomic Boundary Size (PFail): 0 00:14:58.592 Atomic Boundary Offset: 0 00:14:58.592 Maximum Single Source Range Length: 65535 00:14:58.592 Maximum Copy Length: 65535 00:14:58.592 Maximum Source Range Count: 1 00:14:58.592 NGUID/EUI64 Never Reused: No 00:14:58.592 Namespace Write Protected: No 00:14:58.592 Number of LBA Formats: 1 00:14:58.592 Current LBA Format: LBA Format #00 00:14:58.592 LBA Format #00: Data Size: 512 Metadata Size: 0 00:14:58.592 00:14:58.592 04:59:37 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:14:58.592 EAL: No free 2048 kB hugepages reported on node 1 00:14:58.850 [2024-04-23 04:59:37.905336] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:15:04.117 [2024-04-23 04:59:42.924590] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:15:04.117 Initializing NVMe Controllers 00:15:04.117 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:04.117 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:04.117 Initialization complete. Launching workers. 00:15:04.117 ======================================================== 00:15:04.117 Latency(us) 00:15:04.117 Device Information : IOPS MiB/s Average min max 00:15:04.117 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 34508.40 134.80 3708.50 1186.87 7588.38 00:15:04.117 ======================================================== 00:15:04.117 Total : 34508.40 134.80 3708.50 1186.87 7588.38 00:15:04.117 00:15:04.117 04:59:42 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:04.117 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.117 [2024-04-23 04:59:43.168749] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:15:09.382 [2024-04-23 04:59:48.206187] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:15:09.382 Initializing NVMe Controllers 00:15:09.382 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:09.382 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:09.382 Initialization complete. Launching workers. 00:15:09.382 ======================================================== 00:15:09.382 Latency(us) 00:15:09.382 Device Information : IOPS MiB/s Average min max 00:15:09.382 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16025.60 62.60 7995.63 4987.99 15966.54 00:15:09.382 ======================================================== 00:15:09.382 Total : 16025.60 62.60 7995.63 4987.99 15966.54 00:15:09.382 00:15:09.382 04:59:48 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:09.382 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.382 [2024-04-23 04:59:48.406170] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:15:14.647 [2024-04-23 04:59:53.483926] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:15:14.647 Initializing NVMe Controllers 00:15:14.647 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:14.647 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:14.647 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:14.647 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:14.647 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:14.647 Initialization complete. Launching workers. 00:15:14.647 Starting thread on core 2 00:15:14.648 Starting thread on core 3 00:15:14.648 Starting thread on core 1 00:15:14.648 04:59:53 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:14.648 EAL: No free 2048 kB hugepages reported on node 1 00:15:14.648 [2024-04-23 04:59:53.788105] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:15:17.963 [2024-04-23 04:59:56.861793] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:15:17.963 Initializing NVMe Controllers 00:15:17.963 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:17.963 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:17.963 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:17.963 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:17.963 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:17.963 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:17.963 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:17.963 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:17.963 Initialization complete. Launching workers. 00:15:17.963 Starting thread on core 1 with urgent priority queue 00:15:17.963 Starting thread on core 2 with urgent priority queue 00:15:17.963 Starting thread on core 3 with urgent priority queue 00:15:17.963 Starting thread on core 0 with urgent priority queue 00:15:17.963 SPDK bdev Controller (SPDK1 ) core 0: 4658.67 IO/s 21.47 secs/100000 ios 00:15:17.963 SPDK bdev Controller (SPDK1 ) core 1: 5365.33 IO/s 18.64 secs/100000 ios 00:15:17.963 SPDK bdev Controller (SPDK1 ) core 2: 5373.33 IO/s 18.61 secs/100000 ios 00:15:17.963 SPDK bdev Controller (SPDK1 ) core 3: 5341.00 IO/s 18.72 secs/100000 ios 00:15:17.963 ======================================================== 00:15:17.963 00:15:17.963 04:59:56 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:17.963 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.220 [2024-04-23 04:59:57.163064] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:15:18.220 [2024-04-23 04:59:57.200654] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:15:18.220 Initializing NVMe Controllers 00:15:18.220 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:18.220 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:18.220 Namespace ID: 1 size: 0GB 00:15:18.220 Initialization complete. 00:15:18.220 INFO: using host memory buffer for IO 00:15:18.220 Hello world! 00:15:18.220 04:59:57 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:18.220 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.477 [2024-04-23 04:59:57.484031] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:15:19.411 Initializing NVMe Controllers 00:15:19.412 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:19.412 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:19.412 Initialization complete. Launching workers. 00:15:19.412 submit (in ns) avg, min, max = 8616.5, 3486.7, 4040694.4 00:15:19.412 complete (in ns) avg, min, max = 25866.6, 2060.0, 4045491.1 00:15:19.412 00:15:19.412 Submit histogram 00:15:19.412 ================ 00:15:19.412 Range in us Cumulative Count 00:15:19.412 3.484 - 3.508: 0.2364% ( 32) 00:15:19.412 3.508 - 3.532: 0.9676% ( 99) 00:15:19.412 3.532 - 3.556: 3.2203% ( 305) 00:15:19.412 3.556 - 3.579: 7.5559% ( 587) 00:15:19.412 3.579 - 3.603: 15.4886% ( 1074) 00:15:19.412 3.603 - 3.627: 24.4848% ( 1218) 00:15:19.412 3.627 - 3.650: 35.5639% ( 1500) 00:15:19.412 3.650 - 3.674: 44.1613% ( 1164) 00:15:19.412 3.674 - 3.698: 52.6848% ( 1154) 00:15:19.412 3.698 - 3.721: 58.7193% ( 817) 00:15:19.412 3.721 - 3.745: 64.0815% ( 726) 00:15:19.412 3.745 - 3.769: 67.6786% ( 487) 00:15:19.412 3.769 - 3.793: 71.3568% ( 498) 00:15:19.412 3.793 - 3.816: 74.0010% ( 358) 00:15:19.412 3.816 - 3.840: 76.9776% ( 403) 00:15:19.412 3.840 - 3.864: 80.4491% ( 470) 00:15:19.412 3.864 - 3.887: 83.4626% ( 408) 00:15:19.412 3.887 - 3.911: 86.1807% ( 368) 00:15:19.412 3.911 - 3.935: 88.3300% ( 291) 00:15:19.412 3.935 - 3.959: 89.6964% ( 185) 00:15:19.412 3.959 - 3.982: 91.1736% ( 200) 00:15:19.412 3.982 - 4.006: 92.2668% ( 148) 00:15:19.412 4.006 - 4.030: 93.2344% ( 131) 00:15:19.412 4.030 - 4.053: 93.8843% ( 88) 00:15:19.412 4.053 - 4.077: 94.4974% ( 83) 00:15:19.412 4.077 - 4.101: 94.9332% ( 59) 00:15:19.412 4.101 - 4.124: 95.4206% ( 66) 00:15:19.412 4.124 - 4.148: 95.7604% ( 46) 00:15:19.412 4.148 - 4.172: 96.0632% ( 41) 00:15:19.412 4.172 - 4.196: 96.2996% ( 32) 00:15:19.412 4.196 - 4.219: 96.4695% ( 23) 00:15:19.412 4.219 - 4.243: 96.6320% ( 22) 00:15:19.412 4.243 - 4.267: 96.7575% ( 17) 00:15:19.412 4.267 - 4.290: 96.8092% ( 7) 00:15:19.412 4.290 - 4.314: 96.8905% ( 11) 00:15:19.412 4.314 - 4.338: 96.9791% ( 12) 00:15:19.412 4.338 - 4.361: 97.0677% ( 12) 00:15:19.412 4.361 - 4.385: 97.1416% ( 10) 00:15:19.412 4.385 - 4.409: 97.1785% ( 5) 00:15:19.412 4.409 - 4.433: 97.2450% ( 9) 00:15:19.412 4.433 - 4.456: 97.2967% ( 7) 00:15:19.412 4.456 - 4.480: 97.3410% ( 6) 00:15:19.412 4.480 - 4.504: 97.3484% ( 1) 00:15:19.412 4.504 - 4.527: 97.3706% ( 3) 00:15:19.412 4.527 - 4.551: 97.3779% ( 1) 00:15:19.412 4.551 - 4.575: 97.3927% ( 2) 00:15:19.412 4.575 - 4.599: 97.4149% ( 3) 00:15:19.412 4.599 - 4.622: 97.4296% ( 2) 00:15:19.412 4.622 - 4.646: 97.4592% ( 4) 00:15:19.412 4.646 - 4.670: 97.4814% ( 3) 00:15:19.412 4.670 - 4.693: 97.5035% ( 3) 00:15:19.412 4.693 - 4.717: 97.5331% ( 4) 00:15:19.412 4.717 - 4.741: 97.5700% ( 5) 00:15:19.412 4.741 - 4.764: 97.6143% ( 6) 00:15:19.412 4.764 - 4.788: 97.6438% ( 4) 00:15:19.412 4.788 - 4.812: 97.7029% ( 8) 00:15:19.412 4.812 - 4.836: 97.7546% ( 7) 00:15:19.412 4.836 - 4.859: 97.7842% ( 4) 00:15:19.412 4.859 - 4.883: 97.8507% ( 9) 00:15:19.412 4.883 - 4.907: 97.8802% ( 4) 00:15:19.412 4.907 - 4.930: 97.9245% ( 6) 00:15:19.412 4.930 - 4.954: 97.9541% ( 4) 00:15:19.412 4.954 - 4.978: 98.0131% ( 8) 00:15:19.412 4.978 - 5.001: 98.0501% ( 5) 00:15:19.412 5.001 - 5.025: 98.1092% ( 8) 00:15:19.412 5.025 - 5.049: 98.1461% ( 5) 00:15:19.412 5.049 - 5.073: 98.1830% ( 5) 00:15:19.412 5.073 - 5.096: 98.2052% ( 3) 00:15:19.412 5.096 - 5.120: 98.2495% ( 6) 00:15:19.412 5.120 - 5.144: 98.2717% ( 3) 00:15:19.412 5.144 - 5.167: 98.2938% ( 3) 00:15:19.412 5.167 - 5.191: 98.3160% ( 3) 00:15:19.412 5.262 - 5.286: 98.3381% ( 3) 00:15:19.412 5.286 - 5.310: 98.3455% ( 1) 00:15:19.412 5.310 - 5.333: 98.3529% ( 1) 00:15:19.412 5.333 - 5.357: 98.3677% ( 2) 00:15:19.412 5.357 - 5.381: 98.3751% ( 1) 00:15:19.412 5.381 - 5.404: 98.3898% ( 2) 00:15:19.412 5.404 - 5.428: 98.4120% ( 3) 00:15:19.412 5.428 - 5.452: 98.4415% ( 4) 00:15:19.412 5.476 - 5.499: 98.4637% ( 3) 00:15:19.412 5.547 - 5.570: 98.4711% ( 1) 00:15:19.412 5.618 - 5.641: 98.4785% ( 1) 00:15:19.412 5.736 - 5.760: 98.4859% ( 1) 00:15:19.412 5.760 - 5.784: 98.4932% ( 1) 00:15:19.412 5.784 - 5.807: 98.5006% ( 1) 00:15:19.412 5.807 - 5.831: 98.5080% ( 1) 00:15:19.412 5.855 - 5.879: 98.5154% ( 1) 00:15:19.412 5.950 - 5.973: 98.5228% ( 1) 00:15:19.412 6.021 - 6.044: 98.5302% ( 1) 00:15:19.412 6.044 - 6.068: 98.5376% ( 1) 00:15:19.412 6.068 - 6.116: 98.5449% ( 1) 00:15:19.412 6.163 - 6.210: 98.5597% ( 2) 00:15:19.412 6.210 - 6.258: 98.5671% ( 1) 00:15:19.412 6.305 - 6.353: 98.5819% ( 2) 00:15:19.412 6.542 - 6.590: 98.5966% ( 2) 00:15:19.412 6.590 - 6.637: 98.6040% ( 1) 00:15:19.412 6.874 - 6.921: 98.6114% ( 1) 00:15:19.412 6.969 - 7.016: 98.6188% ( 1) 00:15:19.412 7.159 - 7.206: 98.6262% ( 1) 00:15:19.412 7.443 - 7.490: 98.6336% ( 1) 00:15:19.412 7.538 - 7.585: 98.6410% ( 1) 00:15:19.412 7.633 - 7.680: 98.6557% ( 2) 00:15:19.412 7.917 - 7.964: 98.6631% ( 1) 00:15:19.412 7.964 - 8.012: 98.6779% ( 2) 00:15:19.412 8.012 - 8.059: 98.6853% ( 1) 00:15:19.412 8.059 - 8.107: 98.7001% ( 2) 00:15:19.412 8.154 - 8.201: 98.7074% ( 1) 00:15:19.412 8.296 - 8.344: 98.7148% ( 1) 00:15:19.412 8.344 - 8.391: 98.7222% ( 1) 00:15:19.412 8.391 - 8.439: 98.7296% ( 1) 00:15:19.412 8.439 - 8.486: 98.7370% ( 1) 00:15:19.412 8.486 - 8.533: 98.7444% ( 1) 00:15:19.412 8.533 - 8.581: 98.7518% ( 1) 00:15:19.412 8.581 - 8.628: 98.7739% ( 3) 00:15:19.412 8.628 - 8.676: 98.7813% ( 1) 00:15:19.412 8.676 - 8.723: 98.7961% ( 2) 00:15:19.412 8.770 - 8.818: 98.8108% ( 2) 00:15:19.412 8.818 - 8.865: 98.8182% ( 1) 00:15:19.412 8.865 - 8.913: 98.8256% ( 1) 00:15:19.412 8.913 - 8.960: 98.8330% ( 1) 00:15:19.412 9.007 - 9.055: 98.8404% ( 1) 00:15:19.412 9.055 - 9.102: 98.8552% ( 2) 00:15:19.412 9.102 - 9.150: 98.8699% ( 2) 00:15:19.412 9.244 - 9.292: 98.8773% ( 1) 00:15:19.412 9.339 - 9.387: 98.8847% ( 1) 00:15:19.412 9.387 - 9.434: 98.8921% ( 1) 00:15:19.412 9.481 - 9.529: 98.8995% ( 1) 00:15:19.412 9.624 - 9.671: 98.9069% ( 1) 00:15:19.412 9.861 - 9.908: 98.9142% ( 1) 00:15:19.412 9.908 - 9.956: 98.9216% ( 1) 00:15:19.412 10.477 - 10.524: 98.9290% ( 1) 00:15:19.412 10.572 - 10.619: 98.9438% ( 2) 00:15:19.412 10.667 - 10.714: 98.9512% ( 1) 00:15:19.412 10.809 - 10.856: 98.9586% ( 1) 00:15:19.412 10.904 - 10.951: 98.9660% ( 1) 00:15:19.412 11.046 - 11.093: 98.9733% ( 1) 00:15:19.412 11.236 - 11.283: 98.9807% ( 1) 00:15:19.412 11.330 - 11.378: 98.9881% ( 1) 00:15:19.412 11.425 - 11.473: 98.9955% ( 1) 00:15:19.412 11.852 - 11.899: 99.0029% ( 1) 00:15:19.412 12.136 - 12.231: 99.0103% ( 1) 00:15:19.412 12.231 - 12.326: 99.0250% ( 2) 00:15:19.412 12.421 - 12.516: 99.0398% ( 2) 00:15:19.412 12.610 - 12.705: 99.0472% ( 1) 00:15:19.412 12.705 - 12.800: 99.0620% ( 2) 00:15:19.412 12.895 - 12.990: 99.0694% ( 1) 00:15:19.412 12.990 - 13.084: 99.0841% ( 2) 00:15:19.412 13.179 - 13.274: 99.0915% ( 1) 00:15:19.412 13.274 - 13.369: 99.0989% ( 1) 00:15:19.412 13.464 - 13.559: 99.1063% ( 1) 00:15:19.412 13.653 - 13.748: 99.1137% ( 1) 00:15:19.412 13.748 - 13.843: 99.1211% ( 1) 00:15:19.412 14.222 - 14.317: 99.1358% ( 2) 00:15:19.412 14.317 - 14.412: 99.1432% ( 1) 00:15:19.412 14.412 - 14.507: 99.1506% ( 1) 00:15:19.412 14.507 - 14.601: 99.1580% ( 1) 00:15:19.412 14.886 - 14.981: 99.1654% ( 1) 00:15:19.412 14.981 - 15.076: 99.1728% ( 1) 00:15:19.412 15.076 - 15.170: 99.1801% ( 1) 00:15:19.412 15.265 - 15.360: 99.1875% ( 1) 00:15:19.412 16.972 - 17.067: 99.1949% ( 1) 00:15:19.412 17.067 - 17.161: 99.2023% ( 1) 00:15:19.412 17.161 - 17.256: 99.2097% ( 1) 00:15:19.412 17.256 - 17.351: 99.2171% ( 1) 00:15:19.412 17.351 - 17.446: 99.2392% ( 3) 00:15:19.412 17.446 - 17.541: 99.2614% ( 3) 00:15:19.412 17.541 - 17.636: 99.3057% ( 6) 00:15:19.412 17.636 - 17.730: 99.3426% ( 5) 00:15:19.412 17.730 - 17.825: 99.3796% ( 5) 00:15:19.412 17.825 - 17.920: 99.4091% ( 4) 00:15:19.412 17.920 - 18.015: 99.4387% ( 4) 00:15:19.412 18.015 - 18.110: 99.4682% ( 4) 00:15:19.412 18.110 - 18.204: 99.5347% ( 9) 00:15:19.412 18.204 - 18.299: 99.5864% ( 7) 00:15:19.412 18.299 - 18.394: 99.6307% ( 6) 00:15:19.412 18.394 - 18.489: 99.6750% ( 6) 00:15:19.412 18.489 - 18.584: 99.7193% ( 6) 00:15:19.413 18.584 - 18.679: 99.7267% ( 1) 00:15:19.413 18.679 - 18.773: 99.7932% ( 9) 00:15:19.413 18.963 - 19.058: 99.8080% ( 2) 00:15:19.413 19.058 - 19.153: 99.8227% ( 2) 00:15:19.413 19.153 - 19.247: 99.8375% ( 2) 00:15:19.413 19.247 - 19.342: 99.8449% ( 1) 00:15:19.413 19.532 - 19.627: 99.8523% ( 1) 00:15:19.413 19.627 - 19.721: 99.8671% ( 2) 00:15:19.413 20.575 - 20.670: 99.8744% ( 1) 00:15:19.413 21.333 - 21.428: 99.8818% ( 1) 00:15:19.413 3980.705 - 4004.978: 99.9705% ( 12) 00:15:19.413 4004.978 - 4029.250: 99.9926% ( 3) 00:15:19.413 4029.250 - 4053.523: 100.0000% ( 1) 00:15:19.413 00:15:19.413 Complete histogram 00:15:19.413 ================== 00:15:19.413 Range in us Cumulative Count 00:15:19.413 2.050 - 2.062: 0.0222% ( 3) 00:15:19.413 2.062 - 2.074: 2.0164% ( 270) 00:15:19.413 2.074 - 2.086: 12.8074% ( 1461) 00:15:19.413 2.086 - 2.098: 19.3737% ( 889) 00:15:19.413 2.098 - 2.110: 30.2016% ( 1466) 00:15:19.413 2.110 - 2.121: 58.0693% ( 3773) 00:15:19.413 2.121 - 2.133: 65.4332% ( 997) 00:15:19.413 2.133 - 2.145: 67.3240% ( 256) 00:15:19.413 2.145 - 2.157: 70.9875% ( 496) 00:15:19.413 2.157 - 2.169: 72.7011% ( 232) 00:15:19.413 2.169 - 2.181: 77.5907% ( 662) 00:15:19.413 2.181 - 2.193: 87.1335% ( 1292) 00:15:19.413 2.193 - 2.204: 90.3833% ( 440) 00:15:19.413 2.204 - 2.216: 90.9004% ( 70) 00:15:19.413 2.216 - 2.228: 91.6464% ( 101) 00:15:19.413 2.228 - 2.240: 92.4958% ( 115) 00:15:19.413 2.240 - 2.252: 93.1974% ( 95) 00:15:19.413 2.252 - 2.264: 94.5565% ( 184) 00:15:19.413 2.264 - 2.276: 95.2434% ( 93) 00:15:19.413 2.276 - 2.287: 95.4650% ( 30) 00:15:19.413 2.287 - 2.299: 95.5314% ( 9) 00:15:19.413 2.299 - 2.311: 95.5757% ( 6) 00:15:19.413 2.311 - 2.323: 95.6865% ( 15) 00:15:19.413 2.323 - 2.335: 95.7456% ( 8) 00:15:19.413 2.335 - 2.347: 95.7752% ( 4) 00:15:19.413 2.347 - 2.359: 95.8786% ( 14) 00:15:19.413 2.359 - 2.370: 96.0041% ( 17) 00:15:19.413 2.370 - 2.382: 96.1149% ( 15) 00:15:19.413 2.382 - 2.394: 96.3513% ( 32) 00:15:19.413 2.394 - 2.406: 96.7723% ( 57) 00:15:19.413 2.406 - 2.418: 97.0603% ( 39) 00:15:19.413 2.418 - 2.430: 97.3706% ( 42) 00:15:19.413 2.430 - 2.441: 97.6882% ( 43) 00:15:19.413 2.441 - 2.453: 97.8211% ( 18) 00:15:19.413 2.453 - 2.465: 97.8950% ( 10) 00:15:19.413 2.465 - 2.477: 97.9762% ( 11) 00:15:19.413 2.477 - 2.489: 98.0501% ( 10) 00:15:19.413 2.489 - 2.501: 98.0870% ( 5) 00:15:19.413 2.501 - 2.513: 98.1166% ( 4) 00:15:19.413 2.524 - 2.536: 98.1387% ( 3) 00:15:19.413 2.536 - 2.548: 98.1535% ( 2) 00:15:19.413 2.548 - 2.560: 98.1683% ( 2) 00:15:19.413 2.584 - 2.596: 98.1904% ( 3) 00:15:19.413 2.596 - 2.607: 98.1978% ( 1) 00:15:19.413 2.607 - 2.619: 98.2200% ( 3) 00:15:19.413 2.619 - 2.631: 98.2347% ( 2) 00:15:19.413 2.631 - 2.643: 98.2421% ( 1) 00:15:19.413 2.643 - 2.655: 98.2495% ( 1) 00:15:19.413 2.655 - 2.667: 98.2569% ( 1) 00:15:19.413 2.667 - 2.679: 98.2717% ( 2) 00:15:19.413 2.679 - 2.690: 98.2864% ( 2) 00:15:19.413 2.702 - 2.714: 98.2938% ( 1) 00:15:19.413 2.785 - 2.797: 98.3012% ( 1) 00:15:19.413 2.821 - 2.833: 98.3086% ( 1) 00:15:19.413 2.868 - 2.880: 98.3160% ( 1) 00:15:19.413 2.916 - 2.927: 98.3234% ( 1) 00:15:19.413 2.927 - 2.939: 98.3307% ( 1) 00:15:19.413 2.951 - 2.963: 98.3381% ( 1) 00:15:19.413 2.987 - 2.999: 98.3529% ( 2) 00:15:19.413 3.034 - 3.058: 98.3751% ( 3) 00:15:19.413 3.058 - 3.081: 9[2024-04-23 04:59:58.506139] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:15:19.413 8.4120% ( 5) 00:15:19.413 3.105 - 3.129: 98.4194% ( 1) 00:15:19.413 3.129 - 3.153: 98.4268% ( 1) 00:15:19.413 3.176 - 3.200: 98.4342% ( 1) 00:15:19.413 3.224 - 3.247: 98.4415% ( 1) 00:15:19.413 3.271 - 3.295: 98.4489% ( 1) 00:15:19.413 3.295 - 3.319: 98.4711% ( 3) 00:15:19.413 3.319 - 3.342: 98.4785% ( 1) 00:15:19.413 3.342 - 3.366: 98.4859% ( 1) 00:15:19.413 3.366 - 3.390: 98.5006% ( 2) 00:15:19.413 3.484 - 3.508: 98.5228% ( 3) 00:15:19.413 3.508 - 3.532: 98.5302% ( 1) 00:15:19.413 3.532 - 3.556: 98.5523% ( 3) 00:15:19.413 3.579 - 3.603: 98.5597% ( 1) 00:15:19.413 3.674 - 3.698: 98.5671% ( 1) 00:15:19.413 3.745 - 3.769: 98.5819% ( 2) 00:15:19.413 3.769 - 3.793: 98.5893% ( 1) 00:15:19.413 3.793 - 3.816: 98.6040% ( 2) 00:15:19.413 3.864 - 3.887: 98.6114% ( 1) 00:15:19.413 3.911 - 3.935: 98.6262% ( 2) 00:15:19.413 4.006 - 4.030: 98.6336% ( 1) 00:15:19.413 5.239 - 5.262: 98.6410% ( 1) 00:15:19.413 5.310 - 5.333: 98.6483% ( 1) 00:15:19.413 5.357 - 5.381: 98.6557% ( 1) 00:15:19.413 5.547 - 5.570: 98.6705% ( 2) 00:15:19.413 5.618 - 5.641: 98.6779% ( 1) 00:15:19.413 5.736 - 5.760: 98.6853% ( 1) 00:15:19.413 5.926 - 5.950: 98.6927% ( 1) 00:15:19.413 5.973 - 5.997: 98.7001% ( 1) 00:15:19.413 6.044 - 6.068: 98.7074% ( 1) 00:15:19.413 6.068 - 6.116: 98.7148% ( 1) 00:15:19.413 6.210 - 6.258: 98.7296% ( 2) 00:15:19.413 6.258 - 6.305: 98.7370% ( 1) 00:15:19.413 6.542 - 6.590: 98.7444% ( 1) 00:15:19.413 6.590 - 6.637: 98.7518% ( 1) 00:15:19.413 6.921 - 6.969: 98.7591% ( 1) 00:15:19.413 7.538 - 7.585: 98.7665% ( 1) 00:15:19.413 7.822 - 7.870: 98.7739% ( 1) 00:15:19.413 7.917 - 7.964: 98.7813% ( 1) 00:15:19.413 8.154 - 8.201: 98.7887% ( 1) 00:15:19.413 8.439 - 8.486: 98.7961% ( 1) 00:15:19.413 8.628 - 8.676: 98.8035% ( 1) 00:15:19.413 15.550 - 15.644: 98.8108% ( 1) 00:15:19.413 15.644 - 15.739: 98.8256% ( 2) 00:15:19.413 15.739 - 15.834: 98.8552% ( 4) 00:15:19.413 15.929 - 16.024: 98.8921% ( 5) 00:15:19.413 16.024 - 16.119: 98.9142% ( 3) 00:15:19.413 16.119 - 16.213: 98.9216% ( 1) 00:15:19.413 16.213 - 16.308: 98.9364% ( 2) 00:15:19.413 16.308 - 16.403: 98.9586% ( 3) 00:15:19.413 16.403 - 16.498: 99.0472% ( 12) 00:15:19.413 16.498 - 16.593: 99.1358% ( 12) 00:15:19.413 16.593 - 16.687: 99.1432% ( 1) 00:15:19.413 16.687 - 16.782: 99.1654% ( 3) 00:15:19.413 16.782 - 16.877: 99.2023% ( 5) 00:15:19.413 16.877 - 16.972: 99.2392% ( 5) 00:15:19.413 16.972 - 17.067: 99.2466% ( 1) 00:15:19.413 17.067 - 17.161: 99.2540% ( 1) 00:15:19.413 17.161 - 17.256: 99.2762% ( 3) 00:15:19.413 17.256 - 17.351: 99.2836% ( 1) 00:15:19.413 17.446 - 17.541: 99.2909% ( 1) 00:15:19.413 17.541 - 17.636: 99.3057% ( 2) 00:15:19.413 17.636 - 17.730: 99.3205% ( 2) 00:15:19.413 17.730 - 17.825: 99.3279% ( 1) 00:15:19.413 17.825 - 17.920: 99.3500% ( 3) 00:15:19.413 18.110 - 18.204: 99.3722% ( 3) 00:15:19.413 18.204 - 18.299: 99.3796% ( 1) 00:15:19.413 18.299 - 18.394: 99.3943% ( 2) 00:15:19.413 18.489 - 18.584: 99.4017% ( 1) 00:15:19.413 23.135 - 23.230: 99.4091% ( 1) 00:15:19.413 3616.616 - 3640.889: 99.4165% ( 1) 00:15:19.413 3980.705 - 4004.978: 99.8006% ( 52) 00:15:19.413 4004.978 - 4029.250: 99.9778% ( 24) 00:15:19.413 4029.250 - 4053.523: 100.0000% ( 3) 00:15:19.413 00:15:19.413 04:59:58 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:19.413 04:59:58 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:19.413 04:59:58 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:19.413 04:59:58 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:19.413 04:59:58 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:19.671 [2024-04-23 04:59:58.815588] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:19.671 [ 00:15:19.671 { 00:15:19.671 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:19.671 "subtype": "Discovery", 00:15:19.671 "listen_addresses": [], 00:15:19.671 "allow_any_host": true, 00:15:19.671 "hosts": [] 00:15:19.671 }, 00:15:19.671 { 00:15:19.671 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:19.671 "subtype": "NVMe", 00:15:19.671 "listen_addresses": [ 00:15:19.671 { 00:15:19.671 "transport": "VFIOUSER", 00:15:19.671 "trtype": "VFIOUSER", 00:15:19.671 "adrfam": "IPv4", 00:15:19.671 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:19.671 "trsvcid": "0" 00:15:19.671 } 00:15:19.671 ], 00:15:19.671 "allow_any_host": true, 00:15:19.671 "hosts": [], 00:15:19.671 "serial_number": "SPDK1", 00:15:19.671 "model_number": "SPDK bdev Controller", 00:15:19.671 "max_namespaces": 32, 00:15:19.671 "min_cntlid": 1, 00:15:19.671 "max_cntlid": 65519, 00:15:19.672 "namespaces": [ 00:15:19.672 { 00:15:19.672 "nsid": 1, 00:15:19.672 "bdev_name": "Malloc1", 00:15:19.672 "name": "Malloc1", 00:15:19.672 "nguid": "5E0B731E10F04489BE1B919BDCE1F3E3", 00:15:19.672 "uuid": "5e0b731e-10f0-4489-be1b-919bdce1f3e3" 00:15:19.672 } 00:15:19.672 ] 00:15:19.672 }, 00:15:19.672 { 00:15:19.672 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:19.672 "subtype": "NVMe", 00:15:19.672 "listen_addresses": [ 00:15:19.672 { 00:15:19.672 "transport": "VFIOUSER", 00:15:19.672 "trtype": "VFIOUSER", 00:15:19.672 "adrfam": "IPv4", 00:15:19.672 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:19.672 "trsvcid": "0" 00:15:19.672 } 00:15:19.672 ], 00:15:19.672 "allow_any_host": true, 00:15:19.672 "hosts": [], 00:15:19.672 "serial_number": "SPDK2", 00:15:19.672 "model_number": "SPDK bdev Controller", 00:15:19.672 "max_namespaces": 32, 00:15:19.672 "min_cntlid": 1, 00:15:19.672 "max_cntlid": 65519, 00:15:19.672 "namespaces": [ 00:15:19.672 { 00:15:19.672 "nsid": 1, 00:15:19.672 "bdev_name": "Malloc2", 00:15:19.672 "name": "Malloc2", 00:15:19.672 "nguid": "F789FDD68F824F5BA606CBB4737678F9", 00:15:19.672 "uuid": "f789fdd6-8f82-4f5b-a606-cbb4737678f9" 00:15:19.672 } 00:15:19.672 ] 00:15:19.672 } 00:15:19.672 ] 00:15:19.672 04:59:58 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:19.672 04:59:58 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2365392 00:15:19.672 04:59:58 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:19.672 04:59:58 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:19.672 04:59:58 -- common/autotest_common.sh@1251 -- # local i=0 00:15:19.672 04:59:58 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:19.672 04:59:58 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:19.672 04:59:58 -- common/autotest_common.sh@1262 -- # return 0 00:15:19.672 04:59:58 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:19.930 04:59:58 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:19.930 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.930 [2024-04-23 04:59:58.979494] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:15:20.188 Malloc3 00:15:20.188 04:59:59 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:20.188 [2024-04-23 04:59:59.339103] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:15:20.446 04:59:59 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:20.446 Asynchronous Event Request test 00:15:20.446 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:20.446 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:20.446 Registering asynchronous event callbacks... 00:15:20.446 Starting namespace attribute notice tests for all controllers... 00:15:20.446 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:20.446 aer_cb - Changed Namespace 00:15:20.446 Cleaning up... 00:15:20.446 [ 00:15:20.446 { 00:15:20.446 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:20.446 "subtype": "Discovery", 00:15:20.446 "listen_addresses": [], 00:15:20.446 "allow_any_host": true, 00:15:20.446 "hosts": [] 00:15:20.446 }, 00:15:20.446 { 00:15:20.446 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:20.446 "subtype": "NVMe", 00:15:20.446 "listen_addresses": [ 00:15:20.446 { 00:15:20.446 "transport": "VFIOUSER", 00:15:20.446 "trtype": "VFIOUSER", 00:15:20.446 "adrfam": "IPv4", 00:15:20.446 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:20.446 "trsvcid": "0" 00:15:20.446 } 00:15:20.446 ], 00:15:20.446 "allow_any_host": true, 00:15:20.446 "hosts": [], 00:15:20.446 "serial_number": "SPDK1", 00:15:20.446 "model_number": "SPDK bdev Controller", 00:15:20.446 "max_namespaces": 32, 00:15:20.446 "min_cntlid": 1, 00:15:20.446 "max_cntlid": 65519, 00:15:20.446 "namespaces": [ 00:15:20.446 { 00:15:20.446 "nsid": 1, 00:15:20.446 "bdev_name": "Malloc1", 00:15:20.446 "name": "Malloc1", 00:15:20.446 "nguid": "5E0B731E10F04489BE1B919BDCE1F3E3", 00:15:20.446 "uuid": "5e0b731e-10f0-4489-be1b-919bdce1f3e3" 00:15:20.446 }, 00:15:20.446 { 00:15:20.446 "nsid": 2, 00:15:20.446 "bdev_name": "Malloc3", 00:15:20.446 "name": "Malloc3", 00:15:20.446 "nguid": "137B95E018094B21A9BA463050F80188", 00:15:20.446 "uuid": "137b95e0-1809-4b21-a9ba-463050f80188" 00:15:20.446 } 00:15:20.446 ] 00:15:20.446 }, 00:15:20.446 { 00:15:20.446 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:20.446 "subtype": "NVMe", 00:15:20.446 "listen_addresses": [ 00:15:20.446 { 00:15:20.446 "transport": "VFIOUSER", 00:15:20.446 "trtype": "VFIOUSER", 00:15:20.446 "adrfam": "IPv4", 00:15:20.446 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:20.446 "trsvcid": "0" 00:15:20.446 } 00:15:20.446 ], 00:15:20.446 "allow_any_host": true, 00:15:20.446 "hosts": [], 00:15:20.446 "serial_number": "SPDK2", 00:15:20.446 "model_number": "SPDK bdev Controller", 00:15:20.446 "max_namespaces": 32, 00:15:20.446 "min_cntlid": 1, 00:15:20.446 "max_cntlid": 65519, 00:15:20.446 "namespaces": [ 00:15:20.446 { 00:15:20.446 "nsid": 1, 00:15:20.446 "bdev_name": "Malloc2", 00:15:20.446 "name": "Malloc2", 00:15:20.446 "nguid": "F789FDD68F824F5BA606CBB4737678F9", 00:15:20.446 "uuid": "f789fdd6-8f82-4f5b-a606-cbb4737678f9" 00:15:20.446 } 00:15:20.446 ] 00:15:20.446 } 00:15:20.446 ] 00:15:20.446 04:59:59 -- target/nvmf_vfio_user.sh@44 -- # wait 2365392 00:15:20.446 04:59:59 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:20.446 04:59:59 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:20.446 04:59:59 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:20.446 04:59:59 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:20.705 [2024-04-23 04:59:59.628858] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:15:20.706 [2024-04-23 04:59:59.628908] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2365527 ] 00:15:20.706 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.706 [2024-04-23 04:59:59.645090] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:15:20.706 [2024-04-23 04:59:59.662753] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:20.706 [2024-04-23 04:59:59.668066] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:20.706 [2024-04-23 04:59:59.668096] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f5d13b11000 00:15:20.706 [2024-04-23 04:59:59.669068] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.670069] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.671074] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.672079] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.673086] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.674095] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.675102] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.676106] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:20.706 [2024-04-23 04:59:59.677115] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:20.706 [2024-04-23 04:59:59.677136] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f5d128c2000 00:15:20.706 [2024-04-23 04:59:59.678252] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:20.706 [2024-04-23 04:59:59.693001] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:20.706 [2024-04-23 04:59:59.693036] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:20.706 [2024-04-23 04:59:59.695130] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:20.706 [2024-04-23 04:59:59.695181] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:20.706 [2024-04-23 04:59:59.695271] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:20.706 [2024-04-23 04:59:59.695297] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:20.706 [2024-04-23 04:59:59.695307] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:20.706 [2024-04-23 04:59:59.696135] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:20.706 [2024-04-23 04:59:59.696159] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:20.706 [2024-04-23 04:59:59.696173] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:20.706 [2024-04-23 04:59:59.697146] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:20.706 [2024-04-23 04:59:59.697166] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:20.706 [2024-04-23 04:59:59.697180] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:20.706 [2024-04-23 04:59:59.698149] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:20.706 [2024-04-23 04:59:59.698169] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:20.706 [2024-04-23 04:59:59.699159] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:20.706 [2024-04-23 04:59:59.699179] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:20.706 [2024-04-23 04:59:59.699188] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:20.706 [2024-04-23 04:59:59.699199] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:20.706 [2024-04-23 04:59:59.699309] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:20.706 [2024-04-23 04:59:59.699317] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:20.706 [2024-04-23 04:59:59.699325] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:20.706 [2024-04-23 04:59:59.703527] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:20.706 [2024-04-23 04:59:59.704192] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:20.706 [2024-04-23 04:59:59.705200] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:20.706 [2024-04-23 04:59:59.706197] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:20.706 [2024-04-23 04:59:59.706261] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:20.706 [2024-04-23 04:59:59.707222] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:20.706 [2024-04-23 04:59:59.707242] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:20.706 [2024-04-23 04:59:59.707250] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.707273] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:20.706 [2024-04-23 04:59:59.707288] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.707315] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:20.706 [2024-04-23 04:59:59.707325] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:20.706 [2024-04-23 04:59:59.707345] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:20.706 [2024-04-23 04:59:59.713545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:20.706 [2024-04-23 04:59:59.713576] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:20.706 [2024-04-23 04:59:59.713584] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:20.706 [2024-04-23 04:59:59.713602] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:20.706 [2024-04-23 04:59:59.713610] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:20.706 [2024-04-23 04:59:59.713618] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:20.706 [2024-04-23 04:59:59.713635] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:20.706 [2024-04-23 04:59:59.713643] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.713656] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.713673] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:20.706 [2024-04-23 04:59:59.721525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:20.706 [2024-04-23 04:59:59.721553] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:20.706 [2024-04-23 04:59:59.721567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:20.706 [2024-04-23 04:59:59.721579] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:20.706 [2024-04-23 04:59:59.721591] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:20.706 [2024-04-23 04:59:59.721600] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.721615] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.721630] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:20.706 [2024-04-23 04:59:59.729528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:20.706 [2024-04-23 04:59:59.729547] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:20.706 [2024-04-23 04:59:59.729557] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.729573] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.729588] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.729603] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:20.706 [2024-04-23 04:59:59.737540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:20.706 [2024-04-23 04:59:59.737600] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:20.706 [2024-04-23 04:59:59.737615] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.737628] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:20.707 [2024-04-23 04:59:59.737636] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:20.707 [2024-04-23 04:59:59.737646] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.745539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.745561] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:20.707 [2024-04-23 04:59:59.745580] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.745595] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.745607] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:20.707 [2024-04-23 04:59:59.745616] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:20.707 [2024-04-23 04:59:59.745625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.753574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.753603] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.753619] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.753632] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:20.707 [2024-04-23 04:59:59.753640] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:20.707 [2024-04-23 04:59:59.753650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.761540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.761562] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.761575] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.761590] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.761601] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.761613] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.761623] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:20.707 [2024-04-23 04:59:59.761631] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:20.707 [2024-04-23 04:59:59.761639] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:20.707 [2024-04-23 04:59:59.761664] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.769568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.769593] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.777527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.777551] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.785528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.785551] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.793541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.793568] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:20.707 [2024-04-23 04:59:59.793578] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:20.707 [2024-04-23 04:59:59.793585] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:20.707 [2024-04-23 04:59:59.793591] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:20.707 [2024-04-23 04:59:59.793601] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:20.707 [2024-04-23 04:59:59.793613] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:20.707 [2024-04-23 04:59:59.793621] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:20.707 [2024-04-23 04:59:59.793630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.793640] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:20.707 [2024-04-23 04:59:59.793648] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:20.707 [2024-04-23 04:59:59.793657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.793669] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:20.707 [2024-04-23 04:59:59.793676] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:20.707 [2024-04-23 04:59:59.793685] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:20.707 [2024-04-23 04:59:59.801538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.801571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.801588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:20.707 [2024-04-23 04:59:59.801600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:20.707 ===================================================== 00:15:20.707 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:20.707 ===================================================== 00:15:20.707 Controller Capabilities/Features 00:15:20.707 ================================ 00:15:20.707 Vendor ID: 4e58 00:15:20.707 Subsystem Vendor ID: 4e58 00:15:20.707 Serial Number: SPDK2 00:15:20.707 Model Number: SPDK bdev Controller 00:15:20.707 Firmware Version: 24.05 00:15:20.707 Recommended Arb Burst: 6 00:15:20.707 IEEE OUI Identifier: 8d 6b 50 00:15:20.707 Multi-path I/O 00:15:20.707 May have multiple subsystem ports: Yes 00:15:20.707 May have multiple controllers: Yes 00:15:20.707 Associated with SR-IOV VF: No 00:15:20.707 Max Data Transfer Size: 131072 00:15:20.707 Max Number of Namespaces: 32 00:15:20.707 Max Number of I/O Queues: 127 00:15:20.707 NVMe Specification Version (VS): 1.3 00:15:20.707 NVMe Specification Version (Identify): 1.3 00:15:20.707 Maximum Queue Entries: 256 00:15:20.707 Contiguous Queues Required: Yes 00:15:20.707 Arbitration Mechanisms Supported 00:15:20.707 Weighted Round Robin: Not Supported 00:15:20.707 Vendor Specific: Not Supported 00:15:20.707 Reset Timeout: 15000 ms 00:15:20.707 Doorbell Stride: 4 bytes 00:15:20.707 NVM Subsystem Reset: Not Supported 00:15:20.707 Command Sets Supported 00:15:20.707 NVM Command Set: Supported 00:15:20.707 Boot Partition: Not Supported 00:15:20.707 Memory Page Size Minimum: 4096 bytes 00:15:20.707 Memory Page Size Maximum: 4096 bytes 00:15:20.707 Persistent Memory Region: Not Supported 00:15:20.707 Optional Asynchronous Events Supported 00:15:20.707 Namespace Attribute Notices: Supported 00:15:20.707 Firmware Activation Notices: Not Supported 00:15:20.707 ANA Change Notices: Not Supported 00:15:20.707 PLE Aggregate Log Change Notices: Not Supported 00:15:20.707 LBA Status Info Alert Notices: Not Supported 00:15:20.707 EGE Aggregate Log Change Notices: Not Supported 00:15:20.707 Normal NVM Subsystem Shutdown event: Not Supported 00:15:20.707 Zone Descriptor Change Notices: Not Supported 00:15:20.707 Discovery Log Change Notices: Not Supported 00:15:20.707 Controller Attributes 00:15:20.707 128-bit Host Identifier: Supported 00:15:20.707 Non-Operational Permissive Mode: Not Supported 00:15:20.707 NVM Sets: Not Supported 00:15:20.707 Read Recovery Levels: Not Supported 00:15:20.707 Endurance Groups: Not Supported 00:15:20.707 Predictable Latency Mode: Not Supported 00:15:20.707 Traffic Based Keep ALive: Not Supported 00:15:20.707 Namespace Granularity: Not Supported 00:15:20.707 SQ Associations: Not Supported 00:15:20.707 UUID List: Not Supported 00:15:20.707 Multi-Domain Subsystem: Not Supported 00:15:20.707 Fixed Capacity Management: Not Supported 00:15:20.707 Variable Capacity Management: Not Supported 00:15:20.707 Delete Endurance Group: Not Supported 00:15:20.707 Delete NVM Set: Not Supported 00:15:20.707 Extended LBA Formats Supported: Not Supported 00:15:20.707 Flexible Data Placement Supported: Not Supported 00:15:20.707 00:15:20.707 Controller Memory Buffer Support 00:15:20.707 ================================ 00:15:20.707 Supported: No 00:15:20.707 00:15:20.707 Persistent Memory Region Support 00:15:20.707 ================================ 00:15:20.707 Supported: No 00:15:20.707 00:15:20.707 Admin Command Set Attributes 00:15:20.707 ============================ 00:15:20.707 Security Send/Receive: Not Supported 00:15:20.707 Format NVM: Not Supported 00:15:20.708 Firmware Activate/Download: Not Supported 00:15:20.708 Namespace Management: Not Supported 00:15:20.708 Device Self-Test: Not Supported 00:15:20.708 Directives: Not Supported 00:15:20.708 NVMe-MI: Not Supported 00:15:20.708 Virtualization Management: Not Supported 00:15:20.708 Doorbell Buffer Config: Not Supported 00:15:20.708 Get LBA Status Capability: Not Supported 00:15:20.708 Command & Feature Lockdown Capability: Not Supported 00:15:20.708 Abort Command Limit: 4 00:15:20.708 Async Event Request Limit: 4 00:15:20.708 Number of Firmware Slots: N/A 00:15:20.708 Firmware Slot 1 Read-Only: N/A 00:15:20.708 Firmware Activation Without Reset: N/A 00:15:20.708 Multiple Update Detection Support: N/A 00:15:20.708 Firmware Update Granularity: No Information Provided 00:15:20.708 Per-Namespace SMART Log: No 00:15:20.708 Asymmetric Namespace Access Log Page: Not Supported 00:15:20.708 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:20.708 Command Effects Log Page: Supported 00:15:20.708 Get Log Page Extended Data: Supported 00:15:20.708 Telemetry Log Pages: Not Supported 00:15:20.708 Persistent Event Log Pages: Not Supported 00:15:20.708 Supported Log Pages Log Page: May Support 00:15:20.708 Commands Supported & Effects Log Page: Not Supported 00:15:20.708 Feature Identifiers & Effects Log Page:May Support 00:15:20.708 NVMe-MI Commands & Effects Log Page: May Support 00:15:20.708 Data Area 4 for Telemetry Log: Not Supported 00:15:20.708 Error Log Page Entries Supported: 128 00:15:20.708 Keep Alive: Supported 00:15:20.708 Keep Alive Granularity: 10000 ms 00:15:20.708 00:15:20.708 NVM Command Set Attributes 00:15:20.708 ========================== 00:15:20.708 Submission Queue Entry Size 00:15:20.708 Max: 64 00:15:20.708 Min: 64 00:15:20.708 Completion Queue Entry Size 00:15:20.708 Max: 16 00:15:20.708 Min: 16 00:15:20.708 Number of Namespaces: 32 00:15:20.708 Compare Command: Supported 00:15:20.708 Write Uncorrectable Command: Not Supported 00:15:20.708 Dataset Management Command: Supported 00:15:20.708 Write Zeroes Command: Supported 00:15:20.708 Set Features Save Field: Not Supported 00:15:20.708 Reservations: Not Supported 00:15:20.708 Timestamp: Not Supported 00:15:20.708 Copy: Supported 00:15:20.708 Volatile Write Cache: Present 00:15:20.708 Atomic Write Unit (Normal): 1 00:15:20.708 Atomic Write Unit (PFail): 1 00:15:20.708 Atomic Compare & Write Unit: 1 00:15:20.708 Fused Compare & Write: Supported 00:15:20.708 Scatter-Gather List 00:15:20.708 SGL Command Set: Supported (Dword aligned) 00:15:20.708 SGL Keyed: Not Supported 00:15:20.708 SGL Bit Bucket Descriptor: Not Supported 00:15:20.708 SGL Metadata Pointer: Not Supported 00:15:20.708 Oversized SGL: Not Supported 00:15:20.708 SGL Metadata Address: Not Supported 00:15:20.708 SGL Offset: Not Supported 00:15:20.708 Transport SGL Data Block: Not Supported 00:15:20.708 Replay Protected Memory Block: Not Supported 00:15:20.708 00:15:20.708 Firmware Slot Information 00:15:20.708 ========================= 00:15:20.708 Active slot: 1 00:15:20.708 Slot 1 Firmware Revision: 24.05 00:15:20.708 00:15:20.708 00:15:20.708 Commands Supported and Effects 00:15:20.708 ============================== 00:15:20.708 Admin Commands 00:15:20.708 -------------- 00:15:20.708 Get Log Page (02h): Supported 00:15:20.708 Identify (06h): Supported 00:15:20.708 Abort (08h): Supported 00:15:20.708 Set Features (09h): Supported 00:15:20.708 Get Features (0Ah): Supported 00:15:20.708 Asynchronous Event Request (0Ch): Supported 00:15:20.708 Keep Alive (18h): Supported 00:15:20.708 I/O Commands 00:15:20.708 ------------ 00:15:20.708 Flush (00h): Supported LBA-Change 00:15:20.708 Write (01h): Supported LBA-Change 00:15:20.708 Read (02h): Supported 00:15:20.708 Compare (05h): Supported 00:15:20.708 Write Zeroes (08h): Supported LBA-Change 00:15:20.708 Dataset Management (09h): Supported LBA-Change 00:15:20.708 Copy (19h): Supported LBA-Change 00:15:20.708 Unknown (79h): Supported LBA-Change 00:15:20.708 Unknown (7Ah): Supported 00:15:20.708 00:15:20.708 Error Log 00:15:20.708 ========= 00:15:20.708 00:15:20.708 Arbitration 00:15:20.708 =========== 00:15:20.708 Arbitration Burst: 1 00:15:20.708 00:15:20.708 Power Management 00:15:20.708 ================ 00:15:20.708 Number of Power States: 1 00:15:20.708 Current Power State: Power State #0 00:15:20.708 Power State #0: 00:15:20.708 Max Power: 0.00 W 00:15:20.708 Non-Operational State: Operational 00:15:20.708 Entry Latency: Not Reported 00:15:20.708 Exit Latency: Not Reported 00:15:20.708 Relative Read Throughput: 0 00:15:20.708 Relative Read Latency: 0 00:15:20.708 Relative Write Throughput: 0 00:15:20.708 Relative Write Latency: 0 00:15:20.708 Idle Power: Not Reported 00:15:20.708 Active Power: Not Reported 00:15:20.708 Non-Operational Permissive Mode: Not Supported 00:15:20.708 00:15:20.708 Health Information 00:15:20.708 ================== 00:15:20.708 Critical Warnings: 00:15:20.708 Available Spare Space: OK 00:15:20.708 Temperature: OK 00:15:20.708 Device Reliability: OK 00:15:20.708 Read Only: No 00:15:20.708 Volatile Memory Backup: OK 00:15:20.708 Current Temperature: 0 Kelvin (-2[2024-04-23 04:59:59.801718] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:20.708 [2024-04-23 04:59:59.809542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:20.708 [2024-04-23 04:59:59.809586] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:20.708 [2024-04-23 04:59:59.809603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:20.708 [2024-04-23 04:59:59.809614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:20.708 [2024-04-23 04:59:59.809624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:20.708 [2024-04-23 04:59:59.809634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:20.708 [2024-04-23 04:59:59.809714] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:20.708 [2024-04-23 04:59:59.809733] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:20.708 [2024-04-23 04:59:59.810716] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:20.708 [2024-04-23 04:59:59.810785] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:20.708 [2024-04-23 04:59:59.810800] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:20.708 [2024-04-23 04:59:59.811732] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:20.708 [2024-04-23 04:59:59.811756] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:20.708 [2024-04-23 04:59:59.811807] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:20.708 [2024-04-23 04:59:59.812994] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:20.708 73 Celsius) 00:15:20.708 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:20.708 Available Spare: 0% 00:15:20.708 Available Spare Threshold: 0% 00:15:20.708 Life Percentage Used: 0% 00:15:20.708 Data Units Read: 0 00:15:20.708 Data Units Written: 0 00:15:20.708 Host Read Commands: 0 00:15:20.708 Host Write Commands: 0 00:15:20.708 Controller Busy Time: 0 minutes 00:15:20.708 Power Cycles: 0 00:15:20.708 Power On Hours: 0 hours 00:15:20.708 Unsafe Shutdowns: 0 00:15:20.708 Unrecoverable Media Errors: 0 00:15:20.708 Lifetime Error Log Entries: 0 00:15:20.708 Warning Temperature Time: 0 minutes 00:15:20.708 Critical Temperature Time: 0 minutes 00:15:20.708 00:15:20.708 Number of Queues 00:15:20.708 ================ 00:15:20.708 Number of I/O Submission Queues: 127 00:15:20.708 Number of I/O Completion Queues: 127 00:15:20.708 00:15:20.708 Active Namespaces 00:15:20.708 ================= 00:15:20.708 Namespace ID:1 00:15:20.708 Error Recovery Timeout: Unlimited 00:15:20.708 Command Set Identifier: NVM (00h) 00:15:20.708 Deallocate: Supported 00:15:20.708 Deallocated/Unwritten Error: Not Supported 00:15:20.708 Deallocated Read Value: Unknown 00:15:20.708 Deallocate in Write Zeroes: Not Supported 00:15:20.708 Deallocated Guard Field: 0xFFFF 00:15:20.708 Flush: Supported 00:15:20.708 Reservation: Supported 00:15:20.708 Namespace Sharing Capabilities: Multiple Controllers 00:15:20.708 Size (in LBAs): 131072 (0GiB) 00:15:20.708 Capacity (in LBAs): 131072 (0GiB) 00:15:20.708 Utilization (in LBAs): 131072 (0GiB) 00:15:20.708 NGUID: F789FDD68F824F5BA606CBB4737678F9 00:15:20.708 UUID: f789fdd6-8f82-4f5b-a606-cbb4737678f9 00:15:20.708 Thin Provisioning: Not Supported 00:15:20.708 Per-NS Atomic Units: Yes 00:15:20.708 Atomic Boundary Size (Normal): 0 00:15:20.708 Atomic Boundary Size (PFail): 0 00:15:20.708 Atomic Boundary Offset: 0 00:15:20.709 Maximum Single Source Range Length: 65535 00:15:20.709 Maximum Copy Length: 65535 00:15:20.709 Maximum Source Range Count: 1 00:15:20.709 NGUID/EUI64 Never Reused: No 00:15:20.709 Namespace Write Protected: No 00:15:20.709 Number of LBA Formats: 1 00:15:20.709 Current LBA Format: LBA Format #00 00:15:20.709 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:20.709 00:15:20.709 04:59:59 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:20.967 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.967 [2024-04-23 05:00:00.047647] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:26.222 [2024-04-23 05:00:05.150868] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:26.222 Initializing NVMe Controllers 00:15:26.222 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:26.222 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:26.222 Initialization complete. Launching workers. 00:15:26.222 ======================================================== 00:15:26.222 Latency(us) 00:15:26.222 Device Information : IOPS MiB/s Average min max 00:15:26.222 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 34905.56 136.35 3666.51 1160.74 7391.88 00:15:26.222 ======================================================== 00:15:26.222 Total : 34905.56 136.35 3666.51 1160.74 7391.88 00:15:26.222 00:15:26.222 05:00:05 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:26.222 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.479 [2024-04-23 05:00:05.392545] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:31.736 [2024-04-23 05:00:10.413826] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:31.736 Initializing NVMe Controllers 00:15:31.736 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:31.736 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:31.736 Initialization complete. Launching workers. 00:15:31.736 ======================================================== 00:15:31.736 Latency(us) 00:15:31.736 Device Information : IOPS MiB/s Average min max 00:15:31.736 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 32687.84 127.69 3915.14 1195.84 8279.73 00:15:31.736 ======================================================== 00:15:31.736 Total : 32687.84 127.69 3915.14 1195.84 8279.73 00:15:31.736 00:15:31.736 05:00:10 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:31.736 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.736 [2024-04-23 05:00:10.623630] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:36.997 [2024-04-23 05:00:15.758678] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:36.997 Initializing NVMe Controllers 00:15:36.997 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:36.997 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:36.997 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:36.998 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:36.998 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:36.998 Initialization complete. Launching workers. 00:15:36.998 Starting thread on core 2 00:15:36.998 Starting thread on core 3 00:15:36.998 Starting thread on core 1 00:15:36.998 05:00:15 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:36.998 EAL: No free 2048 kB hugepages reported on node 1 00:15:36.998 [2024-04-23 05:00:16.064086] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:40.277 [2024-04-23 05:00:19.128983] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:40.277 Initializing NVMe Controllers 00:15:40.277 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:40.277 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:40.277 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:40.277 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:40.277 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:40.277 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:40.277 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:40.277 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:40.277 Initialization complete. Launching workers. 00:15:40.277 Starting thread on core 1 with urgent priority queue 00:15:40.277 Starting thread on core 2 with urgent priority queue 00:15:40.277 Starting thread on core 3 with urgent priority queue 00:15:40.277 Starting thread on core 0 with urgent priority queue 00:15:40.277 SPDK bdev Controller (SPDK2 ) core 0: 5903.33 IO/s 16.94 secs/100000 ios 00:15:40.277 SPDK bdev Controller (SPDK2 ) core 1: 5981.67 IO/s 16.72 secs/100000 ios 00:15:40.277 SPDK bdev Controller (SPDK2 ) core 2: 6414.00 IO/s 15.59 secs/100000 ios 00:15:40.277 SPDK bdev Controller (SPDK2 ) core 3: 5269.67 IO/s 18.98 secs/100000 ios 00:15:40.277 ======================================================== 00:15:40.277 00:15:40.277 05:00:19 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:40.277 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.277 [2024-04-23 05:00:19.422346] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:40.277 [2024-04-23 05:00:19.430392] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:40.535 Initializing NVMe Controllers 00:15:40.535 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:40.535 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:40.535 Namespace ID: 1 size: 0GB 00:15:40.535 Initialization complete. 00:15:40.535 INFO: using host memory buffer for IO 00:15:40.535 Hello world! 00:15:40.535 05:00:19 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:40.535 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.792 [2024-04-23 05:00:19.717108] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:41.727 Initializing NVMe Controllers 00:15:41.727 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:41.727 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:41.727 Initialization complete. Launching workers. 00:15:41.727 submit (in ns) avg, min, max = 8899.7, 3467.8, 4033504.4 00:15:41.727 complete (in ns) avg, min, max = 24779.9, 2035.6, 4032634.4 00:15:41.727 00:15:41.727 Submit histogram 00:15:41.727 ================ 00:15:41.727 Range in us Cumulative Count 00:15:41.727 3.461 - 3.484: 0.0912% ( 12) 00:15:41.727 3.484 - 3.508: 0.5550% ( 61) 00:15:41.727 3.508 - 3.532: 1.6117% ( 139) 00:15:41.727 3.532 - 3.556: 3.8239% ( 291) 00:15:41.727 3.556 - 3.579: 8.5221% ( 618) 00:15:41.727 3.579 - 3.603: 13.7981% ( 694) 00:15:41.727 3.603 - 3.627: 23.0196% ( 1213) 00:15:41.727 3.627 - 3.650: 31.0932% ( 1062) 00:15:41.727 3.650 - 3.674: 38.5206% ( 977) 00:15:41.727 3.674 - 3.698: 42.8387% ( 568) 00:15:41.727 3.698 - 3.721: 47.4000% ( 600) 00:15:41.727 3.721 - 3.745: 51.8473% ( 585) 00:15:41.727 3.745 - 3.769: 55.8917% ( 532) 00:15:41.727 3.769 - 3.793: 59.7005% ( 501) 00:15:41.727 3.793 - 3.816: 63.3343% ( 478) 00:15:41.727 3.816 - 3.840: 68.1162% ( 629) 00:15:41.727 3.840 - 3.864: 73.2705% ( 678) 00:15:41.727 3.864 - 3.887: 77.2465% ( 523) 00:15:41.727 3.887 - 3.911: 80.0669% ( 371) 00:15:41.727 3.911 - 3.935: 82.1651% ( 276) 00:15:41.727 3.935 - 3.959: 83.9288% ( 232) 00:15:41.727 3.959 - 3.982: 85.6774% ( 230) 00:15:41.727 3.982 - 4.006: 87.2358% ( 205) 00:15:41.727 4.006 - 4.030: 88.2621% ( 135) 00:15:41.727 4.030 - 4.053: 89.4557% ( 157) 00:15:41.727 4.053 - 4.077: 90.5580% ( 145) 00:15:41.727 4.077 - 4.101: 91.6603% ( 145) 00:15:41.727 4.101 - 4.124: 92.6866% ( 135) 00:15:41.727 4.124 - 4.148: 93.3252% ( 84) 00:15:41.727 4.148 - 4.172: 93.7890% ( 61) 00:15:41.727 4.172 - 4.196: 94.1691% ( 50) 00:15:41.727 4.196 - 4.219: 94.4884% ( 42) 00:15:41.727 4.219 - 4.243: 94.7544% ( 35) 00:15:41.727 4.243 - 4.267: 94.9141% ( 21) 00:15:41.727 4.267 - 4.290: 95.0129% ( 13) 00:15:41.727 4.290 - 4.314: 95.1726% ( 21) 00:15:41.727 4.314 - 4.338: 95.2714% ( 13) 00:15:41.727 4.338 - 4.361: 95.4234% ( 20) 00:15:41.727 4.361 - 4.385: 95.4995% ( 10) 00:15:41.727 4.385 - 4.409: 95.5451% ( 6) 00:15:41.727 4.409 - 4.433: 95.6211% ( 10) 00:15:41.727 4.433 - 4.456: 95.6895% ( 9) 00:15:41.727 4.456 - 4.480: 95.7503% ( 8) 00:15:41.727 4.480 - 4.504: 95.7884% ( 5) 00:15:41.727 4.504 - 4.527: 95.8492% ( 8) 00:15:41.727 4.527 - 4.551: 95.8872% ( 5) 00:15:41.727 4.551 - 4.575: 95.9556% ( 9) 00:15:41.727 4.575 - 4.599: 95.9936% ( 5) 00:15:41.727 4.599 - 4.622: 96.0088% ( 2) 00:15:41.727 4.622 - 4.646: 96.0316% ( 3) 00:15:41.727 4.646 - 4.670: 96.1000% ( 9) 00:15:41.727 4.670 - 4.693: 96.1381% ( 5) 00:15:41.727 4.693 - 4.717: 96.1685% ( 4) 00:15:41.727 4.717 - 4.741: 96.2141% ( 6) 00:15:41.727 4.741 - 4.764: 96.2597% ( 6) 00:15:41.727 4.764 - 4.788: 96.2825% ( 3) 00:15:41.727 4.788 - 4.812: 96.3433% ( 8) 00:15:41.727 4.812 - 4.836: 96.3889% ( 6) 00:15:41.727 4.836 - 4.859: 96.4345% ( 6) 00:15:41.727 4.859 - 4.883: 96.4726% ( 5) 00:15:41.727 4.883 - 4.907: 96.5182% ( 6) 00:15:41.727 4.907 - 4.930: 96.5790% ( 8) 00:15:41.727 4.930 - 4.954: 96.6626% ( 11) 00:15:41.727 4.954 - 4.978: 96.7614% ( 13) 00:15:41.727 4.978 - 5.001: 96.8299% ( 9) 00:15:41.727 5.001 - 5.025: 96.9135% ( 11) 00:15:41.727 5.025 - 5.049: 96.9819% ( 9) 00:15:41.727 5.049 - 5.073: 97.0579% ( 10) 00:15:41.727 5.073 - 5.096: 97.0959% ( 5) 00:15:41.727 5.096 - 5.120: 97.1492% ( 7) 00:15:41.727 5.120 - 5.144: 97.1796% ( 4) 00:15:41.727 5.144 - 5.167: 97.1872% ( 1) 00:15:41.727 5.167 - 5.191: 97.2328% ( 6) 00:15:41.727 5.191 - 5.215: 97.2708% ( 5) 00:15:41.727 5.215 - 5.239: 97.3392% ( 9) 00:15:41.727 5.239 - 5.262: 97.3620% ( 3) 00:15:41.727 5.262 - 5.286: 97.4228% ( 8) 00:15:41.727 5.286 - 5.310: 97.4304% ( 1) 00:15:41.727 5.310 - 5.333: 97.4380% ( 1) 00:15:41.727 5.333 - 5.357: 97.4761% ( 5) 00:15:41.727 5.357 - 5.381: 97.4989% ( 3) 00:15:41.727 5.381 - 5.404: 97.5293% ( 4) 00:15:41.727 5.404 - 5.428: 97.5597% ( 4) 00:15:41.727 5.428 - 5.452: 97.5673% ( 1) 00:15:41.727 5.452 - 5.476: 97.5749% ( 1) 00:15:41.727 5.476 - 5.499: 97.6053% ( 4) 00:15:41.727 5.499 - 5.523: 97.6129% ( 1) 00:15:41.728 5.523 - 5.547: 97.6281% ( 2) 00:15:41.728 5.547 - 5.570: 97.6357% ( 1) 00:15:41.728 5.570 - 5.594: 97.6509% ( 2) 00:15:41.728 5.594 - 5.618: 97.6661% ( 2) 00:15:41.728 5.618 - 5.641: 97.6737% ( 1) 00:15:41.728 5.641 - 5.665: 97.6965% ( 3) 00:15:41.728 5.665 - 5.689: 97.7269% ( 4) 00:15:41.728 5.713 - 5.736: 97.7345% ( 1) 00:15:41.728 5.736 - 5.760: 97.7497% ( 2) 00:15:41.728 5.807 - 5.831: 97.7573% ( 1) 00:15:41.728 5.855 - 5.879: 97.7649% ( 1) 00:15:41.728 5.879 - 5.902: 97.7801% ( 2) 00:15:41.728 5.902 - 5.926: 97.7953% ( 2) 00:15:41.728 5.950 - 5.973: 97.8106% ( 2) 00:15:41.728 5.973 - 5.997: 97.8182% ( 1) 00:15:41.728 6.021 - 6.044: 97.8258% ( 1) 00:15:41.728 6.044 - 6.068: 97.8410% ( 2) 00:15:41.728 6.163 - 6.210: 97.8562% ( 2) 00:15:41.728 6.210 - 6.258: 97.8638% ( 1) 00:15:41.728 6.400 - 6.447: 97.8790% ( 2) 00:15:41.728 6.542 - 6.590: 97.8942% ( 2) 00:15:41.728 6.684 - 6.732: 97.9018% ( 1) 00:15:41.728 6.827 - 6.874: 97.9094% ( 1) 00:15:41.728 6.874 - 6.921: 97.9170% ( 1) 00:15:41.728 7.348 - 7.396: 97.9246% ( 1) 00:15:41.728 7.396 - 7.443: 97.9398% ( 2) 00:15:41.728 7.443 - 7.490: 97.9474% ( 1) 00:15:41.728 7.585 - 7.633: 97.9626% ( 2) 00:15:41.728 7.680 - 7.727: 97.9702% ( 1) 00:15:41.728 7.822 - 7.870: 97.9778% ( 1) 00:15:41.728 8.012 - 8.059: 97.9854% ( 1) 00:15:41.728 8.059 - 8.107: 97.9930% ( 1) 00:15:41.728 8.154 - 8.201: 98.0006% ( 1) 00:15:41.728 8.344 - 8.391: 98.0082% ( 1) 00:15:41.728 8.628 - 8.676: 98.0234% ( 2) 00:15:41.728 8.676 - 8.723: 98.0310% ( 1) 00:15:41.728 8.723 - 8.770: 98.0386% ( 1) 00:15:41.728 8.818 - 8.865: 98.0538% ( 2) 00:15:41.728 8.865 - 8.913: 98.0690% ( 2) 00:15:41.728 8.913 - 8.960: 98.0766% ( 1) 00:15:41.728 8.960 - 9.007: 98.0842% ( 1) 00:15:41.728 9.007 - 9.055: 98.0918% ( 1) 00:15:41.728 9.055 - 9.102: 98.1070% ( 2) 00:15:41.728 9.102 - 9.150: 98.1146% ( 1) 00:15:41.728 9.150 - 9.197: 98.1298% ( 2) 00:15:41.728 9.339 - 9.387: 98.1451% ( 2) 00:15:41.728 9.387 - 9.434: 98.1527% ( 1) 00:15:41.728 9.529 - 9.576: 98.1603% ( 1) 00:15:41.728 9.624 - 9.671: 98.1831% ( 3) 00:15:41.728 9.671 - 9.719: 98.1907% ( 1) 00:15:41.728 9.719 - 9.766: 98.2135% ( 3) 00:15:41.728 9.813 - 9.861: 98.2363% ( 3) 00:15:41.728 9.908 - 9.956: 98.2515% ( 2) 00:15:41.728 10.050 - 10.098: 98.2591% ( 1) 00:15:41.728 10.145 - 10.193: 98.2743% ( 2) 00:15:41.728 10.287 - 10.335: 98.2895% ( 2) 00:15:41.728 10.335 - 10.382: 98.3047% ( 2) 00:15:41.728 10.382 - 10.430: 98.3199% ( 2) 00:15:41.728 10.524 - 10.572: 98.3275% ( 1) 00:15:41.728 10.761 - 10.809: 98.3351% ( 1) 00:15:41.728 10.951 - 10.999: 98.3503% ( 2) 00:15:41.728 11.093 - 11.141: 98.3655% ( 2) 00:15:41.728 11.141 - 11.188: 98.3731% ( 1) 00:15:41.728 11.283 - 11.330: 98.3883% ( 2) 00:15:41.728 11.425 - 11.473: 98.3959% ( 1) 00:15:41.728 11.473 - 11.520: 98.4035% ( 1) 00:15:41.728 11.662 - 11.710: 98.4111% ( 1) 00:15:41.728 11.710 - 11.757: 98.4187% ( 1) 00:15:41.728 11.757 - 11.804: 98.4263% ( 1) 00:15:41.728 11.899 - 11.947: 98.4339% ( 1) 00:15:41.728 12.041 - 12.089: 98.4415% ( 1) 00:15:41.728 12.089 - 12.136: 98.4491% ( 1) 00:15:41.728 12.231 - 12.326: 98.4719% ( 3) 00:15:41.728 12.326 - 12.421: 98.4795% ( 1) 00:15:41.728 12.421 - 12.516: 98.4872% ( 1) 00:15:41.728 12.516 - 12.610: 98.5024% ( 2) 00:15:41.728 12.705 - 12.800: 98.5100% ( 1) 00:15:41.728 12.800 - 12.895: 98.5176% ( 1) 00:15:41.728 13.464 - 13.559: 98.5252% ( 1) 00:15:41.728 13.559 - 13.653: 98.5328% ( 1) 00:15:41.728 13.653 - 13.748: 98.5404% ( 1) 00:15:41.728 13.748 - 13.843: 98.5480% ( 1) 00:15:41.728 14.222 - 14.317: 98.5632% ( 2) 00:15:41.728 14.507 - 14.601: 98.5784% ( 2) 00:15:41.728 14.601 - 14.696: 98.6088% ( 4) 00:15:41.728 14.696 - 14.791: 98.6240% ( 2) 00:15:41.728 14.791 - 14.886: 98.6392% ( 2) 00:15:41.728 15.170 - 15.265: 98.6468% ( 1) 00:15:41.728 15.265 - 15.360: 98.6544% ( 1) 00:15:41.728 15.455 - 15.550: 98.6620% ( 1) 00:15:41.728 17.161 - 17.256: 98.6696% ( 1) 00:15:41.728 17.256 - 17.351: 98.6772% ( 1) 00:15:41.728 17.351 - 17.446: 98.6848% ( 1) 00:15:41.728 17.446 - 17.541: 98.7076% ( 3) 00:15:41.728 17.541 - 17.636: 98.7608% ( 7) 00:15:41.728 17.636 - 17.730: 98.7988% ( 5) 00:15:41.728 17.730 - 17.825: 98.8521% ( 7) 00:15:41.728 17.825 - 17.920: 98.9053% ( 7) 00:15:41.728 17.920 - 18.015: 98.9509% ( 6) 00:15:41.728 18.015 - 18.110: 98.9889% ( 5) 00:15:41.728 18.110 - 18.204: 99.0345% ( 6) 00:15:41.728 18.204 - 18.299: 99.1562% ( 16) 00:15:41.728 18.299 - 18.394: 99.2018% ( 6) 00:15:41.728 18.394 - 18.489: 99.3006% ( 13) 00:15:41.728 18.489 - 18.584: 99.3766% ( 10) 00:15:41.728 18.584 - 18.679: 99.4678% ( 12) 00:15:41.728 18.679 - 18.773: 99.5287% ( 8) 00:15:41.728 18.773 - 18.868: 99.5591% ( 4) 00:15:41.728 18.868 - 18.963: 99.5743% ( 2) 00:15:41.728 19.058 - 19.153: 99.6199% ( 6) 00:15:41.728 19.153 - 19.247: 99.6503% ( 4) 00:15:41.728 19.247 - 19.342: 99.6579% ( 1) 00:15:41.728 19.342 - 19.437: 99.6807% ( 3) 00:15:41.728 19.437 - 19.532: 99.7035% ( 3) 00:15:41.728 19.627 - 19.721: 99.7111% ( 1) 00:15:41.728 19.721 - 19.816: 99.7339% ( 3) 00:15:41.728 19.816 - 19.911: 99.7415% ( 1) 00:15:41.728 19.911 - 20.006: 99.7567% ( 2) 00:15:41.728 20.101 - 20.196: 99.7719% ( 2) 00:15:41.728 20.859 - 20.954: 99.7795% ( 1) 00:15:41.728 21.428 - 21.523: 99.7871% ( 1) 00:15:41.728 21.997 - 22.092: 99.7947% ( 1) 00:15:41.728 23.893 - 23.988: 99.8023% ( 1) 00:15:41.728 24.462 - 24.652: 99.8099% ( 1) 00:15:41.728 25.031 - 25.221: 99.8175% ( 1) 00:15:41.728 25.221 - 25.410: 99.8251% ( 1) 00:15:41.728 26.927 - 27.117: 99.8328% ( 1) 00:15:41.728 27.686 - 27.876: 99.8480% ( 2) 00:15:41.728 27.876 - 28.065: 99.8556% ( 1) 00:15:41.728 28.444 - 28.634: 99.8632% ( 1) 00:15:41.728 28.824 - 29.013: 99.8708% ( 1) 00:15:41.728 31.858 - 32.047: 99.8784% ( 1) 00:15:41.728 3980.705 - 4004.978: 99.9392% ( 8) 00:15:41.728 4004.978 - 4029.250: 99.9924% ( 7) 00:15:41.728 4029.250 - 4053.523: 100.0000% ( 1) 00:15:41.728 00:15:41.728 Complete histogram 00:15:41.728 ================== 00:15:41.728 Range in us Cumulative Count 00:15:41.728 2.027 - 2.039: 0.2129% ( 28) 00:15:41.728 2.039 - 2.050: 5.8537% ( 742) 00:15:41.728 2.050 - 2.062: 8.6286% ( 365) 00:15:41.728 2.062 - 2.074: 14.4215% ( 762) 00:15:41.728 2.074 - 2.086: 41.2802% ( 3533) 00:15:41.728 2.086 - 2.098: 46.9971% ( 752) 00:15:41.728 2.098 - 2.110: 49.5971% ( 342) 00:15:41.728 2.110 - 2.121: 53.0029% ( 448) 00:15:41.728 2.121 - 2.133: 53.8924% ( 117) 00:15:41.728 2.133 - 2.145: 59.8753% ( 787) 00:15:41.728 2.145 - 2.157: 69.7735% ( 1302) 00:15:41.728 2.157 - 2.169: 71.6284% ( 244) 00:15:41.728 2.169 - 2.181: 72.6775% ( 138) 00:15:41.728 2.181 - 2.193: 75.0266% ( 309) 00:15:41.728 2.193 - 2.204: 76.0757% ( 138) 00:15:41.728 2.204 - 2.216: 79.6184% ( 466) 00:15:41.728 2.216 - 2.228: 88.0569% ( 1110) 00:15:41.728 2.228 - 2.240: 90.2919% ( 294) 00:15:41.728 2.240 - 2.252: 91.0293% ( 97) 00:15:41.728 2.252 - 2.264: 91.7440% ( 94) 00:15:41.728 2.264 - 2.276: 92.1241% ( 50) 00:15:41.728 2.276 - 2.287: 92.5042% ( 50) 00:15:41.728 2.287 - 2.299: 93.2796% ( 102) 00:15:41.728 2.299 - 2.311: 93.7890% ( 67) 00:15:41.728 2.311 - 2.323: 93.9638% ( 23) 00:15:41.728 2.323 - 2.335: 94.0931% ( 17) 00:15:41.728 2.335 - 2.347: 94.2755% ( 24) 00:15:41.728 2.347 - 2.359: 94.3895% ( 15) 00:15:41.728 2.359 - 2.370: 94.6100% ( 29) 00:15:41.728 2.370 - 2.382: 94.9369% ( 43) 00:15:41.728 2.382 - 2.394: 95.2106% ( 36) 00:15:41.728 2.394 - 2.406: 95.4767% ( 35) 00:15:41.728 2.406 - 2.418: 95.6819% ( 27) 00:15:41.728 2.418 - 2.430: 95.8720% ( 25) 00:15:41.728 2.430 - 2.441: 96.0924% ( 29) 00:15:41.728 2.441 - 2.453: 96.2445% ( 20) 00:15:41.728 2.453 - 2.465: 96.3813% ( 18) 00:15:41.728 2.465 - 2.477: 96.5410% ( 21) 00:15:41.728 2.477 - 2.489: 96.6930% ( 20) 00:15:41.728 2.489 - 2.501: 96.8299% ( 18) 00:15:41.728 2.501 - 2.513: 96.9591% ( 17) 00:15:41.728 2.513 - 2.524: 97.0731% ( 15) 00:15:41.728 2.524 - 2.536: 97.1568% ( 11) 00:15:41.728 2.536 - 2.548: 97.2252% ( 9) 00:15:41.728 2.548 - 2.560: 97.2556% ( 4) 00:15:41.728 2.560 - 2.572: 97.2860% ( 4) 00:15:41.728 2.572 - 2.584: 97.3164% ( 4) 00:15:41.728 2.584 - 2.596: 97.3316% ( 2) 00:15:41.728 2.596 - 2.607: 97.3696% ( 5) 00:15:41.728 2.607 - 2.619: 97.3924% ( 3) 00:15:41.728 2.619 - 2.631: 97.4000% ( 1) 00:15:41.728 2.631 - 2.643: 97.4228% ( 3) 00:15:41.728 2.643 - 2.655: 97.4532% ( 4) 00:15:41.728 2.667 - 2.679: 97.4685% ( 2) 00:15:41.728 2.679 - 2.690: 97.5065% ( 5) 00:15:41.728 2.690 - 2.702: 97.5293% ( 3) 00:15:41.728 2.702 - 2.714: 97.5369% ( 1) 00:15:41.728 2.714 - 2.726: 97.5445% ( 1) 00:15:41.728 2.726 - 2.738: 97.5825% ( 5) 00:15:41.728 2.738 - 2.750: 97.6053% ( 3) 00:15:41.728 2.750 - 2.761: 97.6129% ( 1) 00:15:41.728 2.761 - 2.773: 97.6357% ( 3) 00:15:41.728 2.773 - 2.785: 97.6737% ( 5) 00:15:41.728 2.785 - 2.797: 97.6889% ( 2) 00:15:41.728 2.797 - 2.809: 97.7269% ( 5) 00:15:41.728 2.809 - 2.821: 97.7497% ( 3) 00:15:41.728 2.821 - 2.833: 97.7801% ( 4) 00:15:41.728 2.833 - 2.844: 97.7953% ( 2) 00:15:41.728 2.856 - 2.868: 97.8182% ( 3) 00:15:41.728 2.868 - 2.880: 97.8334% ( 2) 00:15:41.728 2.880 - 2.892: 97.8410% ( 1) 00:15:41.728 2.892 - 2.904: 97.8866% ( 6) 00:15:41.728 2.904 - 2.916: 97.9018% ( 2) 00:15:41.728 2.927 - 2.939: 97.9170% ( 2) 00:15:41.728 2.939 - 2.951: 97.9322% ( 2) 00:15:41.728 2.963 - 2.975: 97.9550% ( 3) 00:15:41.728 2.975 - 2.987: 97.9778% ( 3) 00:15:41.728 2.987 - 2.999: 97.9854% ( 1) 00:15:41.728 2.999 - 3.010: 98.0006% ( 2) 00:15:41.728 3.010 - 3.022: 98.0310% ( 4) 00:15:41.728 3.022 - 3.034: 98.0462% ( 2) 00:15:41.728 3.034 - 3.058: 98.0842% ( 5) 00:15:41.728 3.058 - 3.081: 98.1451% ( 8) 00:15:41.728 3.081 - 3.105: 98.1679% ( 3) 00:15:41.728 3.105 - 3.129: 98.1755% ( 1) 00:15:41.728 3.129 - 3.153: 98.1983% ( 3) 00:15:41.728 3.153 - 3.176: 98.2439% ( 6) 00:15:41.728 3.176 - 3.200: 98.2591% ( 2) 00:15:41.728 3.200 - 3.224: 98.2743% ( 2) 00:15:41.728 3.224 - 3.247: 98.2971% ( 3) 00:15:41.728 3.247 - 3.271: 98.3123% ( 2) 00:15:41.728 3.271 - 3.295: 98.3275% ( 2) 00:15:41.728 3.295 - 3.319: 98.3503% ( 3) 00:15:41.728 3.319 - 3.342: 98.3655% ( 2) 00:15:41.728 3.342 - 3.366: 98.3883% ( 3) 00:15:41.728 3.366 - 3.390: 98.3959% ( 1) 00:15:41.728 3.390 - 3.413: 98.4111% ( 2) 00:15:41.728 3.437 - 3.461: 98.4187% ( 1) 00:15:41.728 3.461 - 3.484: 98.4415% ( 3) 00:15:41.728 3.484 - 3.508: 98.4491% ( 1) 00:15:41.728 3.508 - 3.532: 98.5024% ( 7) 00:15:41.729 3.532 - 3.556: 98.5100% ( 1) 00:15:41.729 3.556 - 3.579: 98.5176% ( 1) 00:15:41.729 3.579 - 3.603: 98.5404% ( 3) 00:15:41.729 3.627 - 3.650: 98.5480% ( 1) 00:15:41.729 3.650 - 3.674: 98.5632% ( 2) 00:15:41.729 3.674 - 3.698: 98.5860% ( 3) 00:15:41.729 3.698 - 3.721: 98.5936% ( 1) 00:15:41.729 3.816 - 3.840: 98.6012% ( 1) 00:15:41.729 3.864 - 3.887: 98.6164% ( 2) 00:15:41.729 3.887 - 3.911: 98.6240% ( 1) 00:15:41.729 3.935 - 3.959: 98.6316% ( 1) 00:15:41.729 3.982 - 4.006: 98.6392% ( 1) 00:15:41.729 4.006 - 4.030: 98.6468% ( 1) 00:15:41.729 4.030 - 4.053: 98.6620% ( 2) 00:15:41.729 4.267 - 4.290: 98.6696% ( 1) 00:15:41.729 4.314 - 4.338: 98.6772%[2024-04-23 05:00:20.813431] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:41.729 ( 1) 00:15:41.729 4.575 - 4.599: 98.6848% ( 1) 00:15:41.729 4.646 - 4.670: 98.6924% ( 1) 00:15:41.729 5.191 - 5.215: 98.7000% ( 1) 00:15:41.729 5.262 - 5.286: 98.7076% ( 1) 00:15:41.729 5.499 - 5.523: 98.7152% ( 1) 00:15:41.729 6.068 - 6.116: 98.7228% ( 1) 00:15:41.729 6.305 - 6.353: 98.7304% ( 1) 00:15:41.729 6.400 - 6.447: 98.7380% ( 1) 00:15:41.729 6.590 - 6.637: 98.7456% ( 1) 00:15:41.729 6.969 - 7.016: 98.7532% ( 1) 00:15:41.729 7.016 - 7.064: 98.7608% ( 1) 00:15:41.729 7.775 - 7.822: 98.7760% ( 2) 00:15:41.729 7.870 - 7.917: 98.7836% ( 1) 00:15:41.729 8.818 - 8.865: 98.7912% ( 1) 00:15:41.729 9.055 - 9.102: 98.7988% ( 1) 00:15:41.729 9.197 - 9.244: 98.8064% ( 1) 00:15:41.729 9.339 - 9.387: 98.8140% ( 1) 00:15:41.729 11.425 - 11.473: 98.8217% ( 1) 00:15:41.729 12.089 - 12.136: 98.8293% ( 1) 00:15:41.729 13.748 - 13.843: 98.8369% ( 1) 00:15:41.729 15.455 - 15.550: 98.8521% ( 2) 00:15:41.729 15.644 - 15.739: 98.8597% ( 1) 00:15:41.729 15.739 - 15.834: 98.8749% ( 2) 00:15:41.729 15.834 - 15.929: 98.8977% ( 3) 00:15:41.729 15.929 - 16.024: 98.9205% ( 3) 00:15:41.729 16.119 - 16.213: 98.9585% ( 5) 00:15:41.729 16.213 - 16.308: 98.9965% ( 5) 00:15:41.729 16.308 - 16.403: 99.0041% ( 1) 00:15:41.729 16.403 - 16.498: 99.0573% ( 7) 00:15:41.729 16.498 - 16.593: 99.1181% ( 8) 00:15:41.729 16.593 - 16.687: 99.1485% ( 4) 00:15:41.729 16.687 - 16.782: 99.1714% ( 3) 00:15:41.729 16.782 - 16.877: 99.2246% ( 7) 00:15:41.729 16.877 - 16.972: 99.2322% ( 1) 00:15:41.729 16.972 - 17.067: 99.2626% ( 4) 00:15:41.729 17.067 - 17.161: 99.2778% ( 2) 00:15:41.729 17.161 - 17.256: 99.2854% ( 1) 00:15:41.729 17.256 - 17.351: 99.2930% ( 1) 00:15:41.729 17.446 - 17.541: 99.3082% ( 2) 00:15:41.729 17.730 - 17.825: 99.3234% ( 2) 00:15:41.729 17.920 - 18.015: 99.3386% ( 2) 00:15:41.729 18.015 - 18.110: 99.3538% ( 2) 00:15:41.729 18.110 - 18.204: 99.3690% ( 2) 00:15:41.729 18.679 - 18.773: 99.3766% ( 1) 00:15:41.729 18.773 - 18.868: 99.3842% ( 1) 00:15:41.729 18.868 - 18.963: 99.3918% ( 1) 00:15:41.729 20.764 - 20.859: 99.3994% ( 1) 00:15:41.729 21.428 - 21.523: 99.4070% ( 1) 00:15:41.729 22.281 - 22.376: 99.4146% ( 1) 00:15:41.729 25.979 - 26.169: 99.4222% ( 1) 00:15:41.729 30.151 - 30.341: 99.4298% ( 1) 00:15:41.729 32.806 - 32.996: 99.4374% ( 1) 00:15:41.729 3980.705 - 4004.978: 99.7795% ( 45) 00:15:41.729 4004.978 - 4029.250: 99.9924% ( 28) 00:15:41.729 4029.250 - 4053.523: 100.0000% ( 1) 00:15:41.729 00:15:41.729 05:00:20 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:41.729 05:00:20 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:41.729 05:00:20 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:41.729 05:00:20 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:41.729 05:00:20 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:41.987 [ 00:15:41.987 { 00:15:41.987 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:41.987 "subtype": "Discovery", 00:15:41.987 "listen_addresses": [], 00:15:41.987 "allow_any_host": true, 00:15:41.987 "hosts": [] 00:15:41.987 }, 00:15:41.987 { 00:15:41.987 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:41.987 "subtype": "NVMe", 00:15:41.987 "listen_addresses": [ 00:15:41.987 { 00:15:41.987 "transport": "VFIOUSER", 00:15:41.987 "trtype": "VFIOUSER", 00:15:41.987 "adrfam": "IPv4", 00:15:41.987 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:41.987 "trsvcid": "0" 00:15:41.987 } 00:15:41.987 ], 00:15:41.987 "allow_any_host": true, 00:15:41.987 "hosts": [], 00:15:41.987 "serial_number": "SPDK1", 00:15:41.987 "model_number": "SPDK bdev Controller", 00:15:41.987 "max_namespaces": 32, 00:15:41.987 "min_cntlid": 1, 00:15:41.987 "max_cntlid": 65519, 00:15:41.987 "namespaces": [ 00:15:41.987 { 00:15:41.987 "nsid": 1, 00:15:41.987 "bdev_name": "Malloc1", 00:15:41.987 "name": "Malloc1", 00:15:41.987 "nguid": "5E0B731E10F04489BE1B919BDCE1F3E3", 00:15:41.987 "uuid": "5e0b731e-10f0-4489-be1b-919bdce1f3e3" 00:15:41.987 }, 00:15:41.987 { 00:15:41.987 "nsid": 2, 00:15:41.987 "bdev_name": "Malloc3", 00:15:41.987 "name": "Malloc3", 00:15:41.987 "nguid": "137B95E018094B21A9BA463050F80188", 00:15:41.987 "uuid": "137b95e0-1809-4b21-a9ba-463050f80188" 00:15:41.987 } 00:15:41.987 ] 00:15:41.987 }, 00:15:41.987 { 00:15:41.987 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:41.987 "subtype": "NVMe", 00:15:41.987 "listen_addresses": [ 00:15:41.987 { 00:15:41.987 "transport": "VFIOUSER", 00:15:41.987 "trtype": "VFIOUSER", 00:15:41.987 "adrfam": "IPv4", 00:15:41.987 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:41.987 "trsvcid": "0" 00:15:41.987 } 00:15:41.987 ], 00:15:41.987 "allow_any_host": true, 00:15:41.987 "hosts": [], 00:15:41.987 "serial_number": "SPDK2", 00:15:41.987 "model_number": "SPDK bdev Controller", 00:15:41.987 "max_namespaces": 32, 00:15:41.987 "min_cntlid": 1, 00:15:41.987 "max_cntlid": 65519, 00:15:41.987 "namespaces": [ 00:15:41.987 { 00:15:41.987 "nsid": 1, 00:15:41.987 "bdev_name": "Malloc2", 00:15:41.987 "name": "Malloc2", 00:15:41.987 "nguid": "F789FDD68F824F5BA606CBB4737678F9", 00:15:41.987 "uuid": "f789fdd6-8f82-4f5b-a606-cbb4737678f9" 00:15:41.987 } 00:15:41.987 ] 00:15:41.987 } 00:15:41.987 ] 00:15:41.987 05:00:21 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:41.987 05:00:21 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2368663 00:15:41.987 05:00:21 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:41.987 05:00:21 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:41.987 05:00:21 -- common/autotest_common.sh@1251 -- # local i=0 00:15:41.987 05:00:21 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:41.987 05:00:21 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:41.987 05:00:21 -- common/autotest_common.sh@1262 -- # return 0 00:15:41.987 05:00:21 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:41.987 05:00:21 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:42.244 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.244 [2024-04-23 05:00:21.278949] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:42.244 Malloc4 00:15:42.244 05:00:21 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:15:42.501 [2024-04-23 05:00:21.618418] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:42.501 05:00:21 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:42.501 Asynchronous Event Request test 00:15:42.501 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:42.501 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:42.501 Registering asynchronous event callbacks... 00:15:42.501 Starting namespace attribute notice tests for all controllers... 00:15:42.501 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:42.501 aer_cb - Changed Namespace 00:15:42.501 Cleaning up... 00:15:42.758 [ 00:15:42.758 { 00:15:42.758 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:42.758 "subtype": "Discovery", 00:15:42.758 "listen_addresses": [], 00:15:42.758 "allow_any_host": true, 00:15:42.758 "hosts": [] 00:15:42.758 }, 00:15:42.758 { 00:15:42.758 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:42.758 "subtype": "NVMe", 00:15:42.758 "listen_addresses": [ 00:15:42.759 { 00:15:42.759 "transport": "VFIOUSER", 00:15:42.759 "trtype": "VFIOUSER", 00:15:42.759 "adrfam": "IPv4", 00:15:42.759 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:42.759 "trsvcid": "0" 00:15:42.759 } 00:15:42.759 ], 00:15:42.759 "allow_any_host": true, 00:15:42.759 "hosts": [], 00:15:42.759 "serial_number": "SPDK1", 00:15:42.759 "model_number": "SPDK bdev Controller", 00:15:42.759 "max_namespaces": 32, 00:15:42.759 "min_cntlid": 1, 00:15:42.759 "max_cntlid": 65519, 00:15:42.759 "namespaces": [ 00:15:42.759 { 00:15:42.759 "nsid": 1, 00:15:42.759 "bdev_name": "Malloc1", 00:15:42.759 "name": "Malloc1", 00:15:42.759 "nguid": "5E0B731E10F04489BE1B919BDCE1F3E3", 00:15:42.759 "uuid": "5e0b731e-10f0-4489-be1b-919bdce1f3e3" 00:15:42.759 }, 00:15:42.759 { 00:15:42.759 "nsid": 2, 00:15:42.759 "bdev_name": "Malloc3", 00:15:42.759 "name": "Malloc3", 00:15:42.759 "nguid": "137B95E018094B21A9BA463050F80188", 00:15:42.759 "uuid": "137b95e0-1809-4b21-a9ba-463050f80188" 00:15:42.759 } 00:15:42.759 ] 00:15:42.759 }, 00:15:42.759 { 00:15:42.759 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:42.759 "subtype": "NVMe", 00:15:42.759 "listen_addresses": [ 00:15:42.759 { 00:15:42.759 "transport": "VFIOUSER", 00:15:42.759 "trtype": "VFIOUSER", 00:15:42.759 "adrfam": "IPv4", 00:15:42.759 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:42.759 "trsvcid": "0" 00:15:42.759 } 00:15:42.759 ], 00:15:42.759 "allow_any_host": true, 00:15:42.759 "hosts": [], 00:15:42.759 "serial_number": "SPDK2", 00:15:42.759 "model_number": "SPDK bdev Controller", 00:15:42.759 "max_namespaces": 32, 00:15:42.759 "min_cntlid": 1, 00:15:42.759 "max_cntlid": 65519, 00:15:42.759 "namespaces": [ 00:15:42.759 { 00:15:42.759 "nsid": 1, 00:15:42.759 "bdev_name": "Malloc2", 00:15:42.759 "name": "Malloc2", 00:15:42.759 "nguid": "F789FDD68F824F5BA606CBB4737678F9", 00:15:42.759 "uuid": "f789fdd6-8f82-4f5b-a606-cbb4737678f9" 00:15:42.759 }, 00:15:42.759 { 00:15:42.759 "nsid": 2, 00:15:42.759 "bdev_name": "Malloc4", 00:15:42.759 "name": "Malloc4", 00:15:42.759 "nguid": "3B439ABD2AB74B7B87086665DA0072CA", 00:15:42.759 "uuid": "3b439abd-2ab7-4b7b-8708-6665da0072ca" 00:15:42.759 } 00:15:42.759 ] 00:15:42.759 } 00:15:42.759 ] 00:15:42.759 05:00:21 -- target/nvmf_vfio_user.sh@44 -- # wait 2368663 00:15:42.759 05:00:21 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:15:42.759 05:00:21 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2362456 00:15:42.759 05:00:21 -- common/autotest_common.sh@936 -- # '[' -z 2362456 ']' 00:15:42.759 05:00:21 -- common/autotest_common.sh@940 -- # kill -0 2362456 00:15:42.759 05:00:21 -- common/autotest_common.sh@941 -- # uname 00:15:42.759 05:00:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:42.759 05:00:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2362456 00:15:42.759 05:00:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:42.759 05:00:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:42.759 05:00:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2362456' 00:15:42.759 killing process with pid 2362456 00:15:42.759 05:00:21 -- common/autotest_common.sh@955 -- # kill 2362456 00:15:42.759 [2024-04-23 05:00:21.898721] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:15:42.759 05:00:21 -- common/autotest_common.sh@960 -- # wait 2362456 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2368799 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2368799' 00:15:43.324 Process pid: 2368799 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:43.324 05:00:22 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2368799 00:15:43.324 05:00:22 -- common/autotest_common.sh@817 -- # '[' -z 2368799 ']' 00:15:43.324 05:00:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:43.324 05:00:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:43.324 05:00:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:43.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:43.325 05:00:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:43.325 05:00:22 -- common/autotest_common.sh@10 -- # set +x 00:15:43.325 [2024-04-23 05:00:22.270718] thread.c:2927:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:15:43.325 [2024-04-23 05:00:22.271719] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:15:43.325 [2024-04-23 05:00:22.271788] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:43.325 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.325 [2024-04-23 05:00:22.304730] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:15:43.325 [2024-04-23 05:00:22.336557] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:43.325 [2024-04-23 05:00:22.426780] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:43.325 [2024-04-23 05:00:22.426845] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:43.325 [2024-04-23 05:00:22.426872] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:43.325 [2024-04-23 05:00:22.426886] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:43.325 [2024-04-23 05:00:22.426898] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:43.325 [2024-04-23 05:00:22.426976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:43.325 [2024-04-23 05:00:22.427028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:43.325 [2024-04-23 05:00:22.427142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:43.325 [2024-04-23 05:00:22.427144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:43.581 [2024-04-23 05:00:22.523393] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:15:43.581 [2024-04-23 05:00:22.523659] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:15:43.581 [2024-04-23 05:00:22.523888] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:15:43.581 [2024-04-23 05:00:22.524651] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:15:43.581 [2024-04-23 05:00:22.524758] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:15:43.581 05:00:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:43.581 05:00:22 -- common/autotest_common.sh@850 -- # return 0 00:15:43.581 05:00:22 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:44.511 05:00:23 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:15:44.769 05:00:23 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:44.769 05:00:23 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:44.769 05:00:23 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:44.769 05:00:23 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:44.769 05:00:23 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:45.028 Malloc1 00:15:45.028 05:00:24 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:45.286 05:00:24 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:45.543 05:00:24 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:45.799 05:00:24 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:45.799 05:00:24 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:45.799 05:00:24 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:46.057 Malloc2 00:15:46.057 05:00:25 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:46.315 05:00:25 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:46.572 05:00:25 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:46.830 05:00:25 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:15:46.830 05:00:25 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2368799 00:15:46.830 05:00:25 -- common/autotest_common.sh@936 -- # '[' -z 2368799 ']' 00:15:46.830 05:00:25 -- common/autotest_common.sh@940 -- # kill -0 2368799 00:15:46.830 05:00:25 -- common/autotest_common.sh@941 -- # uname 00:15:46.830 05:00:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:46.830 05:00:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2368799 00:15:46.830 05:00:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:46.830 05:00:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:46.830 05:00:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2368799' 00:15:46.830 killing process with pid 2368799 00:15:46.830 05:00:25 -- common/autotest_common.sh@955 -- # kill 2368799 00:15:46.830 05:00:25 -- common/autotest_common.sh@960 -- # wait 2368799 00:15:47.088 05:00:26 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:47.088 05:00:26 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:47.088 00:15:47.088 real 0m52.243s 00:15:47.088 user 3m26.226s 00:15:47.088 sys 0m4.318s 00:15:47.088 05:00:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:47.088 05:00:26 -- common/autotest_common.sh@10 -- # set +x 00:15:47.088 ************************************ 00:15:47.088 END TEST nvmf_vfio_user 00:15:47.088 ************************************ 00:15:47.088 05:00:26 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:47.088 05:00:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:47.088 05:00:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:47.088 05:00:26 -- common/autotest_common.sh@10 -- # set +x 00:15:47.347 ************************************ 00:15:47.347 START TEST nvmf_vfio_user_nvme_compliance 00:15:47.347 ************************************ 00:15:47.347 05:00:26 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:47.347 * Looking for test storage... 00:15:47.347 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:15:47.347 05:00:26 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:47.347 05:00:26 -- nvmf/common.sh@7 -- # uname -s 00:15:47.347 05:00:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:47.347 05:00:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:47.347 05:00:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:47.347 05:00:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:47.347 05:00:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:47.347 05:00:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:47.347 05:00:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:47.347 05:00:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:47.347 05:00:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:47.347 05:00:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:47.347 05:00:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:47.347 05:00:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:47.347 05:00:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:47.347 05:00:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:47.347 05:00:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:47.347 05:00:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:47.347 05:00:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:47.347 05:00:26 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:47.347 05:00:26 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:47.347 05:00:26 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:47.347 05:00:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.347 05:00:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.347 05:00:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.347 05:00:26 -- paths/export.sh@5 -- # export PATH 00:15:47.347 05:00:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.347 05:00:26 -- nvmf/common.sh@47 -- # : 0 00:15:47.347 05:00:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:47.347 05:00:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:47.347 05:00:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:47.347 05:00:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:47.347 05:00:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:47.347 05:00:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:47.347 05:00:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:47.347 05:00:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:47.347 05:00:26 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:47.347 05:00:26 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:47.347 05:00:26 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:15:47.347 05:00:26 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:15:47.347 05:00:26 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:15:47.347 05:00:26 -- compliance/compliance.sh@20 -- # nvmfpid=2369286 00:15:47.347 05:00:26 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:15:47.347 05:00:26 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2369286' 00:15:47.347 Process pid: 2369286 00:15:47.347 05:00:26 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:47.347 05:00:26 -- compliance/compliance.sh@24 -- # waitforlisten 2369286 00:15:47.347 05:00:26 -- common/autotest_common.sh@817 -- # '[' -z 2369286 ']' 00:15:47.347 05:00:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:47.347 05:00:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:47.347 05:00:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:47.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:47.347 05:00:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:47.347 05:00:26 -- common/autotest_common.sh@10 -- # set +x 00:15:47.347 [2024-04-23 05:00:26.383806] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:15:47.347 [2024-04-23 05:00:26.383897] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:47.347 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.347 [2024-04-23 05:00:26.415704] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:15:47.347 [2024-04-23 05:00:26.442616] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:47.605 [2024-04-23 05:00:26.527453] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:47.605 [2024-04-23 05:00:26.527527] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:47.605 [2024-04-23 05:00:26.527544] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:47.605 [2024-04-23 05:00:26.527557] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:47.605 [2024-04-23 05:00:26.527568] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:47.605 [2024-04-23 05:00:26.527620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:47.605 [2024-04-23 05:00:26.527671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:47.605 [2024-04-23 05:00:26.527674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:47.605 05:00:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:47.605 05:00:26 -- common/autotest_common.sh@850 -- # return 0 00:15:47.605 05:00:26 -- compliance/compliance.sh@26 -- # sleep 1 00:15:48.536 05:00:27 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:15:48.536 05:00:27 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:15:48.536 05:00:27 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:15:48.536 05:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:48.536 05:00:27 -- common/autotest_common.sh@10 -- # set +x 00:15:48.536 05:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:48.536 05:00:27 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:15:48.536 05:00:27 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:15:48.536 05:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:48.536 05:00:27 -- common/autotest_common.sh@10 -- # set +x 00:15:48.536 malloc0 00:15:48.536 05:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:48.536 05:00:27 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:15:48.536 05:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:48.536 05:00:27 -- common/autotest_common.sh@10 -- # set +x 00:15:48.536 05:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:48.537 05:00:27 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:15:48.537 05:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:48.537 05:00:27 -- common/autotest_common.sh@10 -- # set +x 00:15:48.793 05:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:48.793 05:00:27 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:15:48.793 05:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:48.793 05:00:27 -- common/autotest_common.sh@10 -- # set +x 00:15:48.793 05:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:48.793 05:00:27 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:15:48.793 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.793 00:15:48.793 00:15:48.793 CUnit - A unit testing framework for C - Version 2.1-3 00:15:48.793 http://cunit.sourceforge.net/ 00:15:48.793 00:15:48.793 00:15:48.793 Suite: nvme_compliance 00:15:48.793 Test: admin_identify_ctrlr_verify_dptr ...[2024-04-23 05:00:27.874077] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:48.793 [2024-04-23 05:00:27.875552] vfio_user.c: 804:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:15:48.793 [2024-04-23 05:00:27.875589] vfio_user.c:5514:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:15:48.793 [2024-04-23 05:00:27.875602] vfio_user.c:5607:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:15:48.793 [2024-04-23 05:00:27.877097] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:48.793 passed 00:15:49.050 Test: admin_identify_ctrlr_verify_fused ...[2024-04-23 05:00:27.964746] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.050 [2024-04-23 05:00:27.967767] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.050 passed 00:15:49.050 Test: admin_identify_ns ...[2024-04-23 05:00:28.054079] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.050 [2024-04-23 05:00:28.114547] ctrlr.c:2656:_nvmf_ctrlr_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:15:49.050 [2024-04-23 05:00:28.122546] ctrlr.c:2656:_nvmf_ctrlr_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:15:49.050 [2024-04-23 05:00:28.143673] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.050 passed 00:15:49.308 Test: admin_get_features_mandatory_features ...[2024-04-23 05:00:28.228380] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.308 [2024-04-23 05:00:28.231406] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.308 passed 00:15:49.308 Test: admin_get_features_optional_features ...[2024-04-23 05:00:28.311966] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.308 [2024-04-23 05:00:28.317998] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.308 passed 00:15:49.308 Test: admin_set_features_number_of_queues ...[2024-04-23 05:00:28.400268] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.565 [2024-04-23 05:00:28.504630] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.565 passed 00:15:49.565 Test: admin_get_log_page_mandatory_logs ...[2024-04-23 05:00:28.588371] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.565 [2024-04-23 05:00:28.591398] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.565 passed 00:15:49.565 Test: admin_get_log_page_with_lpo ...[2024-04-23 05:00:28.675579] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.823 [2024-04-23 05:00:28.743544] ctrlr.c:2604:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:15:49.823 [2024-04-23 05:00:28.756618] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.823 passed 00:15:49.823 Test: fabric_property_get ...[2024-04-23 05:00:28.840402] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.823 [2024-04-23 05:00:28.841685] vfio_user.c:5607:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x7f failed 00:15:49.823 [2024-04-23 05:00:28.843427] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.823 passed 00:15:49.823 Test: admin_delete_io_sq_use_admin_qid ...[2024-04-23 05:00:28.929035] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:49.823 [2024-04-23 05:00:28.930317] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:15:49.823 [2024-04-23 05:00:28.932057] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:49.823 passed 00:15:50.080 Test: admin_delete_io_sq_delete_sq_twice ...[2024-04-23 05:00:29.015221] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:50.080 [2024-04-23 05:00:29.098536] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:50.080 [2024-04-23 05:00:29.114541] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:50.080 [2024-04-23 05:00:29.119639] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:50.080 passed 00:15:50.080 Test: admin_delete_io_cq_use_admin_qid ...[2024-04-23 05:00:29.203582] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:50.080 [2024-04-23 05:00:29.204865] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:15:50.080 [2024-04-23 05:00:29.206602] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:50.080 passed 00:15:50.338 Test: admin_delete_io_cq_delete_cq_first ...[2024-04-23 05:00:29.289800] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:50.338 [2024-04-23 05:00:29.365541] vfio_user.c:2319:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:15:50.338 [2024-04-23 05:00:29.389527] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:50.338 [2024-04-23 05:00:29.394633] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:50.338 passed 00:15:50.338 Test: admin_create_io_cq_verify_iv_pc ...[2024-04-23 05:00:29.478902] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:50.338 [2024-04-23 05:00:29.480191] vfio_user.c:2158:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:15:50.338 [2024-04-23 05:00:29.480243] vfio_user.c:2152:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:15:50.338 [2024-04-23 05:00:29.481937] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:50.594 passed 00:15:50.594 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-04-23 05:00:29.563134] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:50.594 [2024-04-23 05:00:29.658524] vfio_user.c:2240:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:15:50.594 [2024-04-23 05:00:29.666538] vfio_user.c:2240:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:15:50.594 [2024-04-23 05:00:29.674539] vfio_user.c:2038:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:15:50.594 [2024-04-23 05:00:29.682541] vfio_user.c:2038:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:15:50.594 [2024-04-23 05:00:29.711660] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:50.594 passed 00:15:50.852 Test: admin_create_io_sq_verify_pc ...[2024-04-23 05:00:29.791347] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:50.852 [2024-04-23 05:00:29.807536] vfio_user.c:2051:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:15:50.852 [2024-04-23 05:00:29.824787] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:50.852 passed 00:15:50.852 Test: admin_create_io_qp_max_qps ...[2024-04-23 05:00:29.911383] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:52.222 [2024-04-23 05:00:31.017535] nvme_ctrlr.c:5329:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:15:52.479 [2024-04-23 05:00:31.407146] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:52.479 passed 00:15:52.479 Test: admin_create_io_sq_shared_cq ...[2024-04-23 05:00:31.491190] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:52.479 [2024-04-23 05:00:31.622524] vfio_user.c:2319:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:15:52.737 [2024-04-23 05:00:31.658625] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:52.737 passed 00:15:52.737 00:15:52.737 Run Summary: Type Total Ran Passed Failed Inactive 00:15:52.737 suites 1 1 n/a 0 0 00:15:52.737 tests 18 18 18 0 0 00:15:52.737 asserts 360 360 360 0 n/a 00:15:52.737 00:15:52.737 Elapsed time = 1.570 seconds 00:15:52.737 05:00:31 -- compliance/compliance.sh@42 -- # killprocess 2369286 00:15:52.737 05:00:31 -- common/autotest_common.sh@936 -- # '[' -z 2369286 ']' 00:15:52.737 05:00:31 -- common/autotest_common.sh@940 -- # kill -0 2369286 00:15:52.737 05:00:31 -- common/autotest_common.sh@941 -- # uname 00:15:52.737 05:00:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:52.737 05:00:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2369286 00:15:52.737 05:00:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:52.737 05:00:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:52.737 05:00:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2369286' 00:15:52.737 killing process with pid 2369286 00:15:52.737 05:00:31 -- common/autotest_common.sh@955 -- # kill 2369286 00:15:52.737 05:00:31 -- common/autotest_common.sh@960 -- # wait 2369286 00:15:52.996 05:00:31 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:15:52.996 05:00:32 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:15:52.996 00:15:52.996 real 0m5.737s 00:15:52.996 user 0m16.094s 00:15:52.996 sys 0m0.562s 00:15:52.996 05:00:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:52.996 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:15:52.996 ************************************ 00:15:52.996 END TEST nvmf_vfio_user_nvme_compliance 00:15:52.996 ************************************ 00:15:52.996 05:00:32 -- nvmf/nvmf.sh@43 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:15:52.996 05:00:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:52.996 05:00:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:52.996 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:15:52.996 ************************************ 00:15:52.996 START TEST nvmf_vfio_user_fuzz 00:15:52.996 ************************************ 00:15:52.996 05:00:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:15:53.255 * Looking for test storage... 00:15:53.255 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:53.255 05:00:32 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:53.255 05:00:32 -- nvmf/common.sh@7 -- # uname -s 00:15:53.255 05:00:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:53.255 05:00:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:53.255 05:00:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:53.255 05:00:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:53.255 05:00:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:53.255 05:00:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:53.255 05:00:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:53.255 05:00:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:53.255 05:00:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:53.255 05:00:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:53.255 05:00:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.255 05:00:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.255 05:00:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:53.255 05:00:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:53.255 05:00:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:53.255 05:00:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:53.255 05:00:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:53.255 05:00:32 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:53.255 05:00:32 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:53.255 05:00:32 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:53.255 05:00:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.255 05:00:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.255 05:00:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.255 05:00:32 -- paths/export.sh@5 -- # export PATH 00:15:53.255 05:00:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.255 05:00:32 -- nvmf/common.sh@47 -- # : 0 00:15:53.255 05:00:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:53.255 05:00:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:53.255 05:00:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:53.256 05:00:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:53.256 05:00:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:53.256 05:00:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:53.256 05:00:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:53.256 05:00:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2370050 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2370050' 00:15:53.256 Process pid: 2370050 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:53.256 05:00:32 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2370050 00:15:53.256 05:00:32 -- common/autotest_common.sh@817 -- # '[' -z 2370050 ']' 00:15:53.256 05:00:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:53.256 05:00:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:53.256 05:00:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:53.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:53.256 05:00:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:53.256 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:15:53.514 05:00:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:53.514 05:00:32 -- common/autotest_common.sh@850 -- # return 0 00:15:53.514 05:00:32 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:15:54.448 05:00:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:54.448 05:00:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.448 05:00:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:15:54.448 05:00:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:54.448 05:00:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.448 malloc0 00:15:54.448 05:00:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:15:54.448 05:00:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:54.448 05:00:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.448 05:00:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:15:54.448 05:00:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:54.448 05:00:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.448 05:00:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:15:54.448 05:00:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:54.448 05:00:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.448 05:00:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:15:54.448 05:00:33 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:26.552 Fuzzing completed. Shutting down the fuzz application 00:16:26.552 00:16:26.552 Dumping successful admin opcodes: 00:16:26.552 8, 9, 10, 24, 00:16:26.552 Dumping successful io opcodes: 00:16:26.552 0, 00:16:26.552 NS: 0x200003a1ef00 I/O qp, Total commands completed: 546223, total successful commands: 2102, random_seed: 2630756352 00:16:26.552 NS: 0x200003a1ef00 admin qp, Total commands completed: 69668, total successful commands: 546, random_seed: 456479872 00:16:26.552 05:01:04 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:26.552 05:01:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:26.552 05:01:04 -- common/autotest_common.sh@10 -- # set +x 00:16:26.552 05:01:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:26.552 05:01:05 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2370050 00:16:26.552 05:01:05 -- common/autotest_common.sh@936 -- # '[' -z 2370050 ']' 00:16:26.552 05:01:05 -- common/autotest_common.sh@940 -- # kill -0 2370050 00:16:26.552 05:01:05 -- common/autotest_common.sh@941 -- # uname 00:16:26.552 05:01:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:26.552 05:01:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2370050 00:16:26.552 05:01:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:26.552 05:01:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:26.552 05:01:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2370050' 00:16:26.552 killing process with pid 2370050 00:16:26.552 05:01:05 -- common/autotest_common.sh@955 -- # kill 2370050 00:16:26.552 05:01:05 -- common/autotest_common.sh@960 -- # wait 2370050 00:16:26.552 05:01:05 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:26.552 05:01:05 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:26.552 00:16:26.552 real 0m33.198s 00:16:26.552 user 0m33.477s 00:16:26.552 sys 0m27.390s 00:16:26.552 05:01:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:26.552 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:16:26.552 ************************************ 00:16:26.552 END TEST nvmf_vfio_user_fuzz 00:16:26.552 ************************************ 00:16:26.552 05:01:05 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:26.552 05:01:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:26.552 05:01:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:26.552 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:16:26.552 ************************************ 00:16:26.552 START TEST nvmf_host_management 00:16:26.552 ************************************ 00:16:26.552 05:01:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:26.552 * Looking for test storage... 00:16:26.552 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:26.552 05:01:05 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:26.552 05:01:05 -- nvmf/common.sh@7 -- # uname -s 00:16:26.552 05:01:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:26.552 05:01:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:26.552 05:01:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:26.552 05:01:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:26.552 05:01:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:26.552 05:01:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:26.552 05:01:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:26.553 05:01:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:26.553 05:01:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:26.553 05:01:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:26.553 05:01:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.553 05:01:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.553 05:01:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:26.553 05:01:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:26.553 05:01:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:26.553 05:01:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:26.553 05:01:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:26.553 05:01:05 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:26.553 05:01:05 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:26.553 05:01:05 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:26.553 05:01:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.553 05:01:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.553 05:01:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.553 05:01:05 -- paths/export.sh@5 -- # export PATH 00:16:26.553 05:01:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.553 05:01:05 -- nvmf/common.sh@47 -- # : 0 00:16:26.553 05:01:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:26.553 05:01:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:26.553 05:01:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:26.553 05:01:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:26.553 05:01:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:26.553 05:01:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:26.553 05:01:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:26.553 05:01:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:26.553 05:01:05 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:26.553 05:01:05 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:26.553 05:01:05 -- target/host_management.sh@105 -- # nvmftestinit 00:16:26.553 05:01:05 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:16:26.553 05:01:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:26.553 05:01:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:26.553 05:01:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:26.553 05:01:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:26.553 05:01:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.553 05:01:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.553 05:01:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.553 05:01:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:26.553 05:01:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:26.553 05:01:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:26.553 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:16:28.463 05:01:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:28.463 05:01:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:28.463 05:01:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:28.463 05:01:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:28.463 05:01:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:28.463 05:01:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:28.463 05:01:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:28.463 05:01:07 -- nvmf/common.sh@295 -- # net_devs=() 00:16:28.463 05:01:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:28.463 05:01:07 -- nvmf/common.sh@296 -- # e810=() 00:16:28.463 05:01:07 -- nvmf/common.sh@296 -- # local -ga e810 00:16:28.463 05:01:07 -- nvmf/common.sh@297 -- # x722=() 00:16:28.463 05:01:07 -- nvmf/common.sh@297 -- # local -ga x722 00:16:28.463 05:01:07 -- nvmf/common.sh@298 -- # mlx=() 00:16:28.463 05:01:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:28.463 05:01:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:28.463 05:01:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:28.463 05:01:07 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:16:28.463 05:01:07 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:28.463 05:01:07 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:28.463 05:01:07 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:28.463 05:01:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:28.463 05:01:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:28.464 05:01:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:28.464 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:28.464 05:01:07 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:28.464 05:01:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:28.464 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:28.464 05:01:07 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:28.464 05:01:07 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:28.464 05:01:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:28.464 05:01:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:28.464 05:01:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:28.464 05:01:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:28.464 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:28.464 05:01:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:28.464 05:01:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:28.464 05:01:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:28.464 05:01:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:28.464 05:01:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:28.464 05:01:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:28.464 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:28.464 05:01:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:28.464 05:01:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:28.464 05:01:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:28.464 05:01:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:16:28.464 05:01:07 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:16:28.464 05:01:07 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:28.464 05:01:07 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:28.464 05:01:07 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:28.464 05:01:07 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:16:28.464 05:01:07 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:28.464 05:01:07 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:28.464 05:01:07 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:16:28.464 05:01:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:28.464 05:01:07 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:28.464 05:01:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:16:28.464 05:01:07 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:16:28.464 05:01:07 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:16:28.464 05:01:07 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:28.464 05:01:07 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:28.464 05:01:07 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:28.464 05:01:07 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:16:28.464 05:01:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:28.722 05:01:07 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:28.722 05:01:07 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:28.722 05:01:07 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:16:28.722 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:28.722 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:16:28.722 00:16:28.722 --- 10.0.0.2 ping statistics --- 00:16:28.722 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:28.722 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:16:28.722 05:01:07 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:28.722 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:28.722 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:16:28.722 00:16:28.722 --- 10.0.0.1 ping statistics --- 00:16:28.723 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:28.723 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:16:28.723 05:01:07 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:28.723 05:01:07 -- nvmf/common.sh@411 -- # return 0 00:16:28.723 05:01:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:28.723 05:01:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:28.723 05:01:07 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:16:28.723 05:01:07 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:16:28.723 05:01:07 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:28.723 05:01:07 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:16:28.723 05:01:07 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:16:28.723 05:01:07 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:16:28.723 05:01:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:28.723 05:01:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:28.723 05:01:07 -- common/autotest_common.sh@10 -- # set +x 00:16:28.723 ************************************ 00:16:28.723 START TEST nvmf_host_management 00:16:28.723 ************************************ 00:16:28.723 05:01:07 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:16:28.723 05:01:07 -- target/host_management.sh@69 -- # starttarget 00:16:28.723 05:01:07 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:28.723 05:01:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:28.723 05:01:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:28.723 05:01:07 -- common/autotest_common.sh@10 -- # set +x 00:16:28.723 05:01:07 -- nvmf/common.sh@470 -- # nvmfpid=2375611 00:16:28.723 05:01:07 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:28.723 05:01:07 -- nvmf/common.sh@471 -- # waitforlisten 2375611 00:16:28.723 05:01:07 -- common/autotest_common.sh@817 -- # '[' -z 2375611 ']' 00:16:28.723 05:01:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:28.723 05:01:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:28.723 05:01:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:28.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:28.723 05:01:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:28.723 05:01:07 -- common/autotest_common.sh@10 -- # set +x 00:16:28.723 [2024-04-23 05:01:07.808933] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:16:28.723 [2024-04-23 05:01:07.809016] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:28.723 EAL: No free 2048 kB hugepages reported on node 1 00:16:28.723 [2024-04-23 05:01:07.846508] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:16:28.723 [2024-04-23 05:01:07.873312] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:28.983 [2024-04-23 05:01:07.961602] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:28.983 [2024-04-23 05:01:07.961661] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:28.983 [2024-04-23 05:01:07.961674] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:28.983 [2024-04-23 05:01:07.961685] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:28.983 [2024-04-23 05:01:07.961696] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:28.983 [2024-04-23 05:01:07.961780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:28.983 [2024-04-23 05:01:07.961908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:28.983 [2024-04-23 05:01:07.961976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:28.983 [2024-04-23 05:01:07.961979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:28.983 05:01:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:28.983 05:01:08 -- common/autotest_common.sh@850 -- # return 0 00:16:28.983 05:01:08 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:28.983 05:01:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:28.983 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:28.983 05:01:08 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:28.983 05:01:08 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:28.983 05:01:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:28.983 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:28.983 [2024-04-23 05:01:08.105133] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:28.983 05:01:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:28.983 05:01:08 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:28.983 05:01:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:28.983 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:28.983 05:01:08 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:28.983 05:01:08 -- target/host_management.sh@23 -- # cat 00:16:28.983 05:01:08 -- target/host_management.sh@30 -- # rpc_cmd 00:16:28.983 05:01:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:28.983 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:28.983 Malloc0 00:16:29.240 [2024-04-23 05:01:08.166052] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:29.240 05:01:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:29.240 05:01:08 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:29.240 05:01:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:29.240 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:29.240 05:01:08 -- target/host_management.sh@73 -- # perfpid=2375772 00:16:29.240 05:01:08 -- target/host_management.sh@74 -- # waitforlisten 2375772 /var/tmp/bdevperf.sock 00:16:29.240 05:01:08 -- common/autotest_common.sh@817 -- # '[' -z 2375772 ']' 00:16:29.240 05:01:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:29.240 05:01:08 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:29.240 05:01:08 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:29.240 05:01:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:29.240 05:01:08 -- nvmf/common.sh@521 -- # config=() 00:16:29.240 05:01:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:29.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:29.240 05:01:08 -- nvmf/common.sh@521 -- # local subsystem config 00:16:29.240 05:01:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:29.240 05:01:08 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:29.240 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:29.240 05:01:08 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:29.240 { 00:16:29.240 "params": { 00:16:29.240 "name": "Nvme$subsystem", 00:16:29.240 "trtype": "$TEST_TRANSPORT", 00:16:29.240 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:29.240 "adrfam": "ipv4", 00:16:29.240 "trsvcid": "$NVMF_PORT", 00:16:29.240 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:29.240 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:29.240 "hdgst": ${hdgst:-false}, 00:16:29.240 "ddgst": ${ddgst:-false} 00:16:29.240 }, 00:16:29.240 "method": "bdev_nvme_attach_controller" 00:16:29.240 } 00:16:29.240 EOF 00:16:29.240 )") 00:16:29.240 05:01:08 -- nvmf/common.sh@543 -- # cat 00:16:29.240 05:01:08 -- nvmf/common.sh@545 -- # jq . 00:16:29.240 05:01:08 -- nvmf/common.sh@546 -- # IFS=, 00:16:29.240 05:01:08 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:29.240 "params": { 00:16:29.240 "name": "Nvme0", 00:16:29.240 "trtype": "tcp", 00:16:29.240 "traddr": "10.0.0.2", 00:16:29.240 "adrfam": "ipv4", 00:16:29.240 "trsvcid": "4420", 00:16:29.240 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:29.241 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:29.241 "hdgst": false, 00:16:29.241 "ddgst": false 00:16:29.241 }, 00:16:29.241 "method": "bdev_nvme_attach_controller" 00:16:29.241 }' 00:16:29.241 [2024-04-23 05:01:08.243378] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:16:29.241 [2024-04-23 05:01:08.243463] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2375772 ] 00:16:29.241 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.241 [2024-04-23 05:01:08.276790] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:16:29.241 [2024-04-23 05:01:08.305736] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:29.241 [2024-04-23 05:01:08.390704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:29.805 Running I/O for 10 seconds... 00:16:29.805 05:01:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:29.805 05:01:08 -- common/autotest_common.sh@850 -- # return 0 00:16:29.805 05:01:08 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:29.805 05:01:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:29.805 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:29.805 05:01:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:29.805 05:01:08 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:29.805 05:01:08 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:29.805 05:01:08 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:29.805 05:01:08 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:29.805 05:01:08 -- target/host_management.sh@52 -- # local ret=1 00:16:29.805 05:01:08 -- target/host_management.sh@53 -- # local i 00:16:29.805 05:01:08 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:29.805 05:01:08 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:29.805 05:01:08 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:29.805 05:01:08 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:29.805 05:01:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:29.805 05:01:08 -- common/autotest_common.sh@10 -- # set +x 00:16:29.805 05:01:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:29.805 05:01:08 -- target/host_management.sh@55 -- # read_io_count=67 00:16:29.805 05:01:08 -- target/host_management.sh@58 -- # '[' 67 -ge 100 ']' 00:16:29.805 05:01:08 -- target/host_management.sh@62 -- # sleep 0.25 00:16:30.064 05:01:09 -- target/host_management.sh@54 -- # (( i-- )) 00:16:30.064 05:01:09 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:30.064 05:01:09 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:30.064 05:01:09 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:30.064 05:01:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.064 05:01:09 -- common/autotest_common.sh@10 -- # set +x 00:16:30.064 05:01:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.064 05:01:09 -- target/host_management.sh@55 -- # read_io_count=515 00:16:30.064 05:01:09 -- target/host_management.sh@58 -- # '[' 515 -ge 100 ']' 00:16:30.064 05:01:09 -- target/host_management.sh@59 -- # ret=0 00:16:30.064 05:01:09 -- target/host_management.sh@60 -- # break 00:16:30.064 05:01:09 -- target/host_management.sh@64 -- # return 0 00:16:30.064 05:01:09 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:30.064 05:01:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.064 05:01:09 -- common/autotest_common.sh@10 -- # set +x 00:16:30.064 [2024-04-23 05:01:09.117332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:80512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:80640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:80768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:80896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:81024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:81152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:81280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:81408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:81536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:81664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:81792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.117984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.117999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.118016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.118032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.118049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.118066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.118086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.118102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.118120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.118135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.118153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.118169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.118186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.064 [2024-04-23 05:01:09.118201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.064 [2024-04-23 05:01:09.118218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:77952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:78208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.118968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.118985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:78336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:78464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:78592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:78720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:78848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:78976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:79104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:79232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:79360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:79488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:79616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:79744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:79872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:80000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:80128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:80256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:80384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:30.065 [2024-04-23 05:01:09.119540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1732510 is same with the state(5) to be set 00:16:30.065 [2024-04-23 05:01:09.119632] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1732510 was disconnected and freed. reset controller. 00:16:30.065 [2024-04-23 05:01:09.119698] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:16:30.065 [2024-04-23 05:01:09.119721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119739] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:30.065 [2024-04-23 05:01:09.119754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119770] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:30.065 [2024-04-23 05:01:09.119785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119801] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:30.065 [2024-04-23 05:01:09.119816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:30.065 [2024-04-23 05:01:09.119840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1321610 is same with the state(5) to be set 00:16:30.065 [2024-04-23 05:01:09.121023] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:30.065 05:01:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.065 05:01:09 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:30.065 05:01:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.065 05:01:09 -- common/autotest_common.sh@10 -- # set +x 00:16:30.065 task offset: 80512 on job bdev=Nvme0n1 fails 00:16:30.065 00:16:30.065 Latency(us) 00:16:30.065 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:30.065 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:30.065 Job: Nvme0n1 ended in about 0.39 seconds with error 00:16:30.065 Verification LBA range: start 0x0 length 0x400 00:16:30.065 Nvme0n1 : 0.39 1481.91 92.62 164.66 0.00 37742.62 3021.94 33787.45 00:16:30.065 =================================================================================================================== 00:16:30.065 Total : 1481.91 92.62 164.66 0.00 37742.62 3021.94 33787.45 00:16:30.065 [2024-04-23 05:01:09.122916] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:30.065 [2024-04-23 05:01:09.122944] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1321610 (9): Bad file descriptor 00:16:30.065 05:01:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.065 05:01:09 -- target/host_management.sh@87 -- # sleep 1 00:16:30.065 [2024-04-23 05:01:09.171980] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:30.999 05:01:10 -- target/host_management.sh@91 -- # kill -9 2375772 00:16:30.999 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2375772) - No such process 00:16:30.999 05:01:10 -- target/host_management.sh@91 -- # true 00:16:30.999 05:01:10 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:30.999 05:01:10 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:30.999 05:01:10 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:30.999 05:01:10 -- nvmf/common.sh@521 -- # config=() 00:16:30.999 05:01:10 -- nvmf/common.sh@521 -- # local subsystem config 00:16:30.999 05:01:10 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:30.999 05:01:10 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:30.999 { 00:16:30.999 "params": { 00:16:30.999 "name": "Nvme$subsystem", 00:16:30.999 "trtype": "$TEST_TRANSPORT", 00:16:30.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:30.999 "adrfam": "ipv4", 00:16:30.999 "trsvcid": "$NVMF_PORT", 00:16:30.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:30.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:30.999 "hdgst": ${hdgst:-false}, 00:16:30.999 "ddgst": ${ddgst:-false} 00:16:30.999 }, 00:16:30.999 "method": "bdev_nvme_attach_controller" 00:16:30.999 } 00:16:30.999 EOF 00:16:30.999 )") 00:16:30.999 05:01:10 -- nvmf/common.sh@543 -- # cat 00:16:30.999 05:01:10 -- nvmf/common.sh@545 -- # jq . 00:16:30.999 05:01:10 -- nvmf/common.sh@546 -- # IFS=, 00:16:30.999 05:01:10 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:30.999 "params": { 00:16:30.999 "name": "Nvme0", 00:16:30.999 "trtype": "tcp", 00:16:30.999 "traddr": "10.0.0.2", 00:16:30.999 "adrfam": "ipv4", 00:16:30.999 "trsvcid": "4420", 00:16:30.999 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:30.999 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:30.999 "hdgst": false, 00:16:30.999 "ddgst": false 00:16:30.999 }, 00:16:30.999 "method": "bdev_nvme_attach_controller" 00:16:30.999 }' 00:16:31.257 [2024-04-23 05:01:10.176671] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:16:31.257 [2024-04-23 05:01:10.176755] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2375939 ] 00:16:31.257 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.257 [2024-04-23 05:01:10.212944] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:16:31.257 [2024-04-23 05:01:10.242742] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:31.257 [2024-04-23 05:01:10.328952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:31.515 Running I/O for 1 seconds... 00:16:32.447 00:16:32.447 Latency(us) 00:16:32.447 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:32.447 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:32.447 Verification LBA range: start 0x0 length 0x400 00:16:32.447 Nvme0n1 : 1.03 1613.10 100.82 0.00 0.00 39049.39 7475.96 32622.36 00:16:32.447 =================================================================================================================== 00:16:32.447 Total : 1613.10 100.82 0.00 0.00 39049.39 7475.96 32622.36 00:16:32.705 05:01:11 -- target/host_management.sh@102 -- # stoptarget 00:16:32.705 05:01:11 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:32.705 05:01:11 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:32.705 05:01:11 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:32.705 05:01:11 -- target/host_management.sh@40 -- # nvmftestfini 00:16:32.705 05:01:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:32.705 05:01:11 -- nvmf/common.sh@117 -- # sync 00:16:32.705 05:01:11 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:16:32.705 05:01:11 -- nvmf/common.sh@120 -- # set +e 00:16:32.705 05:01:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:32.705 05:01:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:16:32.705 rmmod nvme_tcp 00:16:32.705 rmmod nvme_fabrics 00:16:32.705 rmmod nvme_keyring 00:16:32.705 05:01:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:32.705 05:01:11 -- nvmf/common.sh@124 -- # set -e 00:16:32.705 05:01:11 -- nvmf/common.sh@125 -- # return 0 00:16:32.705 05:01:11 -- nvmf/common.sh@478 -- # '[' -n 2375611 ']' 00:16:32.705 05:01:11 -- nvmf/common.sh@479 -- # killprocess 2375611 00:16:32.705 05:01:11 -- common/autotest_common.sh@936 -- # '[' -z 2375611 ']' 00:16:32.705 05:01:11 -- common/autotest_common.sh@940 -- # kill -0 2375611 00:16:32.705 05:01:11 -- common/autotest_common.sh@941 -- # uname 00:16:32.705 05:01:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:32.705 05:01:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2375611 00:16:32.705 05:01:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:32.705 05:01:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:32.705 05:01:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2375611' 00:16:32.705 killing process with pid 2375611 00:16:32.705 05:01:11 -- common/autotest_common.sh@955 -- # kill 2375611 00:16:32.705 05:01:11 -- common/autotest_common.sh@960 -- # wait 2375611 00:16:32.964 [2024-04-23 05:01:12.026121] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:32.964 05:01:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:32.964 05:01:12 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:16:32.964 05:01:12 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:16:32.964 05:01:12 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:32.964 05:01:12 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:16:32.964 05:01:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:32.964 05:01:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:32.965 05:01:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:35.497 05:01:14 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:16:35.497 00:16:35.497 real 0m6.333s 00:16:35.497 user 0m18.402s 00:16:35.497 sys 0m1.184s 00:16:35.497 05:01:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:35.497 05:01:14 -- common/autotest_common.sh@10 -- # set +x 00:16:35.497 ************************************ 00:16:35.497 END TEST nvmf_host_management 00:16:35.497 ************************************ 00:16:35.497 05:01:14 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:16:35.497 00:16:35.497 real 0m8.663s 00:16:35.497 user 0m19.225s 00:16:35.497 sys 0m2.708s 00:16:35.497 05:01:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:35.497 05:01:14 -- common/autotest_common.sh@10 -- # set +x 00:16:35.497 ************************************ 00:16:35.497 END TEST nvmf_host_management 00:16:35.497 ************************************ 00:16:35.497 05:01:14 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:35.497 05:01:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:35.497 05:01:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:35.497 05:01:14 -- common/autotest_common.sh@10 -- # set +x 00:16:35.497 ************************************ 00:16:35.497 START TEST nvmf_lvol 00:16:35.497 ************************************ 00:16:35.497 05:01:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:35.497 * Looking for test storage... 00:16:35.497 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:35.497 05:01:14 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:35.497 05:01:14 -- nvmf/common.sh@7 -- # uname -s 00:16:35.497 05:01:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:35.497 05:01:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:35.497 05:01:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:35.497 05:01:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:35.497 05:01:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:35.497 05:01:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:35.497 05:01:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:35.497 05:01:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:35.497 05:01:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:35.497 05:01:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:35.497 05:01:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:35.497 05:01:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:35.497 05:01:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:35.497 05:01:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:35.497 05:01:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:35.497 05:01:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:35.497 05:01:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:35.497 05:01:14 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:35.497 05:01:14 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:35.497 05:01:14 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:35.497 05:01:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.497 05:01:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.497 05:01:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.497 05:01:14 -- paths/export.sh@5 -- # export PATH 00:16:35.497 05:01:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.497 05:01:14 -- nvmf/common.sh@47 -- # : 0 00:16:35.497 05:01:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:35.497 05:01:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:35.497 05:01:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:35.497 05:01:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:35.498 05:01:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:35.498 05:01:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:35.498 05:01:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:35.498 05:01:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:35.498 05:01:14 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:35.498 05:01:14 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:35.498 05:01:14 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:35.498 05:01:14 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:35.498 05:01:14 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:35.498 05:01:14 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:35.498 05:01:14 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:16:35.498 05:01:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:35.498 05:01:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:35.498 05:01:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:35.498 05:01:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:35.498 05:01:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:35.498 05:01:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:35.498 05:01:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:35.498 05:01:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:35.498 05:01:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:35.498 05:01:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:35.498 05:01:14 -- common/autotest_common.sh@10 -- # set +x 00:16:37.397 05:01:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:37.397 05:01:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:37.397 05:01:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:37.397 05:01:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:37.397 05:01:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:37.397 05:01:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:37.397 05:01:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:37.397 05:01:16 -- nvmf/common.sh@295 -- # net_devs=() 00:16:37.397 05:01:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:37.397 05:01:16 -- nvmf/common.sh@296 -- # e810=() 00:16:37.397 05:01:16 -- nvmf/common.sh@296 -- # local -ga e810 00:16:37.397 05:01:16 -- nvmf/common.sh@297 -- # x722=() 00:16:37.397 05:01:16 -- nvmf/common.sh@297 -- # local -ga x722 00:16:37.397 05:01:16 -- nvmf/common.sh@298 -- # mlx=() 00:16:37.397 05:01:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:37.397 05:01:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:37.397 05:01:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:37.397 05:01:16 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:37.397 05:01:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:37.397 05:01:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:37.397 05:01:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:37.397 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:37.397 05:01:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:37.397 05:01:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:37.397 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:37.397 05:01:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:37.397 05:01:16 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:37.397 05:01:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:37.397 05:01:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:37.397 05:01:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:37.397 05:01:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:37.397 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:37.397 05:01:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:37.397 05:01:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:37.397 05:01:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:37.397 05:01:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:37.397 05:01:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:37.397 05:01:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:37.397 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:37.397 05:01:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:37.397 05:01:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:37.397 05:01:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:37.397 05:01:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:16:37.397 05:01:16 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:37.397 05:01:16 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:37.397 05:01:16 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:37.397 05:01:16 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:16:37.397 05:01:16 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:37.397 05:01:16 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:37.397 05:01:16 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:16:37.397 05:01:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:37.397 05:01:16 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:37.397 05:01:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:16:37.397 05:01:16 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:16:37.397 05:01:16 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:16:37.397 05:01:16 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:37.397 05:01:16 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:37.397 05:01:16 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:37.397 05:01:16 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:16:37.397 05:01:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:37.397 05:01:16 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:37.397 05:01:16 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:37.397 05:01:16 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:16:37.397 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:37.397 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.132 ms 00:16:37.397 00:16:37.397 --- 10.0.0.2 ping statistics --- 00:16:37.397 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:37.397 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:16:37.397 05:01:16 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:37.397 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:37.397 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.221 ms 00:16:37.397 00:16:37.397 --- 10.0.0.1 ping statistics --- 00:16:37.397 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:37.397 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:16:37.397 05:01:16 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:37.397 05:01:16 -- nvmf/common.sh@411 -- # return 0 00:16:37.397 05:01:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:37.397 05:01:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:37.397 05:01:16 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:16:37.397 05:01:16 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:37.397 05:01:16 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:16:37.397 05:01:16 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:16:37.397 05:01:16 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:37.397 05:01:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:37.397 05:01:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:37.397 05:01:16 -- common/autotest_common.sh@10 -- # set +x 00:16:37.397 05:01:16 -- nvmf/common.sh@470 -- # nvmfpid=2378148 00:16:37.397 05:01:16 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:37.397 05:01:16 -- nvmf/common.sh@471 -- # waitforlisten 2378148 00:16:37.397 05:01:16 -- common/autotest_common.sh@817 -- # '[' -z 2378148 ']' 00:16:37.397 05:01:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:37.397 05:01:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:37.397 05:01:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:37.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:37.397 05:01:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:37.397 05:01:16 -- common/autotest_common.sh@10 -- # set +x 00:16:37.397 [2024-04-23 05:01:16.329730] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:16:37.397 [2024-04-23 05:01:16.329803] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:37.397 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.397 [2024-04-23 05:01:16.366770] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:16:37.397 [2024-04-23 05:01:16.392785] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:37.397 [2024-04-23 05:01:16.474602] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:37.397 [2024-04-23 05:01:16.474657] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:37.397 [2024-04-23 05:01:16.474680] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:37.397 [2024-04-23 05:01:16.474691] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:37.397 [2024-04-23 05:01:16.474701] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:37.398 [2024-04-23 05:01:16.474760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:37.398 [2024-04-23 05:01:16.474821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:37.398 [2024-04-23 05:01:16.474824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:37.654 05:01:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:37.654 05:01:16 -- common/autotest_common.sh@850 -- # return 0 00:16:37.654 05:01:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:37.654 05:01:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:37.654 05:01:16 -- common/autotest_common.sh@10 -- # set +x 00:16:37.654 05:01:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:37.654 05:01:16 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:37.912 [2024-04-23 05:01:16.838330] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:37.912 05:01:16 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:38.170 05:01:17 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:38.170 05:01:17 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:38.428 05:01:17 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:38.428 05:01:17 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:38.686 05:01:17 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:38.943 05:01:17 -- target/nvmf_lvol.sh@29 -- # lvs=f061c098-835b-4b4b-8a6a-a96d181e40cf 00:16:38.943 05:01:17 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f061c098-835b-4b4b-8a6a-a96d181e40cf lvol 20 00:16:39.200 05:01:18 -- target/nvmf_lvol.sh@32 -- # lvol=baeb21bb-f6e7-4460-8d71-807a743b59dc 00:16:39.200 05:01:18 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:39.464 05:01:18 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 baeb21bb-f6e7-4460-8d71-807a743b59dc 00:16:39.732 05:01:18 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:39.732 [2024-04-23 05:01:18.848956] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:39.732 05:01:18 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:39.999 05:01:19 -- target/nvmf_lvol.sh@42 -- # perf_pid=2378452 00:16:39.999 05:01:19 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:16:39.999 05:01:19 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:16:39.999 EAL: No free 2048 kB hugepages reported on node 1 00:16:41.378 05:01:20 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot baeb21bb-f6e7-4460-8d71-807a743b59dc MY_SNAPSHOT 00:16:41.378 05:01:20 -- target/nvmf_lvol.sh@47 -- # snapshot=c1bffd17-3931-46a4-a25f-ce0d15063fbd 00:16:41.378 05:01:20 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize baeb21bb-f6e7-4460-8d71-807a743b59dc 30 00:16:41.634 05:01:20 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone c1bffd17-3931-46a4-a25f-ce0d15063fbd MY_CLONE 00:16:41.891 05:01:21 -- target/nvmf_lvol.sh@49 -- # clone=16046f8a-9812-466f-a724-ae07c70ba379 00:16:41.891 05:01:21 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 16046f8a-9812-466f-a724-ae07c70ba379 00:16:42.457 05:01:21 -- target/nvmf_lvol.sh@53 -- # wait 2378452 00:16:50.561 Initializing NVMe Controllers 00:16:50.561 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:16:50.561 Controller IO queue size 128, less than required. 00:16:50.561 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:50.561 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:16:50.561 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:16:50.561 Initialization complete. Launching workers. 00:16:50.561 ======================================================== 00:16:50.561 Latency(us) 00:16:50.561 Device Information : IOPS MiB/s Average min max 00:16:50.561 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10553.20 41.22 12134.45 1293.83 78177.68 00:16:50.561 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10483.50 40.95 12215.03 2395.43 72568.98 00:16:50.561 ======================================================== 00:16:50.561 Total : 21036.70 82.17 12174.61 1293.83 78177.68 00:16:50.561 00:16:50.561 05:01:29 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:16:50.819 05:01:29 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete baeb21bb-f6e7-4460-8d71-807a743b59dc 00:16:51.077 05:01:30 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u f061c098-835b-4b4b-8a6a-a96d181e40cf 00:16:51.335 05:01:30 -- target/nvmf_lvol.sh@60 -- # rm -f 00:16:51.335 05:01:30 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:16:51.335 05:01:30 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:16:51.335 05:01:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:51.335 05:01:30 -- nvmf/common.sh@117 -- # sync 00:16:51.335 05:01:30 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:16:51.335 05:01:30 -- nvmf/common.sh@120 -- # set +e 00:16:51.335 05:01:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:51.335 05:01:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:16:51.335 rmmod nvme_tcp 00:16:51.335 rmmod nvme_fabrics 00:16:51.335 rmmod nvme_keyring 00:16:51.335 05:01:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:51.335 05:01:30 -- nvmf/common.sh@124 -- # set -e 00:16:51.335 05:01:30 -- nvmf/common.sh@125 -- # return 0 00:16:51.335 05:01:30 -- nvmf/common.sh@478 -- # '[' -n 2378148 ']' 00:16:51.335 05:01:30 -- nvmf/common.sh@479 -- # killprocess 2378148 00:16:51.335 05:01:30 -- common/autotest_common.sh@936 -- # '[' -z 2378148 ']' 00:16:51.335 05:01:30 -- common/autotest_common.sh@940 -- # kill -0 2378148 00:16:51.335 05:01:30 -- common/autotest_common.sh@941 -- # uname 00:16:51.335 05:01:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:51.335 05:01:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2378148 00:16:51.335 05:01:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:51.335 05:01:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:51.335 05:01:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2378148' 00:16:51.335 killing process with pid 2378148 00:16:51.335 05:01:30 -- common/autotest_common.sh@955 -- # kill 2378148 00:16:51.335 05:01:30 -- common/autotest_common.sh@960 -- # wait 2378148 00:16:51.593 05:01:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:51.593 05:01:30 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:16:51.593 05:01:30 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:16:51.593 05:01:30 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:51.593 05:01:30 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:16:51.593 05:01:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:51.593 05:01:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:51.593 05:01:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:54.129 05:01:32 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:16:54.129 00:16:54.129 real 0m18.463s 00:16:54.129 user 1m2.766s 00:16:54.130 sys 0m5.858s 00:16:54.130 05:01:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:54.130 05:01:32 -- common/autotest_common.sh@10 -- # set +x 00:16:54.130 ************************************ 00:16:54.130 END TEST nvmf_lvol 00:16:54.130 ************************************ 00:16:54.130 05:01:32 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:16:54.130 05:01:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:54.130 05:01:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:54.130 05:01:32 -- common/autotest_common.sh@10 -- # set +x 00:16:54.130 ************************************ 00:16:54.130 START TEST nvmf_lvs_grow 00:16:54.130 ************************************ 00:16:54.130 05:01:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:16:54.130 * Looking for test storage... 00:16:54.130 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:54.130 05:01:32 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:54.130 05:01:32 -- nvmf/common.sh@7 -- # uname -s 00:16:54.130 05:01:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:54.130 05:01:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:54.130 05:01:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:54.130 05:01:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:54.130 05:01:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:54.130 05:01:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:54.130 05:01:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:54.130 05:01:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:54.130 05:01:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:54.130 05:01:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:54.130 05:01:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:54.130 05:01:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:54.130 05:01:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:54.130 05:01:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:54.130 05:01:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:54.130 05:01:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:54.130 05:01:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:54.130 05:01:32 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:54.130 05:01:32 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:54.130 05:01:32 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:54.130 05:01:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.130 05:01:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.130 05:01:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.130 05:01:32 -- paths/export.sh@5 -- # export PATH 00:16:54.130 05:01:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.130 05:01:32 -- nvmf/common.sh@47 -- # : 0 00:16:54.130 05:01:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:54.130 05:01:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:54.130 05:01:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:54.130 05:01:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:54.130 05:01:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:54.130 05:01:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:54.130 05:01:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:54.130 05:01:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:54.130 05:01:32 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:54.130 05:01:32 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:54.130 05:01:32 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:16:54.130 05:01:32 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:16:54.130 05:01:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:54.130 05:01:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:54.130 05:01:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:54.131 05:01:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:54.131 05:01:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:54.131 05:01:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:54.131 05:01:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:54.131 05:01:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:54.131 05:01:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:54.131 05:01:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:54.131 05:01:32 -- common/autotest_common.sh@10 -- # set +x 00:16:56.033 05:01:34 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:56.033 05:01:34 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:56.033 05:01:34 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:56.033 05:01:34 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:56.033 05:01:34 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:56.033 05:01:34 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:56.033 05:01:34 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:56.033 05:01:34 -- nvmf/common.sh@295 -- # net_devs=() 00:16:56.033 05:01:34 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:56.033 05:01:34 -- nvmf/common.sh@296 -- # e810=() 00:16:56.033 05:01:34 -- nvmf/common.sh@296 -- # local -ga e810 00:16:56.033 05:01:34 -- nvmf/common.sh@297 -- # x722=() 00:16:56.033 05:01:34 -- nvmf/common.sh@297 -- # local -ga x722 00:16:56.033 05:01:34 -- nvmf/common.sh@298 -- # mlx=() 00:16:56.033 05:01:34 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:56.033 05:01:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:56.033 05:01:34 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:56.033 05:01:34 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:56.033 05:01:34 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:56.033 05:01:34 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.033 05:01:34 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:56.033 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:56.033 05:01:34 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.033 05:01:34 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:56.033 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:56.033 05:01:34 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:56.033 05:01:34 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.033 05:01:34 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.033 05:01:34 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.033 05:01:34 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.033 05:01:34 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:56.033 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:56.033 05:01:34 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.033 05:01:34 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.033 05:01:34 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.033 05:01:34 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.033 05:01:34 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.033 05:01:34 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:56.033 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:56.033 05:01:34 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.033 05:01:34 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:56.033 05:01:34 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:56.033 05:01:34 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:16:56.033 05:01:34 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:56.033 05:01:34 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:56.033 05:01:34 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:56.033 05:01:34 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:16:56.033 05:01:34 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:56.033 05:01:34 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:56.033 05:01:34 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:16:56.033 05:01:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:56.033 05:01:34 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:56.033 05:01:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:16:56.033 05:01:34 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:16:56.033 05:01:34 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:16:56.033 05:01:34 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:56.033 05:01:34 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:56.033 05:01:34 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:56.033 05:01:34 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:16:56.033 05:01:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:56.033 05:01:34 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:56.033 05:01:34 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:56.033 05:01:34 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:16:56.033 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:56.033 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:16:56.033 00:16:56.033 --- 10.0.0.2 ping statistics --- 00:16:56.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:56.033 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:16:56.033 05:01:34 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:56.033 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:56.033 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:16:56.033 00:16:56.033 --- 10.0.0.1 ping statistics --- 00:16:56.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:56.033 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:16:56.033 05:01:34 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:56.033 05:01:34 -- nvmf/common.sh@411 -- # return 0 00:16:56.033 05:01:34 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:56.033 05:01:34 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:56.033 05:01:34 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:16:56.033 05:01:34 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:56.033 05:01:34 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:16:56.033 05:01:34 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:16:56.033 05:01:34 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:16:56.033 05:01:34 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:56.033 05:01:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:56.033 05:01:34 -- common/autotest_common.sh@10 -- # set +x 00:16:56.033 05:01:34 -- nvmf/common.sh@470 -- # nvmfpid=2381720 00:16:56.033 05:01:34 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:56.033 05:01:34 -- nvmf/common.sh@471 -- # waitforlisten 2381720 00:16:56.033 05:01:34 -- common/autotest_common.sh@817 -- # '[' -z 2381720 ']' 00:16:56.033 05:01:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:56.033 05:01:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:56.033 05:01:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:56.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:56.033 05:01:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:56.033 05:01:34 -- common/autotest_common.sh@10 -- # set +x 00:16:56.033 [2024-04-23 05:01:35.027248] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:16:56.033 [2024-04-23 05:01:35.027334] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:56.033 EAL: No free 2048 kB hugepages reported on node 1 00:16:56.033 [2024-04-23 05:01:35.066351] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:16:56.033 [2024-04-23 05:01:35.098035] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:56.033 [2024-04-23 05:01:35.188418] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:56.033 [2024-04-23 05:01:35.188483] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:56.033 [2024-04-23 05:01:35.188509] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:56.033 [2024-04-23 05:01:35.188531] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:56.033 [2024-04-23 05:01:35.188544] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:56.033 [2024-04-23 05:01:35.188584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:56.292 05:01:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:56.292 05:01:35 -- common/autotest_common.sh@850 -- # return 0 00:16:56.292 05:01:35 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:56.292 05:01:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:56.292 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:16:56.292 05:01:35 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:56.292 05:01:35 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:56.550 [2024-04-23 05:01:35.565299] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:16:56.550 05:01:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:56.550 05:01:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:56.550 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:16:56.550 ************************************ 00:16:56.550 START TEST lvs_grow_clean 00:16:56.550 ************************************ 00:16:56.550 05:01:35 -- common/autotest_common.sh@1111 -- # lvs_grow 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:56.550 05:01:35 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:56.810 05:01:35 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:16:56.810 05:01:35 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:16:57.069 05:01:36 -- target/nvmf_lvs_grow.sh@28 -- # lvs=8484dacd-f1e9-4f71-928b-cb043dd1acac 00:16:57.069 05:01:36 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:16:57.069 05:01:36 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:16:57.327 05:01:36 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:16:57.327 05:01:36 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:16:57.327 05:01:36 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8484dacd-f1e9-4f71-928b-cb043dd1acac lvol 150 00:16:57.587 05:01:36 -- target/nvmf_lvs_grow.sh@33 -- # lvol=9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae 00:16:57.587 05:01:36 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:57.587 05:01:36 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:16:57.848 [2024-04-23 05:01:36.916695] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:16:57.848 [2024-04-23 05:01:36.916811] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:16:57.848 true 00:16:57.848 05:01:36 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:16:57.848 05:01:36 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:16:58.106 05:01:37 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:16:58.106 05:01:37 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:58.365 05:01:37 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae 00:16:58.622 05:01:37 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:58.880 [2024-04-23 05:01:37.899761] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:58.880 05:01:37 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:59.138 05:01:38 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2382162 00:16:59.138 05:01:38 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:16:59.138 05:01:38 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:59.138 05:01:38 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2382162 /var/tmp/bdevperf.sock 00:16:59.138 05:01:38 -- common/autotest_common.sh@817 -- # '[' -z 2382162 ']' 00:16:59.138 05:01:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:59.138 05:01:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:59.138 05:01:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:59.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:59.138 05:01:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:59.138 05:01:38 -- common/autotest_common.sh@10 -- # set +x 00:16:59.138 [2024-04-23 05:01:38.249953] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:16:59.138 [2024-04-23 05:01:38.250034] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2382162 ] 00:16:59.138 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.138 [2024-04-23 05:01:38.282131] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:16:59.396 [2024-04-23 05:01:38.312967] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:59.396 [2024-04-23 05:01:38.401335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:59.396 05:01:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:59.396 05:01:38 -- common/autotest_common.sh@850 -- # return 0 00:16:59.396 05:01:38 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:16:59.963 Nvme0n1 00:16:59.963 05:01:38 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:16:59.963 [ 00:16:59.963 { 00:16:59.963 "name": "Nvme0n1", 00:16:59.963 "aliases": [ 00:16:59.963 "9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae" 00:16:59.963 ], 00:16:59.963 "product_name": "NVMe disk", 00:16:59.963 "block_size": 4096, 00:16:59.963 "num_blocks": 38912, 00:16:59.963 "uuid": "9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae", 00:16:59.963 "assigned_rate_limits": { 00:16:59.963 "rw_ios_per_sec": 0, 00:16:59.963 "rw_mbytes_per_sec": 0, 00:16:59.963 "r_mbytes_per_sec": 0, 00:16:59.963 "w_mbytes_per_sec": 0 00:16:59.963 }, 00:16:59.963 "claimed": false, 00:16:59.963 "zoned": false, 00:16:59.963 "supported_io_types": { 00:16:59.963 "read": true, 00:16:59.963 "write": true, 00:16:59.963 "unmap": true, 00:16:59.963 "write_zeroes": true, 00:16:59.963 "flush": true, 00:16:59.963 "reset": true, 00:16:59.963 "compare": true, 00:16:59.963 "compare_and_write": true, 00:16:59.963 "abort": true, 00:16:59.963 "nvme_admin": true, 00:16:59.963 "nvme_io": true 00:16:59.963 }, 00:16:59.963 "memory_domains": [ 00:16:59.963 { 00:16:59.963 "dma_device_id": "system", 00:16:59.963 "dma_device_type": 1 00:16:59.963 } 00:16:59.963 ], 00:16:59.963 "driver_specific": { 00:16:59.963 "nvme": [ 00:16:59.963 { 00:16:59.963 "trid": { 00:16:59.963 "trtype": "TCP", 00:16:59.963 "adrfam": "IPv4", 00:16:59.963 "traddr": "10.0.0.2", 00:16:59.963 "trsvcid": "4420", 00:16:59.963 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:16:59.963 }, 00:16:59.963 "ctrlr_data": { 00:16:59.963 "cntlid": 1, 00:16:59.963 "vendor_id": "0x8086", 00:16:59.963 "model_number": "SPDK bdev Controller", 00:16:59.963 "serial_number": "SPDK0", 00:16:59.963 "firmware_revision": "24.05", 00:16:59.963 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:59.964 "oacs": { 00:16:59.964 "security": 0, 00:16:59.964 "format": 0, 00:16:59.964 "firmware": 0, 00:16:59.964 "ns_manage": 0 00:16:59.964 }, 00:16:59.964 "multi_ctrlr": true, 00:16:59.964 "ana_reporting": false 00:16:59.964 }, 00:16:59.964 "vs": { 00:16:59.964 "nvme_version": "1.3" 00:16:59.964 }, 00:16:59.964 "ns_data": { 00:16:59.964 "id": 1, 00:16:59.964 "can_share": true 00:16:59.964 } 00:16:59.964 } 00:16:59.964 ], 00:16:59.964 "mp_policy": "active_passive" 00:16:59.964 } 00:16:59.964 } 00:16:59.964 ] 00:16:59.964 05:01:39 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2382295 00:16:59.964 05:01:39 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:16:59.964 05:01:39 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:00.222 Running I/O for 10 seconds... 00:17:01.210 Latency(us) 00:17:01.210 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:01.210 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:01.210 Nvme0n1 : 1.00 14038.00 54.84 0.00 0.00 0.00 0.00 0.00 00:17:01.210 =================================================================================================================== 00:17:01.210 Total : 14038.00 54.84 0.00 0.00 0.00 0.00 0.00 00:17:01.210 00:17:02.146 05:01:41 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:02.146 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:02.146 Nvme0n1 : 2.00 14258.50 55.70 0.00 0.00 0.00 0.00 0.00 00:17:02.146 =================================================================================================================== 00:17:02.146 Total : 14258.50 55.70 0.00 0.00 0.00 0.00 0.00 00:17:02.146 00:17:02.404 true 00:17:02.404 05:01:41 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:02.404 05:01:41 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:02.662 05:01:41 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:02.662 05:01:41 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:02.662 05:01:41 -- target/nvmf_lvs_grow.sh@65 -- # wait 2382295 00:17:03.231 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:03.231 Nvme0n1 : 3.00 14398.67 56.24 0.00 0.00 0.00 0.00 0.00 00:17:03.231 =================================================================================================================== 00:17:03.231 Total : 14398.67 56.24 0.00 0.00 0.00 0.00 0.00 00:17:03.231 00:17:04.167 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:04.167 Nvme0n1 : 4.00 14466.50 56.51 0.00 0.00 0.00 0.00 0.00 00:17:04.167 =================================================================================================================== 00:17:04.167 Total : 14466.50 56.51 0.00 0.00 0.00 0.00 0.00 00:17:04.167 00:17:05.106 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:05.106 Nvme0n1 : 5.00 14495.40 56.62 0.00 0.00 0.00 0.00 0.00 00:17:05.106 =================================================================================================================== 00:17:05.106 Total : 14495.40 56.62 0.00 0.00 0.00 0.00 0.00 00:17:05.106 00:17:06.485 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:06.485 Nvme0n1 : 6.00 14556.00 56.86 0.00 0.00 0.00 0.00 0.00 00:17:06.485 =================================================================================================================== 00:17:06.485 Total : 14556.00 56.86 0.00 0.00 0.00 0.00 0.00 00:17:06.485 00:17:07.425 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:07.425 Nvme0n1 : 7.00 14581.43 56.96 0.00 0.00 0.00 0.00 0.00 00:17:07.425 =================================================================================================================== 00:17:07.425 Total : 14581.43 56.96 0.00 0.00 0.00 0.00 0.00 00:17:07.425 00:17:08.378 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:08.378 Nvme0n1 : 8.00 14616.25 57.09 0.00 0.00 0.00 0.00 0.00 00:17:08.378 =================================================================================================================== 00:17:08.378 Total : 14616.25 57.09 0.00 0.00 0.00 0.00 0.00 00:17:08.378 00:17:09.319 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:09.319 Nvme0n1 : 9.00 14643.22 57.20 0.00 0.00 0.00 0.00 0.00 00:17:09.319 =================================================================================================================== 00:17:09.319 Total : 14643.22 57.20 0.00 0.00 0.00 0.00 0.00 00:17:09.319 00:17:10.255 00:17:10.255 Latency(us) 00:17:10.255 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:10.255 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:10.255 Nvme0n1 : 10.00 14664.27 57.28 0.00 0.00 8723.90 2160.26 20777.34 00:17:10.255 =================================================================================================================== 00:17:10.255 Total : 14664.27 57.28 0.00 0.00 8723.90 2160.26 20777.34 00:17:10.255 0 00:17:10.255 05:01:49 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2382162 00:17:10.255 05:01:49 -- common/autotest_common.sh@936 -- # '[' -z 2382162 ']' 00:17:10.255 05:01:49 -- common/autotest_common.sh@940 -- # kill -0 2382162 00:17:10.255 05:01:49 -- common/autotest_common.sh@941 -- # uname 00:17:10.255 05:01:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:10.255 05:01:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2382162 00:17:10.255 05:01:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:10.255 05:01:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:10.255 05:01:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2382162' 00:17:10.255 killing process with pid 2382162 00:17:10.255 05:01:49 -- common/autotest_common.sh@955 -- # kill 2382162 00:17:10.255 Received shutdown signal, test time was about 10.000000 seconds 00:17:10.255 00:17:10.255 Latency(us) 00:17:10.255 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:10.255 =================================================================================================================== 00:17:10.255 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:10.255 05:01:49 -- common/autotest_common.sh@960 -- # wait 2382162 00:17:10.514 05:01:49 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:10.772 05:01:49 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:10.772 05:01:49 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:11.039 05:01:50 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:11.040 05:01:50 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:11.040 05:01:50 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:11.304 [2024-04-23 05:01:50.349471] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:11.304 05:01:50 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:11.304 05:01:50 -- common/autotest_common.sh@638 -- # local es=0 00:17:11.304 05:01:50 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:11.304 05:01:50 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.304 05:01:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:11.304 05:01:50 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.304 05:01:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:11.304 05:01:50 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.304 05:01:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:11.304 05:01:50 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.304 05:01:50 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:11.304 05:01:50 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:11.566 request: 00:17:11.566 { 00:17:11.566 "uuid": "8484dacd-f1e9-4f71-928b-cb043dd1acac", 00:17:11.566 "method": "bdev_lvol_get_lvstores", 00:17:11.566 "req_id": 1 00:17:11.566 } 00:17:11.566 Got JSON-RPC error response 00:17:11.566 response: 00:17:11.566 { 00:17:11.566 "code": -19, 00:17:11.566 "message": "No such device" 00:17:11.566 } 00:17:11.566 05:01:50 -- common/autotest_common.sh@641 -- # es=1 00:17:11.566 05:01:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:11.566 05:01:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:11.566 05:01:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:11.566 05:01:50 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:11.826 aio_bdev 00:17:11.826 05:01:50 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae 00:17:11.826 05:01:50 -- common/autotest_common.sh@885 -- # local bdev_name=9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae 00:17:11.826 05:01:50 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:17:11.826 05:01:50 -- common/autotest_common.sh@887 -- # local i 00:17:11.826 05:01:50 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:17:11.826 05:01:50 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:17:11.826 05:01:50 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:12.084 05:01:51 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae -t 2000 00:17:12.341 [ 00:17:12.341 { 00:17:12.341 "name": "9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae", 00:17:12.341 "aliases": [ 00:17:12.341 "lvs/lvol" 00:17:12.341 ], 00:17:12.341 "product_name": "Logical Volume", 00:17:12.341 "block_size": 4096, 00:17:12.341 "num_blocks": 38912, 00:17:12.341 "uuid": "9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae", 00:17:12.341 "assigned_rate_limits": { 00:17:12.341 "rw_ios_per_sec": 0, 00:17:12.341 "rw_mbytes_per_sec": 0, 00:17:12.341 "r_mbytes_per_sec": 0, 00:17:12.341 "w_mbytes_per_sec": 0 00:17:12.341 }, 00:17:12.341 "claimed": false, 00:17:12.341 "zoned": false, 00:17:12.341 "supported_io_types": { 00:17:12.341 "read": true, 00:17:12.341 "write": true, 00:17:12.341 "unmap": true, 00:17:12.341 "write_zeroes": true, 00:17:12.341 "flush": false, 00:17:12.341 "reset": true, 00:17:12.341 "compare": false, 00:17:12.341 "compare_and_write": false, 00:17:12.341 "abort": false, 00:17:12.341 "nvme_admin": false, 00:17:12.341 "nvme_io": false 00:17:12.341 }, 00:17:12.341 "driver_specific": { 00:17:12.341 "lvol": { 00:17:12.341 "lvol_store_uuid": "8484dacd-f1e9-4f71-928b-cb043dd1acac", 00:17:12.341 "base_bdev": "aio_bdev", 00:17:12.341 "thin_provision": false, 00:17:12.341 "snapshot": false, 00:17:12.341 "clone": false, 00:17:12.341 "esnap_clone": false 00:17:12.341 } 00:17:12.341 } 00:17:12.341 } 00:17:12.341 ] 00:17:12.599 05:01:51 -- common/autotest_common.sh@893 -- # return 0 00:17:12.599 05:01:51 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:12.599 05:01:51 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:12.599 05:01:51 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:12.859 05:01:51 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:12.859 05:01:51 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:12.859 05:01:52 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:12.859 05:01:52 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 9e82e4a1-ed46-4ec4-b0ba-39ce6a94b9ae 00:17:13.116 05:01:52 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 8484dacd-f1e9-4f71-928b-cb043dd1acac 00:17:13.375 05:01:52 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:13.634 05:01:52 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:13.634 00:17:13.634 real 0m17.071s 00:17:13.634 user 0m16.443s 00:17:13.634 sys 0m1.953s 00:17:13.634 05:01:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:13.634 05:01:52 -- common/autotest_common.sh@10 -- # set +x 00:17:13.634 ************************************ 00:17:13.634 END TEST lvs_grow_clean 00:17:13.634 ************************************ 00:17:13.634 05:01:52 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:13.634 05:01:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:13.634 05:01:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:13.634 05:01:52 -- common/autotest_common.sh@10 -- # set +x 00:17:13.892 ************************************ 00:17:13.892 START TEST lvs_grow_dirty 00:17:13.892 ************************************ 00:17:13.893 05:01:52 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:13.893 05:01:52 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:14.151 05:01:53 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:14.151 05:01:53 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:14.409 05:01:53 -- target/nvmf_lvs_grow.sh@28 -- # lvs=a2846b28-0a04-4530-9df1-998d793a602b 00:17:14.409 05:01:53 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:14.409 05:01:53 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:14.667 05:01:53 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:14.667 05:01:53 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:14.667 05:01:53 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u a2846b28-0a04-4530-9df1-998d793a602b lvol 150 00:17:14.926 05:01:53 -- target/nvmf_lvs_grow.sh@33 -- # lvol=1262a992-69ec-4812-b546-949a1893a334 00:17:14.926 05:01:53 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:14.926 05:01:53 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:15.185 [2024-04-23 05:01:54.197839] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:15.185 [2024-04-23 05:01:54.197948] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:15.185 true 00:17:15.185 05:01:54 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:15.185 05:01:54 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:15.445 05:01:54 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:15.445 05:01:54 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:15.704 05:01:54 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 1262a992-69ec-4812-b546-949a1893a334 00:17:15.962 05:01:54 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:16.242 05:01:55 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:16.500 05:01:55 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2384218 00:17:16.500 05:01:55 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:16.500 05:01:55 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:16.500 05:01:55 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2384218 /var/tmp/bdevperf.sock 00:17:16.500 05:01:55 -- common/autotest_common.sh@817 -- # '[' -z 2384218 ']' 00:17:16.500 05:01:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.500 05:01:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:16.500 05:01:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.500 05:01:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:16.500 05:01:55 -- common/autotest_common.sh@10 -- # set +x 00:17:16.500 [2024-04-23 05:01:55.471257] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:16.500 [2024-04-23 05:01:55.471337] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2384218 ] 00:17:16.500 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.501 [2024-04-23 05:01:55.504366] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:16.501 [2024-04-23 05:01:55.534850] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.501 [2024-04-23 05:01:55.623852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:16.759 05:01:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:16.759 05:01:55 -- common/autotest_common.sh@850 -- # return 0 00:17:16.759 05:01:55 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:17.016 Nvme0n1 00:17:17.016 05:01:56 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:17.278 [ 00:17:17.278 { 00:17:17.278 "name": "Nvme0n1", 00:17:17.278 "aliases": [ 00:17:17.278 "1262a992-69ec-4812-b546-949a1893a334" 00:17:17.278 ], 00:17:17.278 "product_name": "NVMe disk", 00:17:17.278 "block_size": 4096, 00:17:17.278 "num_blocks": 38912, 00:17:17.278 "uuid": "1262a992-69ec-4812-b546-949a1893a334", 00:17:17.278 "assigned_rate_limits": { 00:17:17.278 "rw_ios_per_sec": 0, 00:17:17.278 "rw_mbytes_per_sec": 0, 00:17:17.278 "r_mbytes_per_sec": 0, 00:17:17.278 "w_mbytes_per_sec": 0 00:17:17.278 }, 00:17:17.278 "claimed": false, 00:17:17.278 "zoned": false, 00:17:17.278 "supported_io_types": { 00:17:17.278 "read": true, 00:17:17.278 "write": true, 00:17:17.278 "unmap": true, 00:17:17.278 "write_zeroes": true, 00:17:17.278 "flush": true, 00:17:17.278 "reset": true, 00:17:17.278 "compare": true, 00:17:17.278 "compare_and_write": true, 00:17:17.278 "abort": true, 00:17:17.278 "nvme_admin": true, 00:17:17.278 "nvme_io": true 00:17:17.278 }, 00:17:17.278 "memory_domains": [ 00:17:17.278 { 00:17:17.278 "dma_device_id": "system", 00:17:17.278 "dma_device_type": 1 00:17:17.278 } 00:17:17.278 ], 00:17:17.278 "driver_specific": { 00:17:17.278 "nvme": [ 00:17:17.278 { 00:17:17.278 "trid": { 00:17:17.278 "trtype": "TCP", 00:17:17.278 "adrfam": "IPv4", 00:17:17.278 "traddr": "10.0.0.2", 00:17:17.278 "trsvcid": "4420", 00:17:17.278 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:17.278 }, 00:17:17.278 "ctrlr_data": { 00:17:17.278 "cntlid": 1, 00:17:17.278 "vendor_id": "0x8086", 00:17:17.278 "model_number": "SPDK bdev Controller", 00:17:17.278 "serial_number": "SPDK0", 00:17:17.278 "firmware_revision": "24.05", 00:17:17.278 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:17.278 "oacs": { 00:17:17.278 "security": 0, 00:17:17.278 "format": 0, 00:17:17.278 "firmware": 0, 00:17:17.278 "ns_manage": 0 00:17:17.278 }, 00:17:17.279 "multi_ctrlr": true, 00:17:17.279 "ana_reporting": false 00:17:17.279 }, 00:17:17.279 "vs": { 00:17:17.279 "nvme_version": "1.3" 00:17:17.279 }, 00:17:17.279 "ns_data": { 00:17:17.279 "id": 1, 00:17:17.279 "can_share": true 00:17:17.279 } 00:17:17.279 } 00:17:17.279 ], 00:17:17.279 "mp_policy": "active_passive" 00:17:17.279 } 00:17:17.279 } 00:17:17.279 ] 00:17:17.279 05:01:56 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2384349 00:17:17.279 05:01:56 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:17.279 05:01:56 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:17.541 Running I/O for 10 seconds... 00:17:18.478 Latency(us) 00:17:18.478 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:18.478 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:18.478 Nvme0n1 : 1.00 14544.00 56.81 0.00 0.00 0.00 0.00 0.00 00:17:18.478 =================================================================================================================== 00:17:18.478 Total : 14544.00 56.81 0.00 0.00 0.00 0.00 0.00 00:17:18.478 00:17:19.536 05:01:58 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:19.536 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:19.536 Nvme0n1 : 2.00 14449.00 56.44 0.00 0.00 0.00 0.00 0.00 00:17:19.536 =================================================================================================================== 00:17:19.536 Total : 14449.00 56.44 0.00 0.00 0.00 0.00 0.00 00:17:19.536 00:17:19.536 true 00:17:19.536 05:01:58 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:19.536 05:01:58 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:19.793 05:01:58 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:19.793 05:01:58 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:19.793 05:01:58 -- target/nvmf_lvs_grow.sh@65 -- # wait 2384349 00:17:20.377 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:20.377 Nvme0n1 : 3.00 14501.67 56.65 0.00 0.00 0.00 0.00 0.00 00:17:20.377 =================================================================================================================== 00:17:20.377 Total : 14501.67 56.65 0.00 0.00 0.00 0.00 0.00 00:17:20.377 00:17:21.757 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:21.757 Nvme0n1 : 4.00 14628.50 57.14 0.00 0.00 0.00 0.00 0.00 00:17:21.757 =================================================================================================================== 00:17:21.757 Total : 14628.50 57.14 0.00 0.00 0.00 0.00 0.00 00:17:21.757 00:17:22.694 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:22.695 Nvme0n1 : 5.00 14662.40 57.27 0.00 0.00 0.00 0.00 0.00 00:17:22.695 =================================================================================================================== 00:17:22.695 Total : 14662.40 57.27 0.00 0.00 0.00 0.00 0.00 00:17:22.695 00:17:23.633 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:23.633 Nvme0n1 : 6.00 14748.50 57.61 0.00 0.00 0.00 0.00 0.00 00:17:23.633 =================================================================================================================== 00:17:23.633 Total : 14748.50 57.61 0.00 0.00 0.00 0.00 0.00 00:17:23.633 00:17:24.568 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:24.568 Nvme0n1 : 7.00 14803.00 57.82 0.00 0.00 0.00 0.00 0.00 00:17:24.568 =================================================================================================================== 00:17:24.568 Total : 14803.00 57.82 0.00 0.00 0.00 0.00 0.00 00:17:24.568 00:17:25.529 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:25.529 Nvme0n1 : 8.00 14834.00 57.95 0.00 0.00 0.00 0.00 0.00 00:17:25.529 =================================================================================================================== 00:17:25.529 Total : 14834.00 57.95 0.00 0.00 0.00 0.00 0.00 00:17:25.529 00:17:26.468 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:26.468 Nvme0n1 : 9.00 14829.89 57.93 0.00 0.00 0.00 0.00 0.00 00:17:26.468 =================================================================================================================== 00:17:26.468 Total : 14829.89 57.93 0.00 0.00 0.00 0.00 0.00 00:17:26.468 00:17:27.406 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.406 Nvme0n1 : 10.00 14839.30 57.97 0.00 0.00 0.00 0.00 0.00 00:17:27.406 =================================================================================================================== 00:17:27.406 Total : 14839.30 57.97 0.00 0.00 0.00 0.00 0.00 00:17:27.406 00:17:27.406 00:17:27.406 Latency(us) 00:17:27.406 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.406 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.406 Nvme0n1 : 10.00 14845.89 57.99 0.00 0.00 8617.45 5097.24 16699.54 00:17:27.406 =================================================================================================================== 00:17:27.406 Total : 14845.89 57.99 0.00 0.00 8617.45 5097.24 16699.54 00:17:27.406 0 00:17:27.406 05:02:06 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2384218 00:17:27.406 05:02:06 -- common/autotest_common.sh@936 -- # '[' -z 2384218 ']' 00:17:27.406 05:02:06 -- common/autotest_common.sh@940 -- # kill -0 2384218 00:17:27.406 05:02:06 -- common/autotest_common.sh@941 -- # uname 00:17:27.406 05:02:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:27.406 05:02:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2384218 00:17:27.406 05:02:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:27.406 05:02:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:27.406 05:02:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2384218' 00:17:27.406 killing process with pid 2384218 00:17:27.406 05:02:06 -- common/autotest_common.sh@955 -- # kill 2384218 00:17:27.406 Received shutdown signal, test time was about 10.000000 seconds 00:17:27.406 00:17:27.406 Latency(us) 00:17:27.406 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.406 =================================================================================================================== 00:17:27.406 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:27.406 05:02:06 -- common/autotest_common.sh@960 -- # wait 2384218 00:17:27.663 05:02:06 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:27.922 05:02:07 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:27.922 05:02:07 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:28.181 05:02:07 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:28.181 05:02:07 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:28.181 05:02:07 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2381720 00:17:28.181 05:02:07 -- target/nvmf_lvs_grow.sh@74 -- # wait 2381720 00:17:28.181 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2381720 Killed "${NVMF_APP[@]}" "$@" 00:17:28.181 05:02:07 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:28.181 05:02:07 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:28.181 05:02:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:28.181 05:02:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:28.181 05:02:07 -- common/autotest_common.sh@10 -- # set +x 00:17:28.181 05:02:07 -- nvmf/common.sh@470 -- # nvmfpid=2385669 00:17:28.181 05:02:07 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:28.181 05:02:07 -- nvmf/common.sh@471 -- # waitforlisten 2385669 00:17:28.181 05:02:07 -- common/autotest_common.sh@817 -- # '[' -z 2385669 ']' 00:17:28.181 05:02:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:28.181 05:02:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:28.181 05:02:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:28.181 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:28.181 05:02:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:28.181 05:02:07 -- common/autotest_common.sh@10 -- # set +x 00:17:28.441 [2024-04-23 05:02:07.388002] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:28.441 [2024-04-23 05:02:07.388090] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:28.441 EAL: No free 2048 kB hugepages reported on node 1 00:17:28.441 [2024-04-23 05:02:07.426993] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:28.441 [2024-04-23 05:02:07.452878] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:28.441 [2024-04-23 05:02:07.537787] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:28.441 [2024-04-23 05:02:07.537864] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:28.441 [2024-04-23 05:02:07.537877] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:28.441 [2024-04-23 05:02:07.537889] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:28.441 [2024-04-23 05:02:07.537898] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:28.441 [2024-04-23 05:02:07.537925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:28.698 05:02:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:28.698 05:02:07 -- common/autotest_common.sh@850 -- # return 0 00:17:28.698 05:02:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:28.698 05:02:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:28.698 05:02:07 -- common/autotest_common.sh@10 -- # set +x 00:17:28.698 05:02:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:28.698 05:02:07 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:28.956 [2024-04-23 05:02:07.897479] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:28.956 [2024-04-23 05:02:07.897659] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:28.956 [2024-04-23 05:02:07.897716] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:28.956 05:02:07 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:28.956 05:02:07 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 1262a992-69ec-4812-b546-949a1893a334 00:17:28.956 05:02:07 -- common/autotest_common.sh@885 -- # local bdev_name=1262a992-69ec-4812-b546-949a1893a334 00:17:28.956 05:02:07 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:17:28.956 05:02:07 -- common/autotest_common.sh@887 -- # local i 00:17:28.956 05:02:07 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:17:28.956 05:02:07 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:17:28.956 05:02:07 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:29.224 05:02:08 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 1262a992-69ec-4812-b546-949a1893a334 -t 2000 00:17:29.485 [ 00:17:29.485 { 00:17:29.485 "name": "1262a992-69ec-4812-b546-949a1893a334", 00:17:29.485 "aliases": [ 00:17:29.485 "lvs/lvol" 00:17:29.485 ], 00:17:29.485 "product_name": "Logical Volume", 00:17:29.485 "block_size": 4096, 00:17:29.485 "num_blocks": 38912, 00:17:29.485 "uuid": "1262a992-69ec-4812-b546-949a1893a334", 00:17:29.485 "assigned_rate_limits": { 00:17:29.485 "rw_ios_per_sec": 0, 00:17:29.485 "rw_mbytes_per_sec": 0, 00:17:29.485 "r_mbytes_per_sec": 0, 00:17:29.485 "w_mbytes_per_sec": 0 00:17:29.485 }, 00:17:29.485 "claimed": false, 00:17:29.485 "zoned": false, 00:17:29.485 "supported_io_types": { 00:17:29.485 "read": true, 00:17:29.485 "write": true, 00:17:29.485 "unmap": true, 00:17:29.485 "write_zeroes": true, 00:17:29.485 "flush": false, 00:17:29.485 "reset": true, 00:17:29.485 "compare": false, 00:17:29.485 "compare_and_write": false, 00:17:29.485 "abort": false, 00:17:29.485 "nvme_admin": false, 00:17:29.485 "nvme_io": false 00:17:29.485 }, 00:17:29.485 "driver_specific": { 00:17:29.485 "lvol": { 00:17:29.485 "lvol_store_uuid": "a2846b28-0a04-4530-9df1-998d793a602b", 00:17:29.485 "base_bdev": "aio_bdev", 00:17:29.485 "thin_provision": false, 00:17:29.485 "snapshot": false, 00:17:29.485 "clone": false, 00:17:29.485 "esnap_clone": false 00:17:29.485 } 00:17:29.485 } 00:17:29.485 } 00:17:29.485 ] 00:17:29.485 05:02:08 -- common/autotest_common.sh@893 -- # return 0 00:17:29.485 05:02:08 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:29.485 05:02:08 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:29.744 05:02:08 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:29.744 05:02:08 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:29.744 05:02:08 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:30.003 05:02:08 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:30.003 05:02:08 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:30.263 [2024-04-23 05:02:09.178587] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:30.263 05:02:09 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:30.263 05:02:09 -- common/autotest_common.sh@638 -- # local es=0 00:17:30.263 05:02:09 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:30.263 05:02:09 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:30.263 05:02:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:30.263 05:02:09 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:30.263 05:02:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:30.263 05:02:09 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:30.263 05:02:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:30.263 05:02:09 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:30.263 05:02:09 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:30.263 05:02:09 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:30.534 request: 00:17:30.534 { 00:17:30.534 "uuid": "a2846b28-0a04-4530-9df1-998d793a602b", 00:17:30.534 "method": "bdev_lvol_get_lvstores", 00:17:30.534 "req_id": 1 00:17:30.534 } 00:17:30.534 Got JSON-RPC error response 00:17:30.534 response: 00:17:30.534 { 00:17:30.534 "code": -19, 00:17:30.534 "message": "No such device" 00:17:30.534 } 00:17:30.534 05:02:09 -- common/autotest_common.sh@641 -- # es=1 00:17:30.534 05:02:09 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:30.534 05:02:09 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:30.534 05:02:09 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:30.534 05:02:09 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:30.534 aio_bdev 00:17:30.794 05:02:09 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 1262a992-69ec-4812-b546-949a1893a334 00:17:30.794 05:02:09 -- common/autotest_common.sh@885 -- # local bdev_name=1262a992-69ec-4812-b546-949a1893a334 00:17:30.794 05:02:09 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:17:30.794 05:02:09 -- common/autotest_common.sh@887 -- # local i 00:17:30.794 05:02:09 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:17:30.794 05:02:09 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:17:30.794 05:02:09 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:31.052 05:02:09 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 1262a992-69ec-4812-b546-949a1893a334 -t 2000 00:17:31.312 [ 00:17:31.312 { 00:17:31.312 "name": "1262a992-69ec-4812-b546-949a1893a334", 00:17:31.312 "aliases": [ 00:17:31.312 "lvs/lvol" 00:17:31.312 ], 00:17:31.312 "product_name": "Logical Volume", 00:17:31.312 "block_size": 4096, 00:17:31.312 "num_blocks": 38912, 00:17:31.312 "uuid": "1262a992-69ec-4812-b546-949a1893a334", 00:17:31.312 "assigned_rate_limits": { 00:17:31.312 "rw_ios_per_sec": 0, 00:17:31.312 "rw_mbytes_per_sec": 0, 00:17:31.312 "r_mbytes_per_sec": 0, 00:17:31.312 "w_mbytes_per_sec": 0 00:17:31.312 }, 00:17:31.312 "claimed": false, 00:17:31.312 "zoned": false, 00:17:31.312 "supported_io_types": { 00:17:31.312 "read": true, 00:17:31.312 "write": true, 00:17:31.312 "unmap": true, 00:17:31.312 "write_zeroes": true, 00:17:31.312 "flush": false, 00:17:31.312 "reset": true, 00:17:31.312 "compare": false, 00:17:31.312 "compare_and_write": false, 00:17:31.312 "abort": false, 00:17:31.312 "nvme_admin": false, 00:17:31.312 "nvme_io": false 00:17:31.312 }, 00:17:31.312 "driver_specific": { 00:17:31.312 "lvol": { 00:17:31.312 "lvol_store_uuid": "a2846b28-0a04-4530-9df1-998d793a602b", 00:17:31.312 "base_bdev": "aio_bdev", 00:17:31.312 "thin_provision": false, 00:17:31.312 "snapshot": false, 00:17:31.312 "clone": false, 00:17:31.312 "esnap_clone": false 00:17:31.312 } 00:17:31.312 } 00:17:31.312 } 00:17:31.312 ] 00:17:31.312 05:02:10 -- common/autotest_common.sh@893 -- # return 0 00:17:31.312 05:02:10 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:31.312 05:02:10 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:31.572 05:02:10 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:31.572 05:02:10 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:31.572 05:02:10 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:31.830 05:02:10 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:31.830 05:02:10 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1262a992-69ec-4812-b546-949a1893a334 00:17:32.087 05:02:11 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u a2846b28-0a04-4530-9df1-998d793a602b 00:17:32.345 05:02:11 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:32.612 05:02:11 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:32.612 00:17:32.612 real 0m18.685s 00:17:32.612 user 0m47.359s 00:17:32.612 sys 0m4.613s 00:17:32.612 05:02:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:32.612 05:02:11 -- common/autotest_common.sh@10 -- # set +x 00:17:32.612 ************************************ 00:17:32.612 END TEST lvs_grow_dirty 00:17:32.612 ************************************ 00:17:32.612 05:02:11 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:32.612 05:02:11 -- common/autotest_common.sh@794 -- # type=--id 00:17:32.612 05:02:11 -- common/autotest_common.sh@795 -- # id=0 00:17:32.612 05:02:11 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:17:32.612 05:02:11 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:32.612 05:02:11 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:17:32.612 05:02:11 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:17:32.612 05:02:11 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:17:32.612 05:02:11 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:32.612 nvmf_trace.0 00:17:32.612 05:02:11 -- common/autotest_common.sh@809 -- # return 0 00:17:32.612 05:02:11 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:32.612 05:02:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:32.612 05:02:11 -- nvmf/common.sh@117 -- # sync 00:17:32.613 05:02:11 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:32.613 05:02:11 -- nvmf/common.sh@120 -- # set +e 00:17:32.613 05:02:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:32.613 05:02:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:32.613 rmmod nvme_tcp 00:17:32.613 rmmod nvme_fabrics 00:17:32.613 rmmod nvme_keyring 00:17:32.613 05:02:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:32.613 05:02:11 -- nvmf/common.sh@124 -- # set -e 00:17:32.613 05:02:11 -- nvmf/common.sh@125 -- # return 0 00:17:32.613 05:02:11 -- nvmf/common.sh@478 -- # '[' -n 2385669 ']' 00:17:32.613 05:02:11 -- nvmf/common.sh@479 -- # killprocess 2385669 00:17:32.613 05:02:11 -- common/autotest_common.sh@936 -- # '[' -z 2385669 ']' 00:17:32.613 05:02:11 -- common/autotest_common.sh@940 -- # kill -0 2385669 00:17:32.613 05:02:11 -- common/autotest_common.sh@941 -- # uname 00:17:32.613 05:02:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:32.613 05:02:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2385669 00:17:32.613 05:02:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:32.613 05:02:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:32.613 05:02:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2385669' 00:17:32.613 killing process with pid 2385669 00:17:32.613 05:02:11 -- common/autotest_common.sh@955 -- # kill 2385669 00:17:32.614 05:02:11 -- common/autotest_common.sh@960 -- # wait 2385669 00:17:32.876 05:02:11 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:32.876 05:02:11 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:32.876 05:02:11 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:32.876 05:02:11 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:32.876 05:02:11 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:32.876 05:02:11 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:32.876 05:02:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:32.876 05:02:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:35.421 05:02:13 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:35.421 00:17:35.421 real 0m41.154s 00:17:35.421 user 1m9.535s 00:17:35.421 sys 0m8.413s 00:17:35.421 05:02:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:35.421 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:17:35.421 ************************************ 00:17:35.421 END TEST nvmf_lvs_grow 00:17:35.421 ************************************ 00:17:35.421 05:02:14 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:35.421 05:02:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:35.421 05:02:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:35.421 05:02:14 -- common/autotest_common.sh@10 -- # set +x 00:17:35.421 ************************************ 00:17:35.421 START TEST nvmf_bdev_io_wait 00:17:35.421 ************************************ 00:17:35.421 05:02:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:35.421 * Looking for test storage... 00:17:35.421 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:35.421 05:02:14 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:35.421 05:02:14 -- nvmf/common.sh@7 -- # uname -s 00:17:35.421 05:02:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:35.421 05:02:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:35.421 05:02:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:35.421 05:02:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:35.421 05:02:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:35.421 05:02:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:35.421 05:02:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:35.421 05:02:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:35.421 05:02:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:35.421 05:02:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:35.421 05:02:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:35.421 05:02:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:35.421 05:02:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:35.421 05:02:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:35.421 05:02:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:35.421 05:02:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:35.421 05:02:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:35.421 05:02:14 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:35.421 05:02:14 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:35.421 05:02:14 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:35.421 05:02:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:35.421 05:02:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:35.421 05:02:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:35.421 05:02:14 -- paths/export.sh@5 -- # export PATH 00:17:35.421 05:02:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:35.421 05:02:14 -- nvmf/common.sh@47 -- # : 0 00:17:35.421 05:02:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:35.421 05:02:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:35.421 05:02:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:35.421 05:02:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:35.421 05:02:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:35.421 05:02:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:35.421 05:02:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:35.421 05:02:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:35.421 05:02:14 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:35.421 05:02:14 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:35.421 05:02:14 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:35.421 05:02:14 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:35.421 05:02:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:35.421 05:02:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:35.421 05:02:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:35.421 05:02:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:35.421 05:02:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:35.421 05:02:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:35.421 05:02:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:35.421 05:02:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:35.421 05:02:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:35.421 05:02:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:35.421 05:02:14 -- common/autotest_common.sh@10 -- # set +x 00:17:37.334 05:02:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:37.334 05:02:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:37.334 05:02:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:37.334 05:02:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:37.334 05:02:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:37.334 05:02:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:37.334 05:02:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:37.334 05:02:16 -- nvmf/common.sh@295 -- # net_devs=() 00:17:37.334 05:02:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:37.334 05:02:16 -- nvmf/common.sh@296 -- # e810=() 00:17:37.334 05:02:16 -- nvmf/common.sh@296 -- # local -ga e810 00:17:37.334 05:02:16 -- nvmf/common.sh@297 -- # x722=() 00:17:37.334 05:02:16 -- nvmf/common.sh@297 -- # local -ga x722 00:17:37.334 05:02:16 -- nvmf/common.sh@298 -- # mlx=() 00:17:37.334 05:02:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:37.334 05:02:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:37.334 05:02:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:37.334 05:02:16 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:37.334 05:02:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:37.334 05:02:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:37.334 05:02:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:37.334 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:37.334 05:02:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:37.334 05:02:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:37.334 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:37.334 05:02:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:37.334 05:02:16 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:37.334 05:02:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:37.334 05:02:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:37.334 05:02:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:37.334 05:02:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:37.334 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:37.334 05:02:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:37.334 05:02:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:37.334 05:02:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:37.334 05:02:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:37.334 05:02:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:37.334 05:02:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:37.334 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:37.334 05:02:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:37.334 05:02:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:37.334 05:02:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:37.334 05:02:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:37.334 05:02:16 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:37.334 05:02:16 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:37.334 05:02:16 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:37.334 05:02:16 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:37.334 05:02:16 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:37.334 05:02:16 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:37.334 05:02:16 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:37.334 05:02:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:37.334 05:02:16 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:37.334 05:02:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:37.334 05:02:16 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:37.334 05:02:16 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:37.334 05:02:16 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:37.334 05:02:16 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:37.334 05:02:16 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:37.334 05:02:16 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:37.334 05:02:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:37.334 05:02:16 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:37.334 05:02:16 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:37.334 05:02:16 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:37.334 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:37.334 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:17:37.334 00:17:37.334 --- 10.0.0.2 ping statistics --- 00:17:37.334 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:37.334 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:17:37.334 05:02:16 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:37.334 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:37.334 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:17:37.334 00:17:37.334 --- 10.0.0.1 ping statistics --- 00:17:37.334 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:37.334 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:17:37.334 05:02:16 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:37.334 05:02:16 -- nvmf/common.sh@411 -- # return 0 00:17:37.334 05:02:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:37.334 05:02:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:37.334 05:02:16 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:37.334 05:02:16 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:37.334 05:02:16 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:37.334 05:02:16 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:37.334 05:02:16 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:17:37.334 05:02:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:37.334 05:02:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:37.334 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.334 05:02:16 -- nvmf/common.sh@470 -- # nvmfpid=2388199 00:17:37.334 05:02:16 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:17:37.334 05:02:16 -- nvmf/common.sh@471 -- # waitforlisten 2388199 00:17:37.334 05:02:16 -- common/autotest_common.sh@817 -- # '[' -z 2388199 ']' 00:17:37.334 05:02:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:37.334 05:02:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:37.334 05:02:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:37.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:37.334 05:02:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:37.334 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.334 [2024-04-23 05:02:16.346707] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:37.335 [2024-04-23 05:02:16.346792] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:37.335 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.335 [2024-04-23 05:02:16.392364] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:37.335 [2024-04-23 05:02:16.423408] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:37.595 [2024-04-23 05:02:16.519138] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:37.595 [2024-04-23 05:02:16.519203] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:37.595 [2024-04-23 05:02:16.519217] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:37.595 [2024-04-23 05:02:16.519228] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:37.595 [2024-04-23 05:02:16.519238] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:37.595 [2024-04-23 05:02:16.519294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:37.595 [2024-04-23 05:02:16.519363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:37.595 [2024-04-23 05:02:16.519477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:37.595 [2024-04-23 05:02:16.519480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:37.595 05:02:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:37.595 05:02:16 -- common/autotest_common.sh@850 -- # return 0 00:17:37.595 05:02:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:37.595 05:02:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:37.595 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.595 05:02:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:37.595 05:02:16 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:17:37.595 05:02:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.595 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.595 05:02:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.595 05:02:16 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:17:37.595 05:02:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.595 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.595 05:02:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.595 05:02:16 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:37.595 05:02:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.595 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.595 [2024-04-23 05:02:16.704462] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:37.595 05:02:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.595 05:02:16 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:37.595 05:02:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.595 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.595 Malloc0 00:17:37.595 05:02:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.595 05:02:16 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:37.595 05:02:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.595 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.865 05:02:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:37.865 05:02:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.865 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.865 05:02:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:37.865 05:02:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.865 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.865 [2024-04-23 05:02:16.775212] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:37.865 05:02:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2388222 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@30 -- # READ_PID=2388223 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:17:37.865 05:02:16 -- nvmf/common.sh@521 -- # config=() 00:17:37.865 05:02:16 -- nvmf/common.sh@521 -- # local subsystem config 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2388226 00:17:37.865 05:02:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:17:37.865 05:02:16 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:17:37.865 05:02:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:37.865 { 00:17:37.865 "params": { 00:17:37.865 "name": "Nvme$subsystem", 00:17:37.865 "trtype": "$TEST_TRANSPORT", 00:17:37.865 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:37.865 "adrfam": "ipv4", 00:17:37.865 "trsvcid": "$NVMF_PORT", 00:17:37.865 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:37.865 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:37.865 "hdgst": ${hdgst:-false}, 00:17:37.865 "ddgst": ${ddgst:-false} 00:17:37.865 }, 00:17:37.865 "method": "bdev_nvme_attach_controller" 00:17:37.865 } 00:17:37.865 EOF 00:17:37.865 )") 00:17:37.865 05:02:16 -- nvmf/common.sh@521 -- # config=() 00:17:37.865 05:02:16 -- nvmf/common.sh@521 -- # local subsystem config 00:17:37.865 05:02:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:37.865 05:02:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:37.865 { 00:17:37.865 "params": { 00:17:37.865 "name": "Nvme$subsystem", 00:17:37.866 "trtype": "$TEST_TRANSPORT", 00:17:37.866 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:37.866 "adrfam": "ipv4", 00:17:37.866 "trsvcid": "$NVMF_PORT", 00:17:37.866 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:37.866 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:37.866 "hdgst": ${hdgst:-false}, 00:17:37.866 "ddgst": ${ddgst:-false} 00:17:37.866 }, 00:17:37.866 "method": "bdev_nvme_attach_controller" 00:17:37.866 } 00:17:37.866 EOF 00:17:37.866 )") 00:17:37.866 05:02:16 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2388228 00:17:37.866 05:02:16 -- target/bdev_io_wait.sh@35 -- # sync 00:17:37.866 05:02:16 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:17:37.866 05:02:16 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:17:37.866 05:02:16 -- nvmf/common.sh@521 -- # config=() 00:17:37.866 05:02:16 -- nvmf/common.sh@521 -- # local subsystem config 00:17:37.866 05:02:16 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:17:37.866 05:02:16 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:17:37.866 05:02:16 -- nvmf/common.sh@543 -- # cat 00:17:37.866 05:02:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:37.866 05:02:16 -- nvmf/common.sh@521 -- # config=() 00:17:37.866 05:02:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:37.866 { 00:17:37.866 "params": { 00:17:37.866 "name": "Nvme$subsystem", 00:17:37.866 "trtype": "$TEST_TRANSPORT", 00:17:37.866 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:37.866 "adrfam": "ipv4", 00:17:37.866 "trsvcid": "$NVMF_PORT", 00:17:37.866 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:37.866 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:37.866 "hdgst": ${hdgst:-false}, 00:17:37.866 "ddgst": ${ddgst:-false} 00:17:37.866 }, 00:17:37.866 "method": "bdev_nvme_attach_controller" 00:17:37.866 } 00:17:37.866 EOF 00:17:37.866 )") 00:17:37.866 05:02:16 -- nvmf/common.sh@521 -- # local subsystem config 00:17:37.866 05:02:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:37.866 05:02:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:37.866 { 00:17:37.866 "params": { 00:17:37.866 "name": "Nvme$subsystem", 00:17:37.866 "trtype": "$TEST_TRANSPORT", 00:17:37.866 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:37.866 "adrfam": "ipv4", 00:17:37.866 "trsvcid": "$NVMF_PORT", 00:17:37.866 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:37.866 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:37.866 "hdgst": ${hdgst:-false}, 00:17:37.866 "ddgst": ${ddgst:-false} 00:17:37.866 }, 00:17:37.866 "method": "bdev_nvme_attach_controller" 00:17:37.866 } 00:17:37.866 EOF 00:17:37.866 )") 00:17:37.866 05:02:16 -- nvmf/common.sh@543 -- # cat 00:17:37.866 05:02:16 -- nvmf/common.sh@543 -- # cat 00:17:37.866 05:02:16 -- target/bdev_io_wait.sh@37 -- # wait 2388222 00:17:37.866 05:02:16 -- nvmf/common.sh@543 -- # cat 00:17:37.866 05:02:16 -- nvmf/common.sh@545 -- # jq . 00:17:37.866 05:02:16 -- nvmf/common.sh@545 -- # jq . 00:17:37.866 05:02:16 -- nvmf/common.sh@545 -- # jq . 00:17:37.866 05:02:16 -- nvmf/common.sh@545 -- # jq . 00:17:37.866 05:02:16 -- nvmf/common.sh@546 -- # IFS=, 00:17:37.866 05:02:16 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:37.866 "params": { 00:17:37.866 "name": "Nvme1", 00:17:37.866 "trtype": "tcp", 00:17:37.866 "traddr": "10.0.0.2", 00:17:37.866 "adrfam": "ipv4", 00:17:37.866 "trsvcid": "4420", 00:17:37.866 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.866 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:37.866 "hdgst": false, 00:17:37.866 "ddgst": false 00:17:37.866 }, 00:17:37.866 "method": "bdev_nvme_attach_controller" 00:17:37.866 }' 00:17:37.866 05:02:16 -- nvmf/common.sh@546 -- # IFS=, 00:17:37.866 05:02:16 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:37.866 "params": { 00:17:37.866 "name": "Nvme1", 00:17:37.866 "trtype": "tcp", 00:17:37.866 "traddr": "10.0.0.2", 00:17:37.866 "adrfam": "ipv4", 00:17:37.866 "trsvcid": "4420", 00:17:37.866 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.866 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:37.866 "hdgst": false, 00:17:37.866 "ddgst": false 00:17:37.866 }, 00:17:37.866 "method": "bdev_nvme_attach_controller" 00:17:37.866 }' 00:17:37.866 05:02:16 -- nvmf/common.sh@546 -- # IFS=, 00:17:37.866 05:02:16 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:37.866 "params": { 00:17:37.866 "name": "Nvme1", 00:17:37.866 "trtype": "tcp", 00:17:37.866 "traddr": "10.0.0.2", 00:17:37.866 "adrfam": "ipv4", 00:17:37.866 "trsvcid": "4420", 00:17:37.866 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.866 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:37.866 "hdgst": false, 00:17:37.866 "ddgst": false 00:17:37.866 }, 00:17:37.866 "method": "bdev_nvme_attach_controller" 00:17:37.866 }' 00:17:37.866 05:02:16 -- nvmf/common.sh@546 -- # IFS=, 00:17:37.866 05:02:16 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:37.866 "params": { 00:17:37.866 "name": "Nvme1", 00:17:37.866 "trtype": "tcp", 00:17:37.866 "traddr": "10.0.0.2", 00:17:37.866 "adrfam": "ipv4", 00:17:37.866 "trsvcid": "4420", 00:17:37.866 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.866 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:37.866 "hdgst": false, 00:17:37.866 "ddgst": false 00:17:37.866 }, 00:17:37.866 "method": "bdev_nvme_attach_controller" 00:17:37.866 }' 00:17:37.866 [2024-04-23 05:02:16.821790] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:37.866 [2024-04-23 05:02:16.821818] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:37.866 [2024-04-23 05:02:16.821818] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:37.866 [2024-04-23 05:02:16.821824] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:37.866 [2024-04-23 05:02:16.821879] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:17:37.866 [2024-04-23 05:02:16.821903] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-23 05:02:16.821904] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-23 05:02:16.821904] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:17:37.866 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:37.866 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:17:37.866 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.866 [2024-04-23 05:02:16.969890] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:37.866 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.866 [2024-04-23 05:02:16.997888] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.145 [2024-04-23 05:02:17.069307] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:38.145 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.145 [2024-04-23 05:02:17.071779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:38.145 [2024-04-23 05:02:17.099308] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.145 [2024-04-23 05:02:17.172793] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:38.145 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.145 [2024-04-23 05:02:17.175123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:38.145 [2024-04-23 05:02:17.203454] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.145 [2024-04-23 05:02:17.243712] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:38.145 [2024-04-23 05:02:17.273730] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.145 [2024-04-23 05:02:17.278606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:38.406 [2024-04-23 05:02:17.342033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:17:38.406 Running I/O for 1 seconds... 00:17:38.406 Running I/O for 1 seconds... 00:17:38.406 Running I/O for 1 seconds... 00:17:38.406 Running I/O for 1 seconds... 00:17:39.347 00:17:39.347 Latency(us) 00:17:39.347 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.347 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:17:39.347 Nvme1n1 : 1.02 6208.52 24.25 0.00 0.00 20402.32 9077.95 32234.00 00:17:39.347 =================================================================================================================== 00:17:39.347 Total : 6208.52 24.25 0.00 0.00 20402.32 9077.95 32234.00 00:17:39.347 00:17:39.347 Latency(us) 00:17:39.347 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.347 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:17:39.347 Nvme1n1 : 1.00 202282.71 790.17 0.00 0.00 630.36 250.31 801.00 00:17:39.347 =================================================================================================================== 00:17:39.347 Total : 202282.71 790.17 0.00 0.00 630.36 250.31 801.00 00:17:39.347 00:17:39.347 Latency(us) 00:17:39.347 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.347 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:17:39.347 Nvme1n1 : 1.01 6142.96 24.00 0.00 0.00 20772.15 5558.42 40583.77 00:17:39.347 =================================================================================================================== 00:17:39.347 Total : 6142.96 24.00 0.00 0.00 20772.15 5558.42 40583.77 00:17:39.607 00:17:39.607 Latency(us) 00:17:39.607 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.607 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:17:39.607 Nvme1n1 : 1.01 9347.28 36.51 0.00 0.00 13638.77 6990.51 27962.03 00:17:39.607 =================================================================================================================== 00:17:39.607 Total : 9347.28 36.51 0.00 0.00 13638.77 6990.51 27962.03 00:17:39.866 05:02:18 -- target/bdev_io_wait.sh@38 -- # wait 2388223 00:17:39.866 05:02:18 -- target/bdev_io_wait.sh@39 -- # wait 2388226 00:17:39.866 05:02:18 -- target/bdev_io_wait.sh@40 -- # wait 2388228 00:17:39.866 05:02:18 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:39.866 05:02:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.866 05:02:18 -- common/autotest_common.sh@10 -- # set +x 00:17:39.866 05:02:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.866 05:02:18 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:17:39.866 05:02:18 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:17:39.866 05:02:18 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:39.866 05:02:18 -- nvmf/common.sh@117 -- # sync 00:17:39.866 05:02:18 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:39.866 05:02:18 -- nvmf/common.sh@120 -- # set +e 00:17:39.866 05:02:18 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:39.866 05:02:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:39.866 rmmod nvme_tcp 00:17:39.866 rmmod nvme_fabrics 00:17:39.866 rmmod nvme_keyring 00:17:39.866 05:02:18 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:39.866 05:02:18 -- nvmf/common.sh@124 -- # set -e 00:17:39.866 05:02:18 -- nvmf/common.sh@125 -- # return 0 00:17:39.866 05:02:18 -- nvmf/common.sh@478 -- # '[' -n 2388199 ']' 00:17:39.866 05:02:18 -- nvmf/common.sh@479 -- # killprocess 2388199 00:17:39.866 05:02:18 -- common/autotest_common.sh@936 -- # '[' -z 2388199 ']' 00:17:39.866 05:02:18 -- common/autotest_common.sh@940 -- # kill -0 2388199 00:17:39.866 05:02:18 -- common/autotest_common.sh@941 -- # uname 00:17:39.866 05:02:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.866 05:02:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2388199 00:17:39.866 05:02:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:39.866 05:02:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:39.866 05:02:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2388199' 00:17:39.866 killing process with pid 2388199 00:17:39.866 05:02:18 -- common/autotest_common.sh@955 -- # kill 2388199 00:17:39.866 05:02:18 -- common/autotest_common.sh@960 -- # wait 2388199 00:17:40.124 05:02:19 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:40.124 05:02:19 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:40.124 05:02:19 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:40.124 05:02:19 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:40.124 05:02:19 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:40.124 05:02:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:40.124 05:02:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:40.124 05:02:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.662 05:02:21 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:42.662 00:17:42.662 real 0m7.128s 00:17:42.662 user 0m16.328s 00:17:42.662 sys 0m3.456s 00:17:42.662 05:02:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:42.662 05:02:21 -- common/autotest_common.sh@10 -- # set +x 00:17:42.662 ************************************ 00:17:42.662 END TEST nvmf_bdev_io_wait 00:17:42.662 ************************************ 00:17:42.662 05:02:21 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:42.662 05:02:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:42.662 05:02:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:42.662 05:02:21 -- common/autotest_common.sh@10 -- # set +x 00:17:42.662 ************************************ 00:17:42.662 START TEST nvmf_queue_depth 00:17:42.662 ************************************ 00:17:42.662 05:02:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:42.662 * Looking for test storage... 00:17:42.662 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:42.662 05:02:21 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:42.662 05:02:21 -- nvmf/common.sh@7 -- # uname -s 00:17:42.662 05:02:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:42.662 05:02:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:42.662 05:02:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:42.662 05:02:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:42.662 05:02:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:42.662 05:02:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:42.662 05:02:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:42.662 05:02:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:42.662 05:02:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:42.662 05:02:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:42.662 05:02:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:42.662 05:02:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:42.662 05:02:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:42.662 05:02:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:42.662 05:02:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:42.662 05:02:21 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:42.662 05:02:21 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:42.662 05:02:21 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:42.662 05:02:21 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:42.662 05:02:21 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:42.662 05:02:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.662 05:02:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.662 05:02:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.662 05:02:21 -- paths/export.sh@5 -- # export PATH 00:17:42.662 05:02:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.662 05:02:21 -- nvmf/common.sh@47 -- # : 0 00:17:42.662 05:02:21 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:42.662 05:02:21 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:42.662 05:02:21 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:42.662 05:02:21 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:42.662 05:02:21 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:42.662 05:02:21 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:42.662 05:02:21 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:42.662 05:02:21 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:42.662 05:02:21 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:17:42.662 05:02:21 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:17:42.662 05:02:21 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:42.662 05:02:21 -- target/queue_depth.sh@19 -- # nvmftestinit 00:17:42.662 05:02:21 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:42.662 05:02:21 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:42.662 05:02:21 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:42.662 05:02:21 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:42.662 05:02:21 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:42.662 05:02:21 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:42.662 05:02:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:42.662 05:02:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.662 05:02:21 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:42.662 05:02:21 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:42.662 05:02:21 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:42.662 05:02:21 -- common/autotest_common.sh@10 -- # set +x 00:17:44.565 05:02:23 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:44.565 05:02:23 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:44.565 05:02:23 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:44.565 05:02:23 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:44.565 05:02:23 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:44.565 05:02:23 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:44.565 05:02:23 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:44.565 05:02:23 -- nvmf/common.sh@295 -- # net_devs=() 00:17:44.565 05:02:23 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:44.565 05:02:23 -- nvmf/common.sh@296 -- # e810=() 00:17:44.565 05:02:23 -- nvmf/common.sh@296 -- # local -ga e810 00:17:44.565 05:02:23 -- nvmf/common.sh@297 -- # x722=() 00:17:44.565 05:02:23 -- nvmf/common.sh@297 -- # local -ga x722 00:17:44.565 05:02:23 -- nvmf/common.sh@298 -- # mlx=() 00:17:44.565 05:02:23 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:44.565 05:02:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:44.565 05:02:23 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:44.565 05:02:23 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:44.565 05:02:23 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:44.565 05:02:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:44.565 05:02:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:44.565 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:44.565 05:02:23 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:44.565 05:02:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:44.565 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:44.565 05:02:23 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:44.565 05:02:23 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:44.565 05:02:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.565 05:02:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:44.565 05:02:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.565 05:02:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:44.565 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:44.565 05:02:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.565 05:02:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:44.565 05:02:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.565 05:02:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:44.565 05:02:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.565 05:02:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:44.565 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:44.565 05:02:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.565 05:02:23 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:44.565 05:02:23 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:44.565 05:02:23 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:44.565 05:02:23 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:44.565 05:02:23 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:44.565 05:02:23 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:44.565 05:02:23 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:44.565 05:02:23 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:44.565 05:02:23 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:44.565 05:02:23 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:44.565 05:02:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:44.565 05:02:23 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:44.565 05:02:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:44.565 05:02:23 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:44.565 05:02:23 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:44.565 05:02:23 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:44.565 05:02:23 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:44.565 05:02:23 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:44.565 05:02:23 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:44.565 05:02:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:44.565 05:02:23 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:44.565 05:02:23 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:44.565 05:02:23 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:44.565 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:44.565 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:17:44.565 00:17:44.565 --- 10.0.0.2 ping statistics --- 00:17:44.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.565 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:17:44.565 05:02:23 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:44.565 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:44.565 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:17:44.565 00:17:44.565 --- 10.0.0.1 ping statistics --- 00:17:44.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.565 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:17:44.565 05:02:23 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:44.565 05:02:23 -- nvmf/common.sh@411 -- # return 0 00:17:44.565 05:02:23 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:44.565 05:02:23 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:44.565 05:02:23 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:44.565 05:02:23 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:44.565 05:02:23 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:44.565 05:02:23 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:44.565 05:02:23 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:17:44.565 05:02:23 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:44.565 05:02:23 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:44.565 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:17:44.565 05:02:23 -- nvmf/common.sh@470 -- # nvmfpid=2390452 00:17:44.565 05:02:23 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:44.565 05:02:23 -- nvmf/common.sh@471 -- # waitforlisten 2390452 00:17:44.565 05:02:23 -- common/autotest_common.sh@817 -- # '[' -z 2390452 ']' 00:17:44.565 05:02:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.565 05:02:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:44.565 05:02:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.565 05:02:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:44.565 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:17:44.565 [2024-04-23 05:02:23.660718] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:44.566 [2024-04-23 05:02:23.660823] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.566 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.566 [2024-04-23 05:02:23.698398] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:44.823 [2024-04-23 05:02:23.740241] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:44.824 [2024-04-23 05:02:23.832581] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:44.824 [2024-04-23 05:02:23.832652] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:44.824 [2024-04-23 05:02:23.832686] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:44.824 [2024-04-23 05:02:23.832710] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:44.824 [2024-04-23 05:02:23.832729] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:44.824 [2024-04-23 05:02:23.832775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:44.824 05:02:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:44.824 05:02:23 -- common/autotest_common.sh@850 -- # return 0 00:17:44.824 05:02:23 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:44.824 05:02:23 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:44.824 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:17:45.081 05:02:23 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.081 05:02:23 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:45.081 05:02:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:45.081 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:17:45.081 [2024-04-23 05:02:23.999484] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:45.081 05:02:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:45.081 05:02:24 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:45.081 05:02:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:45.081 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:17:45.081 Malloc0 00:17:45.081 05:02:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:45.081 05:02:24 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:45.081 05:02:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:45.081 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:17:45.081 05:02:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:45.081 05:02:24 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:45.081 05:02:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:45.081 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:17:45.081 05:02:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:45.081 05:02:24 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:45.081 05:02:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:45.081 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:17:45.081 [2024-04-23 05:02:24.060324] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:45.081 05:02:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:45.081 05:02:24 -- target/queue_depth.sh@30 -- # bdevperf_pid=2390595 00:17:45.081 05:02:24 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:17:45.082 05:02:24 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:45.082 05:02:24 -- target/queue_depth.sh@33 -- # waitforlisten 2390595 /var/tmp/bdevperf.sock 00:17:45.082 05:02:24 -- common/autotest_common.sh@817 -- # '[' -z 2390595 ']' 00:17:45.082 05:02:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:45.082 05:02:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:45.082 05:02:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:45.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:45.082 05:02:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:45.082 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:17:45.082 [2024-04-23 05:02:24.104421] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:17:45.082 [2024-04-23 05:02:24.104480] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2390595 ] 00:17:45.082 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.082 [2024-04-23 05:02:24.137759] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:17:45.082 [2024-04-23 05:02:24.168310] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.339 [2024-04-23 05:02:24.257639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:45.339 05:02:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:45.339 05:02:24 -- common/autotest_common.sh@850 -- # return 0 00:17:45.339 05:02:24 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:17:45.339 05:02:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:45.339 05:02:24 -- common/autotest_common.sh@10 -- # set +x 00:17:45.339 NVMe0n1 00:17:45.339 05:02:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:45.339 05:02:24 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:45.598 Running I/O for 10 seconds... 00:17:55.613 00:17:55.613 Latency(us) 00:17:55.613 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:55.613 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:17:55.613 Verification LBA range: start 0x0 length 0x4000 00:17:55.613 NVMe0n1 : 10.07 8357.25 32.65 0.00 0.00 121906.80 15340.28 77672.30 00:17:55.613 =================================================================================================================== 00:17:55.613 Total : 8357.25 32.65 0.00 0.00 121906.80 15340.28 77672.30 00:17:55.613 0 00:17:55.613 05:02:34 -- target/queue_depth.sh@39 -- # killprocess 2390595 00:17:55.613 05:02:34 -- common/autotest_common.sh@936 -- # '[' -z 2390595 ']' 00:17:55.613 05:02:34 -- common/autotest_common.sh@940 -- # kill -0 2390595 00:17:55.613 05:02:34 -- common/autotest_common.sh@941 -- # uname 00:17:55.613 05:02:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:55.613 05:02:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2390595 00:17:55.613 05:02:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:55.613 05:02:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:55.613 05:02:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2390595' 00:17:55.613 killing process with pid 2390595 00:17:55.614 05:02:34 -- common/autotest_common.sh@955 -- # kill 2390595 00:17:55.614 Received shutdown signal, test time was about 10.000000 seconds 00:17:55.614 00:17:55.614 Latency(us) 00:17:55.614 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:55.614 =================================================================================================================== 00:17:55.614 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:55.614 05:02:34 -- common/autotest_common.sh@960 -- # wait 2390595 00:17:55.879 05:02:34 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:17:55.879 05:02:34 -- target/queue_depth.sh@43 -- # nvmftestfini 00:17:55.879 05:02:34 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:55.879 05:02:34 -- nvmf/common.sh@117 -- # sync 00:17:55.879 05:02:34 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:55.879 05:02:34 -- nvmf/common.sh@120 -- # set +e 00:17:55.879 05:02:34 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:55.879 05:02:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:55.879 rmmod nvme_tcp 00:17:55.879 rmmod nvme_fabrics 00:17:55.879 rmmod nvme_keyring 00:17:55.879 05:02:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:55.879 05:02:35 -- nvmf/common.sh@124 -- # set -e 00:17:55.879 05:02:35 -- nvmf/common.sh@125 -- # return 0 00:17:55.879 05:02:35 -- nvmf/common.sh@478 -- # '[' -n 2390452 ']' 00:17:55.879 05:02:35 -- nvmf/common.sh@479 -- # killprocess 2390452 00:17:55.879 05:02:35 -- common/autotest_common.sh@936 -- # '[' -z 2390452 ']' 00:17:55.879 05:02:35 -- common/autotest_common.sh@940 -- # kill -0 2390452 00:17:55.879 05:02:35 -- common/autotest_common.sh@941 -- # uname 00:17:55.879 05:02:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:55.879 05:02:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2390452 00:17:56.138 05:02:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:56.138 05:02:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:56.138 05:02:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2390452' 00:17:56.138 killing process with pid 2390452 00:17:56.138 05:02:35 -- common/autotest_common.sh@955 -- # kill 2390452 00:17:56.138 05:02:35 -- common/autotest_common.sh@960 -- # wait 2390452 00:17:56.396 05:02:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:56.396 05:02:35 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:56.396 05:02:35 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:56.396 05:02:35 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:56.396 05:02:35 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:56.396 05:02:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:56.396 05:02:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:56.396 05:02:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:58.302 05:02:37 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:58.302 00:17:58.302 real 0m15.980s 00:17:58.302 user 0m22.597s 00:17:58.302 sys 0m2.963s 00:17:58.302 05:02:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:58.302 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:17:58.302 ************************************ 00:17:58.302 END TEST nvmf_queue_depth 00:17:58.302 ************************************ 00:17:58.302 05:02:37 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:17:58.302 05:02:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:58.302 05:02:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:58.302 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:17:58.561 ************************************ 00:17:58.561 START TEST nvmf_multipath 00:17:58.561 ************************************ 00:17:58.561 05:02:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:17:58.561 * Looking for test storage... 00:17:58.561 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:58.561 05:02:37 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:58.561 05:02:37 -- nvmf/common.sh@7 -- # uname -s 00:17:58.561 05:02:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:58.561 05:02:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:58.561 05:02:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:58.561 05:02:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:58.561 05:02:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:58.561 05:02:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:58.561 05:02:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:58.561 05:02:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:58.561 05:02:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:58.561 05:02:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:58.561 05:02:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:58.561 05:02:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:58.561 05:02:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:58.561 05:02:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:58.561 05:02:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:58.561 05:02:37 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:58.561 05:02:37 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:58.561 05:02:37 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:58.561 05:02:37 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:58.561 05:02:37 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:58.561 05:02:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.561 05:02:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.561 05:02:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.561 05:02:37 -- paths/export.sh@5 -- # export PATH 00:17:58.561 05:02:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:58.561 05:02:37 -- nvmf/common.sh@47 -- # : 0 00:17:58.561 05:02:37 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:58.561 05:02:37 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:58.561 05:02:37 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:58.561 05:02:37 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:58.562 05:02:37 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:58.562 05:02:37 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:58.562 05:02:37 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:58.562 05:02:37 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:58.562 05:02:37 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:58.562 05:02:37 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:58.562 05:02:37 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:17:58.562 05:02:37 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:58.562 05:02:37 -- target/multipath.sh@43 -- # nvmftestinit 00:17:58.562 05:02:37 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:58.562 05:02:37 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:58.562 05:02:37 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:58.562 05:02:37 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:58.562 05:02:37 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:58.562 05:02:37 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:58.562 05:02:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:58.562 05:02:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:58.562 05:02:37 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:58.562 05:02:37 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:58.562 05:02:37 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:58.562 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:18:00.463 05:02:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:00.463 05:02:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:00.463 05:02:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:00.463 05:02:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:00.463 05:02:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:00.463 05:02:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:00.463 05:02:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:00.463 05:02:39 -- nvmf/common.sh@295 -- # net_devs=() 00:18:00.463 05:02:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:00.463 05:02:39 -- nvmf/common.sh@296 -- # e810=() 00:18:00.463 05:02:39 -- nvmf/common.sh@296 -- # local -ga e810 00:18:00.463 05:02:39 -- nvmf/common.sh@297 -- # x722=() 00:18:00.463 05:02:39 -- nvmf/common.sh@297 -- # local -ga x722 00:18:00.463 05:02:39 -- nvmf/common.sh@298 -- # mlx=() 00:18:00.463 05:02:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:00.463 05:02:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:00.463 05:02:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:00.463 05:02:39 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:00.463 05:02:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:00.463 05:02:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:00.463 05:02:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:00.463 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:00.463 05:02:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:00.463 05:02:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:00.463 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:00.463 05:02:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:00.463 05:02:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:00.463 05:02:39 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:00.464 05:02:39 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:18:00.464 05:02:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:00.464 05:02:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:00.464 05:02:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:00.464 05:02:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:00.464 05:02:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:00.464 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:00.464 05:02:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:00.464 05:02:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:00.464 05:02:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:00.464 05:02:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:00.464 05:02:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:00.464 05:02:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:00.464 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:00.464 05:02:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:00.464 05:02:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:00.464 05:02:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:00.464 05:02:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:00.464 05:02:39 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:18:00.464 05:02:39 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:18:00.464 05:02:39 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:00.464 05:02:39 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:00.464 05:02:39 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:00.464 05:02:39 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:18:00.464 05:02:39 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:00.464 05:02:39 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:00.464 05:02:39 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:18:00.464 05:02:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:00.464 05:02:39 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:00.723 05:02:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:18:00.723 05:02:39 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:18:00.723 05:02:39 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:18:00.723 05:02:39 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:00.723 05:02:39 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:00.723 05:02:39 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:00.723 05:02:39 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:18:00.723 05:02:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:00.723 05:02:39 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:00.723 05:02:39 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:00.723 05:02:39 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:18:00.723 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:00.723 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.139 ms 00:18:00.723 00:18:00.723 --- 10.0.0.2 ping statistics --- 00:18:00.723 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.723 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:18:00.723 05:02:39 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:00.723 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:00.723 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:18:00.723 00:18:00.723 --- 10.0.0.1 ping statistics --- 00:18:00.723 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.723 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:18:00.723 05:02:39 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:00.723 05:02:39 -- nvmf/common.sh@411 -- # return 0 00:18:00.723 05:02:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:00.723 05:02:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:00.723 05:02:39 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:18:00.723 05:02:39 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:18:00.723 05:02:39 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:00.723 05:02:39 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:18:00.723 05:02:39 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:18:00.723 05:02:39 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:00.723 05:02:39 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:00.723 only one NIC for nvmf test 00:18:00.723 05:02:39 -- target/multipath.sh@47 -- # nvmftestfini 00:18:00.723 05:02:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:00.723 05:02:39 -- nvmf/common.sh@117 -- # sync 00:18:00.723 05:02:39 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:18:00.723 05:02:39 -- nvmf/common.sh@120 -- # set +e 00:18:00.723 05:02:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:00.723 05:02:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:18:00.723 rmmod nvme_tcp 00:18:00.723 rmmod nvme_fabrics 00:18:00.723 rmmod nvme_keyring 00:18:00.723 05:02:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:00.723 05:02:39 -- nvmf/common.sh@124 -- # set -e 00:18:00.723 05:02:39 -- nvmf/common.sh@125 -- # return 0 00:18:00.723 05:02:39 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:00.723 05:02:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:00.723 05:02:39 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:18:00.723 05:02:39 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:18:00.723 05:02:39 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:00.723 05:02:39 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:18:00.723 05:02:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:00.723 05:02:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:00.723 05:02:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:03.262 05:02:41 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:18:03.262 05:02:41 -- target/multipath.sh@48 -- # exit 0 00:18:03.262 05:02:41 -- target/multipath.sh@1 -- # nvmftestfini 00:18:03.262 05:02:41 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:03.262 05:02:41 -- nvmf/common.sh@117 -- # sync 00:18:03.262 05:02:41 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:18:03.262 05:02:41 -- nvmf/common.sh@120 -- # set +e 00:18:03.262 05:02:41 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:03.262 05:02:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:18:03.262 05:02:41 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:03.262 05:02:41 -- nvmf/common.sh@124 -- # set -e 00:18:03.262 05:02:41 -- nvmf/common.sh@125 -- # return 0 00:18:03.262 05:02:41 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:03.262 05:02:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:03.262 05:02:41 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:18:03.262 05:02:41 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:18:03.262 05:02:41 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:03.262 05:02:41 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:18:03.262 05:02:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:03.262 05:02:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:03.262 05:02:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:03.262 05:02:41 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:18:03.262 00:18:03.262 real 0m4.411s 00:18:03.262 user 0m0.879s 00:18:03.262 sys 0m1.514s 00:18:03.262 05:02:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:03.262 05:02:41 -- common/autotest_common.sh@10 -- # set +x 00:18:03.262 ************************************ 00:18:03.262 END TEST nvmf_multipath 00:18:03.262 ************************************ 00:18:03.262 05:02:41 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:03.262 05:02:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:03.262 05:02:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:03.262 05:02:41 -- common/autotest_common.sh@10 -- # set +x 00:18:03.262 ************************************ 00:18:03.262 START TEST nvmf_zcopy 00:18:03.262 ************************************ 00:18:03.262 05:02:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:03.262 * Looking for test storage... 00:18:03.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:03.262 05:02:42 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:03.262 05:02:42 -- nvmf/common.sh@7 -- # uname -s 00:18:03.262 05:02:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:03.262 05:02:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:03.262 05:02:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:03.262 05:02:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:03.262 05:02:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:03.262 05:02:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:03.262 05:02:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:03.262 05:02:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:03.262 05:02:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:03.262 05:02:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:03.262 05:02:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:03.262 05:02:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:03.262 05:02:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:03.262 05:02:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:03.262 05:02:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:03.262 05:02:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:03.262 05:02:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:03.262 05:02:42 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:03.262 05:02:42 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:03.262 05:02:42 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:03.262 05:02:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.262 05:02:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.263 05:02:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.263 05:02:42 -- paths/export.sh@5 -- # export PATH 00:18:03.263 05:02:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.263 05:02:42 -- nvmf/common.sh@47 -- # : 0 00:18:03.263 05:02:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:03.263 05:02:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:03.263 05:02:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:03.263 05:02:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:03.263 05:02:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:03.263 05:02:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:03.263 05:02:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:03.263 05:02:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:03.263 05:02:42 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:03.263 05:02:42 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:18:03.263 05:02:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:03.263 05:02:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:03.263 05:02:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:03.263 05:02:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:03.263 05:02:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:03.263 05:02:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:03.263 05:02:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:03.263 05:02:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:03.263 05:02:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:03.263 05:02:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:03.263 05:02:42 -- common/autotest_common.sh@10 -- # set +x 00:18:05.166 05:02:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:05.166 05:02:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:05.166 05:02:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:05.166 05:02:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:05.166 05:02:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:05.166 05:02:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:05.166 05:02:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:05.166 05:02:43 -- nvmf/common.sh@295 -- # net_devs=() 00:18:05.166 05:02:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:05.166 05:02:43 -- nvmf/common.sh@296 -- # e810=() 00:18:05.166 05:02:43 -- nvmf/common.sh@296 -- # local -ga e810 00:18:05.166 05:02:43 -- nvmf/common.sh@297 -- # x722=() 00:18:05.166 05:02:43 -- nvmf/common.sh@297 -- # local -ga x722 00:18:05.166 05:02:43 -- nvmf/common.sh@298 -- # mlx=() 00:18:05.166 05:02:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:05.166 05:02:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:05.166 05:02:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:05.166 05:02:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:05.166 05:02:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:05.166 05:02:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:05.166 05:02:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:05.166 05:02:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:05.166 05:02:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:05.167 05:02:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:05.167 05:02:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:05.167 05:02:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:05.167 05:02:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:05.167 05:02:43 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:05.167 05:02:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:05.167 05:02:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:05.167 05:02:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:05.167 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:05.167 05:02:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:05.167 05:02:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:05.167 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:05.167 05:02:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:05.167 05:02:43 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:05.167 05:02:43 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:18:05.167 05:02:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:05.167 05:02:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:05.167 05:02:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:05.167 05:02:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:05.167 05:02:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:05.167 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:05.167 05:02:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:05.167 05:02:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:05.167 05:02:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:05.167 05:02:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:05.167 05:02:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:05.167 05:02:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:05.167 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:05.167 05:02:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:05.167 05:02:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:05.167 05:02:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:05.167 05:02:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:05.167 05:02:44 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:18:05.167 05:02:44 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:18:05.167 05:02:44 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:05.167 05:02:44 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:05.167 05:02:44 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:05.167 05:02:44 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:18:05.167 05:02:44 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:05.167 05:02:44 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:05.167 05:02:44 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:18:05.167 05:02:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:05.167 05:02:44 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:05.167 05:02:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:18:05.167 05:02:44 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:18:05.167 05:02:44 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:18:05.167 05:02:44 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:05.167 05:02:44 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:05.167 05:02:44 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:05.167 05:02:44 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:18:05.167 05:02:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:05.167 05:02:44 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:05.167 05:02:44 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:05.167 05:02:44 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:18:05.167 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:05.167 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.199 ms 00:18:05.167 00:18:05.167 --- 10.0.0.2 ping statistics --- 00:18:05.167 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.167 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:18:05.167 05:02:44 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:05.167 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:05.167 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:18:05.167 00:18:05.167 --- 10.0.0.1 ping statistics --- 00:18:05.167 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.167 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:18:05.167 05:02:44 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:05.167 05:02:44 -- nvmf/common.sh@411 -- # return 0 00:18:05.167 05:02:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:05.167 05:02:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:05.167 05:02:44 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:18:05.167 05:02:44 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:18:05.167 05:02:44 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:05.167 05:02:44 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:18:05.167 05:02:44 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:18:05.167 05:02:44 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:05.167 05:02:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:05.167 05:02:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:05.167 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.167 05:02:44 -- nvmf/common.sh@470 -- # nvmfpid=2395665 00:18:05.167 05:02:44 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:05.167 05:02:44 -- nvmf/common.sh@471 -- # waitforlisten 2395665 00:18:05.167 05:02:44 -- common/autotest_common.sh@817 -- # '[' -z 2395665 ']' 00:18:05.167 05:02:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:05.167 05:02:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:05.167 05:02:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:05.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:05.167 05:02:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:05.167 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.167 [2024-04-23 05:02:44.204764] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:18:05.167 [2024-04-23 05:02:44.204862] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:05.167 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.167 [2024-04-23 05:02:44.249386] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:18:05.167 [2024-04-23 05:02:44.282247] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.425 [2024-04-23 05:02:44.372237] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:05.425 [2024-04-23 05:02:44.372285] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:05.425 [2024-04-23 05:02:44.372299] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:05.425 [2024-04-23 05:02:44.372310] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:05.425 [2024-04-23 05:02:44.372320] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:05.425 [2024-04-23 05:02:44.372351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:05.425 05:02:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:05.425 05:02:44 -- common/autotest_common.sh@850 -- # return 0 00:18:05.425 05:02:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:05.425 05:02:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:05.425 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.425 05:02:44 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:05.425 05:02:44 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:05.425 05:02:44 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:05.425 05:02:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.425 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.425 [2024-04-23 05:02:44.512210] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:05.425 05:02:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.425 05:02:44 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:05.425 05:02:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.425 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.425 05:02:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.425 05:02:44 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:05.425 05:02:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.425 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.425 [2024-04-23 05:02:44.528419] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:05.425 05:02:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.425 05:02:44 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:05.425 05:02:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.426 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.426 05:02:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.426 05:02:44 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:05.426 05:02:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.426 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.426 malloc0 00:18:05.426 05:02:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.426 05:02:44 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:05.426 05:02:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.426 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:18:05.426 05:02:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.426 05:02:44 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:05.426 05:02:44 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:05.426 05:02:44 -- nvmf/common.sh@521 -- # config=() 00:18:05.426 05:02:44 -- nvmf/common.sh@521 -- # local subsystem config 00:18:05.426 05:02:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:05.426 05:02:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:05.426 { 00:18:05.426 "params": { 00:18:05.426 "name": "Nvme$subsystem", 00:18:05.426 "trtype": "$TEST_TRANSPORT", 00:18:05.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:05.426 "adrfam": "ipv4", 00:18:05.426 "trsvcid": "$NVMF_PORT", 00:18:05.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:05.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:05.426 "hdgst": ${hdgst:-false}, 00:18:05.426 "ddgst": ${ddgst:-false} 00:18:05.426 }, 00:18:05.426 "method": "bdev_nvme_attach_controller" 00:18:05.426 } 00:18:05.426 EOF 00:18:05.426 )") 00:18:05.426 05:02:44 -- nvmf/common.sh@543 -- # cat 00:18:05.426 05:02:44 -- nvmf/common.sh@545 -- # jq . 00:18:05.426 05:02:44 -- nvmf/common.sh@546 -- # IFS=, 00:18:05.426 05:02:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:05.426 "params": { 00:18:05.426 "name": "Nvme1", 00:18:05.426 "trtype": "tcp", 00:18:05.426 "traddr": "10.0.0.2", 00:18:05.426 "adrfam": "ipv4", 00:18:05.426 "trsvcid": "4420", 00:18:05.426 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:05.426 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:05.426 "hdgst": false, 00:18:05.426 "ddgst": false 00:18:05.426 }, 00:18:05.426 "method": "bdev_nvme_attach_controller" 00:18:05.426 }' 00:18:05.685 [2024-04-23 05:02:44.609252] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:18:05.685 [2024-04-23 05:02:44.609328] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2395810 ] 00:18:05.685 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.685 [2024-04-23 05:02:44.640105] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:18:05.685 [2024-04-23 05:02:44.672278] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.685 [2024-04-23 05:02:44.766534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:05.944 Running I/O for 10 seconds... 00:18:15.932 00:18:15.932 Latency(us) 00:18:15.932 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.932 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:15.932 Verification LBA range: start 0x0 length 0x1000 00:18:15.932 Nvme1n1 : 10.02 5573.76 43.54 0.00 0.00 22901.60 3349.62 33010.73 00:18:15.932 =================================================================================================================== 00:18:15.932 Total : 5573.76 43.54 0.00 0.00 22901.60 3349.62 33010.73 00:18:16.191 05:02:55 -- target/zcopy.sh@39 -- # perfpid=2396999 00:18:16.191 05:02:55 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:16.191 05:02:55 -- common/autotest_common.sh@10 -- # set +x 00:18:16.191 05:02:55 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:16.192 05:02:55 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:16.192 05:02:55 -- nvmf/common.sh@521 -- # config=() 00:18:16.192 05:02:55 -- nvmf/common.sh@521 -- # local subsystem config 00:18:16.192 05:02:55 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:16.192 05:02:55 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:16.192 { 00:18:16.192 "params": { 00:18:16.192 "name": "Nvme$subsystem", 00:18:16.192 "trtype": "$TEST_TRANSPORT", 00:18:16.192 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:16.192 "adrfam": "ipv4", 00:18:16.192 "trsvcid": "$NVMF_PORT", 00:18:16.192 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:16.192 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:16.192 "hdgst": ${hdgst:-false}, 00:18:16.192 "ddgst": ${ddgst:-false} 00:18:16.192 }, 00:18:16.192 "method": "bdev_nvme_attach_controller" 00:18:16.192 } 00:18:16.192 EOF 00:18:16.192 )") 00:18:16.192 05:02:55 -- nvmf/common.sh@543 -- # cat 00:18:16.192 [2024-04-23 05:02:55.283662] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.283709] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 05:02:55 -- nvmf/common.sh@545 -- # jq . 00:18:16.192 05:02:55 -- nvmf/common.sh@546 -- # IFS=, 00:18:16.192 05:02:55 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:16.192 "params": { 00:18:16.192 "name": "Nvme1", 00:18:16.192 "trtype": "tcp", 00:18:16.192 "traddr": "10.0.0.2", 00:18:16.192 "adrfam": "ipv4", 00:18:16.192 "trsvcid": "4420", 00:18:16.192 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:16.192 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:16.192 "hdgst": false, 00:18:16.192 "ddgst": false 00:18:16.192 }, 00:18:16.192 "method": "bdev_nvme_attach_controller" 00:18:16.192 }' 00:18:16.192 [2024-04-23 05:02:55.291621] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.291648] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 [2024-04-23 05:02:55.299639] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.299665] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 [2024-04-23 05:02:55.307661] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.307686] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 [2024-04-23 05:02:55.315683] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.315708] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 [2024-04-23 05:02:55.321935] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:18:16.192 [2024-04-23 05:02:55.322019] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2396999 ] 00:18:16.192 [2024-04-23 05:02:55.323705] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.323730] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 [2024-04-23 05:02:55.331732] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.331759] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 [2024-04-23 05:02:55.339749] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.339774] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 [2024-04-23 05:02:55.347776] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.347806] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.192 EAL: No free 2048 kB hugepages reported on node 1 00:18:16.192 [2024-04-23 05:02:55.353697] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:18:16.192 [2024-04-23 05:02:55.355796] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.192 [2024-04-23 05:02:55.355820] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.452 [2024-04-23 05:02:55.363815] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.452 [2024-04-23 05:02:55.363840] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.452 [2024-04-23 05:02:55.371838] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.452 [2024-04-23 05:02:55.371863] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.452 [2024-04-23 05:02:55.379867] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.452 [2024-04-23 05:02:55.379892] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.452 [2024-04-23 05:02:55.386109] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:16.452 [2024-04-23 05:02:55.387886] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.452 [2024-04-23 05:02:55.387911] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.452 [2024-04-23 05:02:55.395945] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.452 [2024-04-23 05:02:55.395983] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.403949] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.403981] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.411940] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.411961] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.419962] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.419983] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.427983] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.428015] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.436025] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.436055] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.444062] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.444100] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.452048] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.452070] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.460068] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.460089] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.468092] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.468114] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.475183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:16.453 [2024-04-23 05:02:55.476112] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.476132] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.484132] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.484153] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.492186] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.492217] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.500216] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.500259] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.508246] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.508285] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.516267] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.516306] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.524289] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.524327] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.532313] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.532353] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.540331] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.540366] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.548329] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.548353] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.556376] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.556412] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.564396] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.564435] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.572390] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.572411] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.580412] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.580435] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.588446] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.588470] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.596484] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.596509] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.604484] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.604528] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.453 [2024-04-23 05:02:55.612556] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.453 [2024-04-23 05:02:55.612581] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.620567] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.620592] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.628581] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.628603] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.636619] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.636641] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.644628] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.644651] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.652655] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.652678] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.660680] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.660719] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.668699] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.668723] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.676717] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.676740] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.685544] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.685573] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 [2024-04-23 05:02:55.692764] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.713 [2024-04-23 05:02:55.692804] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.713 Running I/O for 5 seconds... 00:18:16.714 [2024-04-23 05:02:55.700784] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.700820] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.714076] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.714105] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.724693] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.724721] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.735294] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.735333] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.746214] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.746243] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.757115] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.757143] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.768754] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.768794] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.780751] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.780789] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.792257] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.792288] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.804178] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.804218] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.816043] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.816074] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.828115] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.828145] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.839868] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.839899] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.853157] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.853187] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.863747] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.863775] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.714 [2024-04-23 05:02:55.875440] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.714 [2024-04-23 05:02:55.875471] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.974 [2024-04-23 05:02:55.886979] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.974 [2024-04-23 05:02:55.887011] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.974 [2024-04-23 05:02:55.900485] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.974 [2024-04-23 05:02:55.900523] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.974 [2024-04-23 05:02:55.911304] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.974 [2024-04-23 05:02:55.911334] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.974 [2024-04-23 05:02:55.922662] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.974 [2024-04-23 05:02:55.922690] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.974 [2024-04-23 05:02:55.934397] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.974 [2024-04-23 05:02:55.934427] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.974 [2024-04-23 05:02:55.945780] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.974 [2024-04-23 05:02:55.945807] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.974 [2024-04-23 05:02:55.959027] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:55.959067] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:55.969645] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:55.969673] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:55.981340] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:55.981370] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:55.993580] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:55.993618] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.007086] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.007116] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.017503] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.017566] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.029746] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.029774] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.041355] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.041386] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.052624] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.052652] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.063598] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.063626] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.075554] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.075598] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.087096] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.087126] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.098589] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.098616] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.111990] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.112021] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.123031] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.123062] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.975 [2024-04-23 05:02:56.134767] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.975 [2024-04-23 05:02:56.134795] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.146316] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.146347] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.158279] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.158309] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.170145] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.170175] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.182005] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.182045] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.193871] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.193902] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.205200] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.205230] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.216825] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.216855] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.229948] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.229979] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.239975] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.240005] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.252033] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.252063] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.263929] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.263959] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.276180] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.276210] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.290138] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.290169] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.301150] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.301180] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.313099] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.313129] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.324947] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.324977] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.336653] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.336682] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.348912] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.348943] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.361294] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.361324] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.372918] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.372950] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.384696] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.384724] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.396364] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.396395] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.268 [2024-04-23 05:02:56.408333] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.268 [2024-04-23 05:02:56.408371] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.419848] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.419879] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.431890] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.431921] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.443305] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.443336] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.454985] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.455016] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.466377] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.466409] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.478153] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.478183] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.490050] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.490082] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.501884] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.501915] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.513873] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.513904] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.525740] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.525768] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.537971] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.538002] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.549701] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.549729] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.561449] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.561479] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.572803] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.572833] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.584116] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.584146] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.595866] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.595897] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.607597] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.607624] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.619621] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.619648] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.631740] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.631768] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.643608] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.643636] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.655540] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.655582] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.669268] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.669299] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.680459] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.680489] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.528 [2024-04-23 05:02:56.691894] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.528 [2024-04-23 05:02:56.691925] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.703675] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.703703] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.715369] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.715399] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.727167] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.727198] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.740320] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.740350] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.751509] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.751549] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.763305] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.763333] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.774564] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.774592] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.785807] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.785835] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.796622] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.796652] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.807375] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.807403] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.818132] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.818161] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.830434] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.830463] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.840156] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.840183] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.850575] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.850603] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.861128] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.861155] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.871890] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.871917] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.882578] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.882606] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.895284] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.895313] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.905178] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.905206] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.915945] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.915972] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.928750] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.928780] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.938613] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.938640] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.787 [2024-04-23 05:02:56.949159] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.787 [2024-04-23 05:02:56.949185] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:56.961959] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:56.961987] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:56.971921] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:56.971948] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:56.982794] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:56.982821] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:56.995907] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:56.995934] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.005990] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.006017] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.016241] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.016268] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.026451] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.026477] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.036711] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.036738] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.047656] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.047683] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.060174] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.060200] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.072164] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.072190] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.081394] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.081422] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.092494] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.092528] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.103108] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.103134] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.113385] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.113412] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.123772] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.123799] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.134688] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.134715] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.147256] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.147282] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.158847] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.158875] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.167864] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.167891] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.179724] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.179751] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.190333] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.190360] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.046 [2024-04-23 05:02:57.201010] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.046 [2024-04-23 05:02:57.201037] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.213750] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.213778] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.223768] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.223794] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.234610] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.234637] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.247185] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.247212] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.256789] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.256815] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.268506] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.268541] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.281343] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.281370] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.291708] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.291735] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.302764] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.302791] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.313945] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.313972] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.324840] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.324867] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.337765] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.337792] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.347914] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.347940] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.306 [2024-04-23 05:02:57.358462] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.306 [2024-04-23 05:02:57.358488] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.369366] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.369393] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.380071] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.380098] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.393363] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.393390] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.403740] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.403767] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.414609] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.414636] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.427396] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.427424] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.437049] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.437076] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.448960] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.448991] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.307 [2024-04-23 05:02:57.460774] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.307 [2024-04-23 05:02:57.460801] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.472478] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.567 [2024-04-23 05:02:57.472524] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.484856] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.567 [2024-04-23 05:02:57.484897] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.496506] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.567 [2024-04-23 05:02:57.496559] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.510106] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.567 [2024-04-23 05:02:57.510136] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.521508] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.567 [2024-04-23 05:02:57.521574] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.532702] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.567 [2024-04-23 05:02:57.532730] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.546943] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.567 [2024-04-23 05:02:57.546973] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.567 [2024-04-23 05:02:57.558169] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.558198] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.569689] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.569716] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.581439] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.581469] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.593413] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.593443] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.605258] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.605288] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.617189] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.617218] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.629359] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.629389] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.641404] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.641434] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.652679] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.652706] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.664336] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.664366] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.675724] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.675751] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.687563] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.687590] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.699385] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.699423] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.713201] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.713231] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.568 [2024-04-23 05:02:57.723501] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.568 [2024-04-23 05:02:57.723538] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.735464] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.735495] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.747098] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.747127] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.760651] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.760678] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.771444] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.771474] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.783054] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.783084] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.794919] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.794949] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.808202] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.808232] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.818475] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.818505] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.830794] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.830821] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.842743] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.842770] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.854391] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.854421] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.865721] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.865748] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.877595] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.877622] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.889591] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.889618] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.901244] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.901273] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.913007] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.913037] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.924598] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.924632] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.936386] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.936416] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.948114] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.948144] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.959596] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.959624] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.827 [2024-04-23 05:02:57.971270] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.827 [2024-04-23 05:02:57.971300] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.828 [2024-04-23 05:02:57.983019] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.828 [2024-04-23 05:02:57.983049] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:57.994931] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:57.994961] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.006261] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.006289] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.017692] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.017720] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.029563] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.029593] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.041029] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.041060] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.052664] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.052691] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.064999] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.065029] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.076987] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.077018] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.089023] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.089053] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.101099] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.101129] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.112764] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.112791] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.124636] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.124663] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.136328] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.136357] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.147831] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.147869] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.160186] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.160215] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.171679] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.171706] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.183527] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.183571] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.195126] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.195155] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.208540] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.208582] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.218670] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.218697] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.230740] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.230767] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.088 [2024-04-23 05:02:58.242658] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.088 [2024-04-23 05:02:58.242685] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.347 [2024-04-23 05:02:58.254620] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.254648] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.266606] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.266633] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.278449] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.278479] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.290969] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.290999] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.303369] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.303398] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.314992] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.315022] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.326764] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.326791] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.338247] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.338278] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.349958] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.349988] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.361458] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.361487] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.372898] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.372928] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.386767] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.386794] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.398110] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.398141] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.409626] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.409654] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.421312] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.421341] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.432939] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.432969] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.444199] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.444229] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.455391] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.455421] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.466070] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.466101] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.477612] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.477639] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.489315] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.489345] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.501164] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.501194] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.348 [2024-04-23 05:02:58.513119] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.348 [2024-04-23 05:02:58.513148] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.606 [2024-04-23 05:02:58.524638] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.606 [2024-04-23 05:02:58.524666] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.606 [2024-04-23 05:02:58.535883] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.606 [2024-04-23 05:02:58.535913] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.606 [2024-04-23 05:02:58.547419] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.606 [2024-04-23 05:02:58.547449] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.606 [2024-04-23 05:02:58.559105] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.559135] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.570715] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.570743] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.582512] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.582564] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.596020] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.596050] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.606886] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.606916] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.617834] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.617864] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.629183] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.629212] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.640732] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.640760] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.652246] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.652276] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.665698] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.665725] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.676571] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.676598] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.687987] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.688017] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.699242] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.699271] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.710923] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.710953] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.724719] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.724746] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.735609] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.735637] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.747214] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.747244] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.758557] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.758584] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.607 [2024-04-23 05:02:58.770400] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.607 [2024-04-23 05:02:58.770430] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.781989] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.782019] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.795531] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.795574] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.806656] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.806683] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.817832] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.817863] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.831371] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.831402] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.842709] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.842736] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.854477] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.854507] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.866096] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.866126] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.878162] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.878192] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.889676] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.889703] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.901344] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.901373] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.913263] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.913294] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.926698] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.926725] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.937328] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.937358] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.948927] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.948957] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.960633] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.960660] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.972097] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.972127] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.983576] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.983603] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:58.994975] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:58.995004] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:59.006180] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:59.006210] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:59.017888] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:59.017918] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.865 [2024-04-23 05:02:59.029841] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.865 [2024-04-23 05:02:59.029871] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.125 [2024-04-23 05:02:59.041226] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.125 [2024-04-23 05:02:59.041257] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.125 [2024-04-23 05:02:59.052880] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.052910] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.064232] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.064262] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.075512] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.075548] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.086600] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.086627] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.098119] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.098149] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.109614] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.109641] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.122872] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.122902] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.133596] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.133623] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.144979] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.145009] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.156480] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.156510] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.168379] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.168408] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.179958] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.179987] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.192036] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.192067] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.203647] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.203674] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.215389] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.215419] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.227050] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.227080] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.238750] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.238778] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.250172] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.250212] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.262052] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.262081] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.273325] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.273354] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.126 [2024-04-23 05:02:59.286905] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.126 [2024-04-23 05:02:59.286934] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.385 [2024-04-23 05:02:59.297814] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.385 [2024-04-23 05:02:59.297841] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.385 [2024-04-23 05:02:59.309582] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.385 [2024-04-23 05:02:59.309608] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.385 [2024-04-23 05:02:59.320940] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.385 [2024-04-23 05:02:59.320970] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.385 [2024-04-23 05:02:59.332157] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.385 [2024-04-23 05:02:59.332186] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.385 [2024-04-23 05:02:59.343722] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.343749] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.355319] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.355349] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.366986] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.367016] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.378612] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.378639] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.389769] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.389796] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.401394] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.401424] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.412784] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.412811] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.424280] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.424309] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.435719] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.435746] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.447445] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.447474] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.459095] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.459124] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.470434] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.470473] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.481830] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.481859] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.493317] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.493347] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.504633] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.504662] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.516097] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.516127] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.527529] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.527573] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.386 [2024-04-23 05:02:59.541547] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.386 [2024-04-23 05:02:59.541598] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.552755] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.552790] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.564142] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.564172] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.575401] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.575431] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.586687] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.586715] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.598487] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.598526] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.610285] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.610314] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.621950] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.621981] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.635822] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.635849] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.646879] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.646909] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.658443] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.658473] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.672123] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.672153] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.683228] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.683258] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.694705] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.694740] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.708590] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.708617] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.719474] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.719503] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.730604] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.730632] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.743831] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.743872] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.754916] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.754947] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.766674] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.766701] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.777981] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.778010] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.789477] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.789507] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.646 [2024-04-23 05:02:59.801507] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.646 [2024-04-23 05:02:59.801548] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.812978] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.813009] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.826614] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.826640] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.837371] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.837401] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.849408] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.849438] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.861101] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.861130] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.874828] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.874858] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.885676] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.885703] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.896987] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.897017] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.908740] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.908767] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.920238] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.920276] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.931972] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.932001] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.943732] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.943759] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.955503] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.955541] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.967432] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.967461] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.979385] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.979415] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:02:59.990992] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:02:59.991023] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:03:00.004002] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:03:00.004040] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:03:00.018421] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:03:00.018453] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:03:00.030646] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:03:00.030674] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:03:00.042329] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:03:00.042359] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:03:00.053171] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:03:00.053198] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:20.906 [2024-04-23 05:03:00.064805] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:20.906 [2024-04-23 05:03:00.064833] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.075623] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.075652] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.087416] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.087447] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.098857] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.098887] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.110715] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.110743] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.122624] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.122652] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.134358] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.134388] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.146129] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.146160] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.157576] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.157603] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.169262] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.169291] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.182035] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.182061] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.191831] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.191858] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.203302] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.203328] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.216046] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.216073] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.226527] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.226561] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.237038] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.237065] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.248036] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.248064] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.258891] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.258919] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.269758] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.269786] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.280454] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.280482] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.293164] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.293192] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.303279] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.303306] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.313786] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.313813] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.165 [2024-04-23 05:03:00.324528] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.165 [2024-04-23 05:03:00.324555] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.337052] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.337080] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.347343] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.347370] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.358279] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.358306] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.375720] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.375751] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.386216] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.386244] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.396691] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.396718] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.407230] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.407257] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.418365] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.418392] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.431214] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.431241] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.443141] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.443168] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.452194] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.452221] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.463989] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.464016] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.474633] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.474661] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.485581] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.485608] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.498755] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.498782] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.508960] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.508987] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.519947] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.519974] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.532803] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.532830] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.542877] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.542904] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.553758] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.553794] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.565147] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.565175] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.575925] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.575951] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.424 [2024-04-23 05:03:00.588063] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.424 [2024-04-23 05:03:00.588090] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.597497] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.597537] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.609160] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.609187] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.622129] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.622157] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.632314] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.632341] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.642926] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.642954] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.656001] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.656028] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.666437] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.666463] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.676944] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.676971] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.687740] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.687776] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.698485] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.698512] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.709323] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.709350] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 [2024-04-23 05:03:00.719131] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.683 [2024-04-23 05:03:00.719157] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.683 00:18:21.684 Latency(us) 00:18:21.684 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.684 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:21.684 Nvme1n1 : 5.01 11132.75 86.97 0.00 0.00 11483.47 4805.97 22136.60 00:18:21.684 =================================================================================================================== 00:18:21.684 Total : 11132.75 86.97 0.00 0.00 11483.47 4805.97 22136.60 00:18:21.684 [2024-04-23 05:03:00.725162] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.725185] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.733182] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.733214] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.741254] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.741296] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.749289] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.749339] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.757298] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.757344] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.765318] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.765367] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.773343] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.773392] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.781370] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.781418] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.789404] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.789458] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.797410] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.797462] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.805432] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.805487] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.813456] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.813511] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.821480] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.821546] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.829499] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.829566] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.837527] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.837574] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.684 [2024-04-23 05:03:00.845551] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.684 [2024-04-23 05:03:00.845599] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.942 [2024-04-23 05:03:00.853542] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.942 [2024-04-23 05:03:00.853584] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.861563] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.861590] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.869616] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.869667] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.877636] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.877689] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.885658] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.885716] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.893655] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.893678] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.901688] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.901730] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.909719] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.909775] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.917726] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.917767] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.925711] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.925731] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 [2024-04-23 05:03:00.933732] subsystem.c:1900:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:21.943 [2024-04-23 05:03:00.933753] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:21.943 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2396999) - No such process 00:18:21.943 05:03:00 -- target/zcopy.sh@49 -- # wait 2396999 00:18:21.943 05:03:00 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:21.943 05:03:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.943 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:18:21.943 05:03:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.943 05:03:00 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:21.943 05:03:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.943 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:18:21.943 delay0 00:18:21.943 05:03:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.943 05:03:00 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:21.943 05:03:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.943 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:18:21.943 05:03:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.943 05:03:00 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:21.943 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.943 [2024-04-23 05:03:01.060652] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:28.511 Initializing NVMe Controllers 00:18:28.511 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:28.511 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:28.511 Initialization complete. Launching workers. 00:18:28.511 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 154 00:18:28.511 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 429, failed to submit 45 00:18:28.511 success 256, unsuccess 173, failed 0 00:18:28.511 05:03:07 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:28.511 05:03:07 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:28.511 05:03:07 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:28.511 05:03:07 -- nvmf/common.sh@117 -- # sync 00:18:28.511 05:03:07 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:18:28.511 05:03:07 -- nvmf/common.sh@120 -- # set +e 00:18:28.511 05:03:07 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:28.511 05:03:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:18:28.511 rmmod nvme_tcp 00:18:28.511 rmmod nvme_fabrics 00:18:28.511 rmmod nvme_keyring 00:18:28.511 05:03:07 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:28.511 05:03:07 -- nvmf/common.sh@124 -- # set -e 00:18:28.511 05:03:07 -- nvmf/common.sh@125 -- # return 0 00:18:28.511 05:03:07 -- nvmf/common.sh@478 -- # '[' -n 2395665 ']' 00:18:28.511 05:03:07 -- nvmf/common.sh@479 -- # killprocess 2395665 00:18:28.511 05:03:07 -- common/autotest_common.sh@936 -- # '[' -z 2395665 ']' 00:18:28.511 05:03:07 -- common/autotest_common.sh@940 -- # kill -0 2395665 00:18:28.511 05:03:07 -- common/autotest_common.sh@941 -- # uname 00:18:28.511 05:03:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:28.511 05:03:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2395665 00:18:28.511 05:03:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:28.511 05:03:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:28.511 05:03:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2395665' 00:18:28.511 killing process with pid 2395665 00:18:28.511 05:03:07 -- common/autotest_common.sh@955 -- # kill 2395665 00:18:28.511 05:03:07 -- common/autotest_common.sh@960 -- # wait 2395665 00:18:28.511 05:03:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:28.511 05:03:07 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:18:28.511 05:03:07 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:18:28.511 05:03:07 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:28.511 05:03:07 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:18:28.511 05:03:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:28.511 05:03:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:28.511 05:03:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:30.412 05:03:09 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:18:30.412 00:18:30.412 real 0m27.515s 00:18:30.412 user 0m40.503s 00:18:30.412 sys 0m8.425s 00:18:30.412 05:03:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:30.412 05:03:09 -- common/autotest_common.sh@10 -- # set +x 00:18:30.412 ************************************ 00:18:30.412 END TEST nvmf_zcopy 00:18:30.412 ************************************ 00:18:30.412 05:03:09 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:30.412 05:03:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:30.412 05:03:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:30.412 05:03:09 -- common/autotest_common.sh@10 -- # set +x 00:18:30.671 ************************************ 00:18:30.671 START TEST nvmf_nmic 00:18:30.671 ************************************ 00:18:30.671 05:03:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:30.671 * Looking for test storage... 00:18:30.671 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:30.671 05:03:09 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:30.671 05:03:09 -- nvmf/common.sh@7 -- # uname -s 00:18:30.671 05:03:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:30.671 05:03:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:30.671 05:03:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:30.671 05:03:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:30.671 05:03:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:30.671 05:03:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:30.671 05:03:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:30.671 05:03:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:30.671 05:03:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:30.671 05:03:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:30.671 05:03:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:30.671 05:03:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:30.671 05:03:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:30.671 05:03:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:30.671 05:03:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:30.671 05:03:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:30.671 05:03:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:30.671 05:03:09 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:30.671 05:03:09 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:30.671 05:03:09 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:30.671 05:03:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.671 05:03:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.671 05:03:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.671 05:03:09 -- paths/export.sh@5 -- # export PATH 00:18:30.671 05:03:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.671 05:03:09 -- nvmf/common.sh@47 -- # : 0 00:18:30.671 05:03:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:30.671 05:03:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:30.671 05:03:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:30.671 05:03:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:30.671 05:03:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:30.671 05:03:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:30.671 05:03:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:30.671 05:03:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:30.671 05:03:09 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:30.671 05:03:09 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:30.671 05:03:09 -- target/nmic.sh@14 -- # nvmftestinit 00:18:30.671 05:03:09 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:18:30.671 05:03:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:30.671 05:03:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:30.671 05:03:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:30.671 05:03:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:30.671 05:03:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:30.671 05:03:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:30.671 05:03:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:30.671 05:03:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:30.671 05:03:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:30.671 05:03:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:30.671 05:03:09 -- common/autotest_common.sh@10 -- # set +x 00:18:32.587 05:03:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:32.587 05:03:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:32.587 05:03:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:32.587 05:03:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:32.587 05:03:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:32.587 05:03:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:32.587 05:03:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:32.587 05:03:11 -- nvmf/common.sh@295 -- # net_devs=() 00:18:32.587 05:03:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:32.587 05:03:11 -- nvmf/common.sh@296 -- # e810=() 00:18:32.587 05:03:11 -- nvmf/common.sh@296 -- # local -ga e810 00:18:32.587 05:03:11 -- nvmf/common.sh@297 -- # x722=() 00:18:32.587 05:03:11 -- nvmf/common.sh@297 -- # local -ga x722 00:18:32.587 05:03:11 -- nvmf/common.sh@298 -- # mlx=() 00:18:32.587 05:03:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:32.587 05:03:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:32.587 05:03:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:32.587 05:03:11 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:32.587 05:03:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:32.587 05:03:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:32.587 05:03:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:32.587 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:32.587 05:03:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:32.587 05:03:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:32.587 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:32.587 05:03:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:32.587 05:03:11 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:32.587 05:03:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.587 05:03:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:32.587 05:03:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.587 05:03:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:32.587 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:32.587 05:03:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.587 05:03:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:32.587 05:03:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.587 05:03:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:32.587 05:03:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.587 05:03:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:32.587 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:32.587 05:03:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.587 05:03:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:32.587 05:03:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:32.587 05:03:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:18:32.587 05:03:11 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:18:32.587 05:03:11 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:32.587 05:03:11 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:32.587 05:03:11 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:32.588 05:03:11 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:18:32.588 05:03:11 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:32.588 05:03:11 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:32.588 05:03:11 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:18:32.588 05:03:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:32.588 05:03:11 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:32.588 05:03:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:18:32.588 05:03:11 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:18:32.588 05:03:11 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:18:32.588 05:03:11 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:32.847 05:03:11 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:32.847 05:03:11 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:32.847 05:03:11 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:18:32.847 05:03:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:32.847 05:03:11 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:32.847 05:03:11 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:32.847 05:03:11 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:18:32.847 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:32.847 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.149 ms 00:18:32.847 00:18:32.847 --- 10.0.0.2 ping statistics --- 00:18:32.847 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.847 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:18:32.847 05:03:11 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:32.847 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:32.847 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:18:32.847 00:18:32.847 --- 10.0.0.1 ping statistics --- 00:18:32.847 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.847 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:18:32.847 05:03:11 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:32.847 05:03:11 -- nvmf/common.sh@411 -- # return 0 00:18:32.847 05:03:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:32.847 05:03:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:32.847 05:03:11 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:18:32.847 05:03:11 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:18:32.847 05:03:11 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:32.847 05:03:11 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:18:32.847 05:03:11 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:18:32.847 05:03:11 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:32.847 05:03:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:32.847 05:03:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:32.847 05:03:11 -- common/autotest_common.sh@10 -- # set +x 00:18:32.847 05:03:11 -- nvmf/common.sh@470 -- # nvmfpid=2401003 00:18:32.847 05:03:11 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:32.847 05:03:11 -- nvmf/common.sh@471 -- # waitforlisten 2401003 00:18:32.847 05:03:11 -- common/autotest_common.sh@817 -- # '[' -z 2401003 ']' 00:18:32.847 05:03:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:32.847 05:03:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:32.847 05:03:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:32.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:32.847 05:03:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:32.847 05:03:11 -- common/autotest_common.sh@10 -- # set +x 00:18:32.847 [2024-04-23 05:03:11.908307] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:18:32.847 [2024-04-23 05:03:11.908379] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:32.847 EAL: No free 2048 kB hugepages reported on node 1 00:18:32.847 [2024-04-23 05:03:11.945092] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:18:32.847 [2024-04-23 05:03:11.971524] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:33.107 [2024-04-23 05:03:12.058253] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:33.107 [2024-04-23 05:03:12.058326] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:33.107 [2024-04-23 05:03:12.058354] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:33.107 [2024-04-23 05:03:12.058366] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:33.107 [2024-04-23 05:03:12.058376] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:33.107 [2024-04-23 05:03:12.058435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:33.107 [2024-04-23 05:03:12.058466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:33.107 [2024-04-23 05:03:12.058914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:33.107 [2024-04-23 05:03:12.058919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:33.107 05:03:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:33.107 05:03:12 -- common/autotest_common.sh@850 -- # return 0 00:18:33.107 05:03:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:33.107 05:03:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:33.107 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.107 05:03:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:33.107 05:03:12 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:33.107 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.107 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.107 [2024-04-23 05:03:12.216238] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:33.107 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.107 05:03:12 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:33.107 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.107 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.107 Malloc0 00:18:33.107 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.107 05:03:12 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:33.107 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.107 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.107 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.107 05:03:12 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:33.107 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.107 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.107 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.107 05:03:12 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:33.107 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.107 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.107 [2024-04-23 05:03:12.269923] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:33.365 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.365 05:03:12 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:33.365 test case1: single bdev can't be used in multiple subsystems 00:18:33.365 05:03:12 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:33.365 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.365 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.365 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.365 05:03:12 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:33.365 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.365 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.365 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.365 05:03:12 -- target/nmic.sh@28 -- # nmic_status=0 00:18:33.365 05:03:12 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:33.365 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.365 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.365 [2024-04-23 05:03:12.293726] bdev.c:7988:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:33.365 [2024-04-23 05:03:12.293765] subsystem.c:1934:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:33.365 [2024-04-23 05:03:12.293781] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.365 request: 00:18:33.365 { 00:18:33.365 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:33.365 "namespace": { 00:18:33.365 "bdev_name": "Malloc0", 00:18:33.365 "no_auto_visible": false 00:18:33.365 }, 00:18:33.365 "method": "nvmf_subsystem_add_ns", 00:18:33.365 "req_id": 1 00:18:33.365 } 00:18:33.365 Got JSON-RPC error response 00:18:33.365 response: 00:18:33.365 { 00:18:33.365 "code": -32602, 00:18:33.365 "message": "Invalid parameters" 00:18:33.365 } 00:18:33.365 05:03:12 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:18:33.365 05:03:12 -- target/nmic.sh@29 -- # nmic_status=1 00:18:33.365 05:03:12 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:33.365 05:03:12 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:33.365 Adding namespace failed - expected result. 00:18:33.365 05:03:12 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:33.365 test case2: host connect to nvmf target in multiple paths 00:18:33.365 05:03:12 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:33.365 05:03:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:33.365 05:03:12 -- common/autotest_common.sh@10 -- # set +x 00:18:33.365 [2024-04-23 05:03:12.301847] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:33.365 05:03:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:33.365 05:03:12 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:33.932 05:03:12 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:18:34.499 05:03:13 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:18:34.499 05:03:13 -- common/autotest_common.sh@1184 -- # local i=0 00:18:34.499 05:03:13 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:34.499 05:03:13 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:34.499 05:03:13 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:37.029 05:03:15 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:37.029 05:03:15 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:37.029 05:03:15 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:18:37.029 05:03:15 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:37.029 05:03:15 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:37.029 05:03:15 -- common/autotest_common.sh@1194 -- # return 0 00:18:37.029 05:03:15 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:37.029 [global] 00:18:37.029 thread=1 00:18:37.029 invalidate=1 00:18:37.029 rw=write 00:18:37.029 time_based=1 00:18:37.029 runtime=1 00:18:37.029 ioengine=libaio 00:18:37.029 direct=1 00:18:37.029 bs=4096 00:18:37.029 iodepth=1 00:18:37.029 norandommap=0 00:18:37.029 numjobs=1 00:18:37.029 00:18:37.029 verify_dump=1 00:18:37.029 verify_backlog=512 00:18:37.029 verify_state_save=0 00:18:37.029 do_verify=1 00:18:37.029 verify=crc32c-intel 00:18:37.029 [job0] 00:18:37.029 filename=/dev/nvme0n1 00:18:37.029 Could not set queue depth (nvme0n1) 00:18:37.029 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:37.029 fio-3.35 00:18:37.029 Starting 1 thread 00:18:37.966 00:18:37.966 job0: (groupid=0, jobs=1): err= 0: pid=2401514: Tue Apr 23 05:03:16 2024 00:18:37.966 read: IOPS=21, BW=84.9KiB/s (87.0kB/s)(88.0KiB/1036msec) 00:18:37.966 slat (nsec): min=8643, max=34437, avg=18973.00, stdev=9095.24 00:18:37.966 clat (usec): min=40907, max=41275, avg=40989.60, stdev=72.19 00:18:37.966 lat (usec): min=40934, max=41283, avg=41008.57, stdev=68.16 00:18:37.966 clat percentiles (usec): 00:18:37.966 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:18:37.966 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:18:37.966 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:18:37.966 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:18:37.966 | 99.99th=[41157] 00:18:37.966 write: IOPS=494, BW=1977KiB/s (2024kB/s)(2048KiB/1036msec); 0 zone resets 00:18:37.966 slat (usec): min=9, max=29690, avg=72.90, stdev=1311.49 00:18:37.966 clat (usec): min=154, max=389, avg=183.60, stdev=20.36 00:18:37.966 lat (usec): min=163, max=30020, avg=256.50, stdev=1318.21 00:18:37.966 clat percentiles (usec): 00:18:37.966 | 1.00th=[ 159], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 169], 00:18:37.966 | 30.00th=[ 174], 40.00th=[ 176], 50.00th=[ 180], 60.00th=[ 186], 00:18:37.966 | 70.00th=[ 190], 80.00th=[ 196], 90.00th=[ 202], 95.00th=[ 212], 00:18:37.966 | 99.00th=[ 258], 99.50th=[ 273], 99.90th=[ 392], 99.95th=[ 392], 00:18:37.966 | 99.99th=[ 392] 00:18:37.966 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:18:37.966 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:37.966 lat (usec) : 250=94.76%, 500=1.12% 00:18:37.966 lat (msec) : 50=4.12% 00:18:37.966 cpu : usr=0.39%, sys=0.97%, ctx=536, majf=0, minf=2 00:18:37.966 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:37.966 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:37.966 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:37.966 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:37.966 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:37.966 00:18:37.966 Run status group 0 (all jobs): 00:18:37.966 READ: bw=84.9KiB/s (87.0kB/s), 84.9KiB/s-84.9KiB/s (87.0kB/s-87.0kB/s), io=88.0KiB (90.1kB), run=1036-1036msec 00:18:37.966 WRITE: bw=1977KiB/s (2024kB/s), 1977KiB/s-1977KiB/s (2024kB/s-2024kB/s), io=2048KiB (2097kB), run=1036-1036msec 00:18:37.966 00:18:37.966 Disk stats (read/write): 00:18:37.966 nvme0n1: ios=70/512, merge=0/0, ticks=1161/92, in_queue=1253, util=98.70% 00:18:37.966 05:03:16 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:37.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:18:37.966 05:03:17 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:18:37.966 05:03:17 -- common/autotest_common.sh@1205 -- # local i=0 00:18:37.966 05:03:17 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:18:37.966 05:03:17 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:37.966 05:03:17 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:18:37.966 05:03:17 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:37.966 05:03:17 -- common/autotest_common.sh@1217 -- # return 0 00:18:37.966 05:03:17 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:18:37.966 05:03:17 -- target/nmic.sh@53 -- # nvmftestfini 00:18:37.966 05:03:17 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:37.966 05:03:17 -- nvmf/common.sh@117 -- # sync 00:18:37.966 05:03:17 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:18:37.966 05:03:17 -- nvmf/common.sh@120 -- # set +e 00:18:37.966 05:03:17 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:37.966 05:03:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:18:37.966 rmmod nvme_tcp 00:18:37.966 rmmod nvme_fabrics 00:18:37.966 rmmod nvme_keyring 00:18:37.966 05:03:17 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:37.966 05:03:17 -- nvmf/common.sh@124 -- # set -e 00:18:37.966 05:03:17 -- nvmf/common.sh@125 -- # return 0 00:18:37.966 05:03:17 -- nvmf/common.sh@478 -- # '[' -n 2401003 ']' 00:18:37.966 05:03:17 -- nvmf/common.sh@479 -- # killprocess 2401003 00:18:37.966 05:03:17 -- common/autotest_common.sh@936 -- # '[' -z 2401003 ']' 00:18:37.966 05:03:17 -- common/autotest_common.sh@940 -- # kill -0 2401003 00:18:37.966 05:03:17 -- common/autotest_common.sh@941 -- # uname 00:18:37.966 05:03:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:37.966 05:03:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2401003 00:18:38.224 05:03:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:38.224 05:03:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:38.224 05:03:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2401003' 00:18:38.224 killing process with pid 2401003 00:18:38.225 05:03:17 -- common/autotest_common.sh@955 -- # kill 2401003 00:18:38.225 05:03:17 -- common/autotest_common.sh@960 -- # wait 2401003 00:18:38.485 05:03:17 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:38.485 05:03:17 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:18:38.485 05:03:17 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:18:38.485 05:03:17 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:38.485 05:03:17 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:18:38.485 05:03:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:38.485 05:03:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:38.485 05:03:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.394 05:03:19 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:18:40.394 00:18:40.394 real 0m9.776s 00:18:40.394 user 0m22.265s 00:18:40.394 sys 0m2.194s 00:18:40.394 05:03:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:40.394 05:03:19 -- common/autotest_common.sh@10 -- # set +x 00:18:40.394 ************************************ 00:18:40.394 END TEST nvmf_nmic 00:18:40.394 ************************************ 00:18:40.394 05:03:19 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:40.394 05:03:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:40.394 05:03:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:40.394 05:03:19 -- common/autotest_common.sh@10 -- # set +x 00:18:40.394 ************************************ 00:18:40.394 START TEST nvmf_fio_target 00:18:40.394 ************************************ 00:18:40.394 05:03:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:40.652 * Looking for test storage... 00:18:40.652 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:40.652 05:03:19 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:40.652 05:03:19 -- nvmf/common.sh@7 -- # uname -s 00:18:40.652 05:03:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:40.652 05:03:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:40.652 05:03:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:40.652 05:03:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:40.652 05:03:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:40.652 05:03:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:40.652 05:03:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:40.652 05:03:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:40.652 05:03:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:40.652 05:03:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:40.652 05:03:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.652 05:03:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.653 05:03:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:40.653 05:03:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:40.653 05:03:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:40.653 05:03:19 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:40.653 05:03:19 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:40.653 05:03:19 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:40.653 05:03:19 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:40.653 05:03:19 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:40.653 05:03:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.653 05:03:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.653 05:03:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.653 05:03:19 -- paths/export.sh@5 -- # export PATH 00:18:40.653 05:03:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.653 05:03:19 -- nvmf/common.sh@47 -- # : 0 00:18:40.653 05:03:19 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:40.653 05:03:19 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:40.653 05:03:19 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:40.653 05:03:19 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:40.653 05:03:19 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:40.653 05:03:19 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:40.653 05:03:19 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:40.653 05:03:19 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:40.653 05:03:19 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:40.653 05:03:19 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:40.653 05:03:19 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:40.653 05:03:19 -- target/fio.sh@16 -- # nvmftestinit 00:18:40.653 05:03:19 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:18:40.653 05:03:19 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:40.653 05:03:19 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:40.653 05:03:19 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:40.653 05:03:19 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:40.653 05:03:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.653 05:03:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.653 05:03:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.653 05:03:19 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:40.653 05:03:19 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:40.653 05:03:19 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:40.653 05:03:19 -- common/autotest_common.sh@10 -- # set +x 00:18:42.585 05:03:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:42.585 05:03:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:42.585 05:03:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:42.585 05:03:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:42.585 05:03:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:42.585 05:03:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:42.585 05:03:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:42.585 05:03:21 -- nvmf/common.sh@295 -- # net_devs=() 00:18:42.585 05:03:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:42.585 05:03:21 -- nvmf/common.sh@296 -- # e810=() 00:18:42.585 05:03:21 -- nvmf/common.sh@296 -- # local -ga e810 00:18:42.585 05:03:21 -- nvmf/common.sh@297 -- # x722=() 00:18:42.585 05:03:21 -- nvmf/common.sh@297 -- # local -ga x722 00:18:42.585 05:03:21 -- nvmf/common.sh@298 -- # mlx=() 00:18:42.585 05:03:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:42.585 05:03:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:42.585 05:03:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:42.585 05:03:21 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:42.585 05:03:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:42.585 05:03:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:42.585 05:03:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:42.585 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:42.585 05:03:21 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:42.585 05:03:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:42.585 05:03:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:42.585 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:42.586 05:03:21 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:42.586 05:03:21 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:42.586 05:03:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.586 05:03:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:42.586 05:03:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.586 05:03:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:42.586 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:42.586 05:03:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.586 05:03:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:42.586 05:03:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.586 05:03:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:42.586 05:03:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.586 05:03:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:42.586 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:42.586 05:03:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.586 05:03:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:42.586 05:03:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:42.586 05:03:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:18:42.586 05:03:21 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:42.586 05:03:21 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:42.586 05:03:21 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:42.586 05:03:21 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:18:42.586 05:03:21 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:42.586 05:03:21 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:42.586 05:03:21 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:18:42.586 05:03:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:42.586 05:03:21 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:42.586 05:03:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:18:42.586 05:03:21 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:18:42.586 05:03:21 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:18:42.586 05:03:21 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:42.586 05:03:21 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:42.586 05:03:21 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:42.586 05:03:21 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:18:42.586 05:03:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:42.586 05:03:21 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:42.586 05:03:21 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:42.586 05:03:21 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:18:42.586 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:42.586 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.146 ms 00:18:42.586 00:18:42.586 --- 10.0.0.2 ping statistics --- 00:18:42.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.586 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:18:42.586 05:03:21 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:42.586 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:42.586 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:18:42.586 00:18:42.586 --- 10.0.0.1 ping statistics --- 00:18:42.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.586 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:18:42.586 05:03:21 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:42.586 05:03:21 -- nvmf/common.sh@411 -- # return 0 00:18:42.586 05:03:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:42.586 05:03:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:42.586 05:03:21 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:18:42.586 05:03:21 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:42.586 05:03:21 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:18:42.586 05:03:21 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:18:42.586 05:03:21 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:18:42.586 05:03:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:42.586 05:03:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:42.586 05:03:21 -- common/autotest_common.sh@10 -- # set +x 00:18:42.586 05:03:21 -- nvmf/common.sh@470 -- # nvmfpid=2403591 00:18:42.586 05:03:21 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:42.586 05:03:21 -- nvmf/common.sh@471 -- # waitforlisten 2403591 00:18:42.586 05:03:21 -- common/autotest_common.sh@817 -- # '[' -z 2403591 ']' 00:18:42.586 05:03:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:42.586 05:03:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:42.586 05:03:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:42.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:42.586 05:03:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:42.586 05:03:21 -- common/autotest_common.sh@10 -- # set +x 00:18:42.586 [2024-04-23 05:03:21.665183] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:18:42.586 [2024-04-23 05:03:21.665251] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:42.586 EAL: No free 2048 kB hugepages reported on node 1 00:18:42.586 [2024-04-23 05:03:21.702767] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:18:42.586 [2024-04-23 05:03:21.728956] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:42.845 [2024-04-23 05:03:21.820145] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:42.845 [2024-04-23 05:03:21.820216] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:42.845 [2024-04-23 05:03:21.820243] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:42.845 [2024-04-23 05:03:21.820257] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:42.845 [2024-04-23 05:03:21.820269] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:42.845 [2024-04-23 05:03:21.820372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:42.845 [2024-04-23 05:03:21.820460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:42.845 [2024-04-23 05:03:21.820543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:42.845 [2024-04-23 05:03:21.820547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:42.845 05:03:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:42.845 05:03:21 -- common/autotest_common.sh@850 -- # return 0 00:18:42.845 05:03:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:42.845 05:03:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:42.845 05:03:21 -- common/autotest_common.sh@10 -- # set +x 00:18:42.845 05:03:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:42.845 05:03:21 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:43.102 [2024-04-23 05:03:22.178913] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:43.102 05:03:22 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:43.360 05:03:22 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:18:43.360 05:03:22 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:43.618 05:03:22 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:18:43.618 05:03:22 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:43.876 05:03:23 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:18:43.876 05:03:23 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:44.133 05:03:23 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:18:44.133 05:03:23 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:18:44.390 05:03:23 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:44.648 05:03:23 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:18:44.648 05:03:23 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:44.904 05:03:24 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:18:44.904 05:03:24 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:45.162 05:03:24 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:18:45.162 05:03:24 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:18:45.420 05:03:24 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:45.678 05:03:24 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:18:45.678 05:03:24 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:45.936 05:03:25 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:18:45.936 05:03:25 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:46.194 05:03:25 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:46.452 [2024-04-23 05:03:25.504612] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:46.452 05:03:25 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:18:46.710 05:03:25 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:18:46.968 05:03:26 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:47.536 05:03:26 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:18:47.536 05:03:26 -- common/autotest_common.sh@1184 -- # local i=0 00:18:47.536 05:03:26 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:47.536 05:03:26 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:18:47.536 05:03:26 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:18:47.536 05:03:26 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:49.445 05:03:28 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:49.445 05:03:28 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:49.445 05:03:28 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:18:49.445 05:03:28 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:18:49.445 05:03:28 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:49.445 05:03:28 -- common/autotest_common.sh@1194 -- # return 0 00:18:49.445 05:03:28 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:49.445 [global] 00:18:49.445 thread=1 00:18:49.445 invalidate=1 00:18:49.445 rw=write 00:18:49.445 time_based=1 00:18:49.445 runtime=1 00:18:49.445 ioengine=libaio 00:18:49.445 direct=1 00:18:49.445 bs=4096 00:18:49.445 iodepth=1 00:18:49.445 norandommap=0 00:18:49.445 numjobs=1 00:18:49.445 00:18:49.445 verify_dump=1 00:18:49.445 verify_backlog=512 00:18:49.445 verify_state_save=0 00:18:49.445 do_verify=1 00:18:49.445 verify=crc32c-intel 00:18:49.445 [job0] 00:18:49.445 filename=/dev/nvme0n1 00:18:49.445 [job1] 00:18:49.445 filename=/dev/nvme0n2 00:18:49.445 [job2] 00:18:49.445 filename=/dev/nvme0n3 00:18:49.445 [job3] 00:18:49.445 filename=/dev/nvme0n4 00:18:49.704 Could not set queue depth (nvme0n1) 00:18:49.704 Could not set queue depth (nvme0n2) 00:18:49.704 Could not set queue depth (nvme0n3) 00:18:49.704 Could not set queue depth (nvme0n4) 00:18:49.704 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:49.704 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:49.704 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:49.704 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:49.704 fio-3.35 00:18:49.704 Starting 4 threads 00:18:51.078 00:18:51.078 job0: (groupid=0, jobs=1): err= 0: pid=2404655: Tue Apr 23 05:03:30 2024 00:18:51.078 read: IOPS=20, BW=80.9KiB/s (82.9kB/s)(84.0KiB/1038msec) 00:18:51.078 slat (nsec): min=9028, max=35849, avg=16912.71, stdev=8028.16 00:18:51.078 clat (usec): min=40824, max=41094, avg=40970.18, stdev=59.78 00:18:51.078 lat (usec): min=40833, max=41109, avg=40987.09, stdev=57.61 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:18:51.078 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:18:51.078 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:18:51.078 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:18:51.078 | 99.99th=[41157] 00:18:51.078 write: IOPS=493, BW=1973KiB/s (2020kB/s)(2048KiB/1038msec); 0 zone resets 00:18:51.078 slat (nsec): min=8080, max=56348, avg=17918.91, stdev=8057.42 00:18:51.078 clat (usec): min=157, max=719, avg=323.36, stdev=128.05 00:18:51.078 lat (usec): min=166, max=736, avg=341.28, stdev=128.07 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[ 178], 5.00th=[ 192], 10.00th=[ 202], 20.00th=[ 215], 00:18:51.078 | 30.00th=[ 229], 40.00th=[ 241], 50.00th=[ 265], 60.00th=[ 318], 00:18:51.078 | 70.00th=[ 396], 80.00th=[ 449], 90.00th=[ 523], 95.00th=[ 578], 00:18:51.078 | 99.00th=[ 660], 99.50th=[ 701], 99.90th=[ 717], 99.95th=[ 717], 00:18:51.078 | 99.99th=[ 717] 00:18:51.078 bw ( KiB/s): min= 4096, max= 4096, per=29.66%, avg=4096.00, stdev= 0.00, samples=1 00:18:51.078 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:51.078 lat (usec) : 250=42.78%, 500=41.09%, 750=12.20% 00:18:51.078 lat (msec) : 50=3.94% 00:18:51.078 cpu : usr=0.58%, sys=0.96%, ctx=534, majf=0, minf=1 00:18:51.078 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:51.078 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:51.078 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:51.078 job1: (groupid=0, jobs=1): err= 0: pid=2404656: Tue Apr 23 05:03:30 2024 00:18:51.078 read: IOPS=165, BW=661KiB/s (677kB/s)(680KiB/1028msec) 00:18:51.078 slat (nsec): min=6568, max=33645, avg=10074.76, stdev=4696.01 00:18:51.078 clat (usec): min=284, max=41514, avg=5003.91, stdev=12856.84 00:18:51.078 lat (usec): min=295, max=41522, avg=5013.98, stdev=12859.01 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[ 293], 5.00th=[ 326], 10.00th=[ 334], 20.00th=[ 338], 00:18:51.078 | 30.00th=[ 343], 40.00th=[ 347], 50.00th=[ 359], 60.00th=[ 383], 00:18:51.078 | 70.00th=[ 412], 80.00th=[ 461], 90.00th=[40633], 95.00th=[41157], 00:18:51.078 | 99.00th=[41157], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:18:51.078 | 99.99th=[41681] 00:18:51.078 write: IOPS=498, BW=1992KiB/s (2040kB/s)(2048KiB/1028msec); 0 zone resets 00:18:51.078 slat (nsec): min=6373, max=40061, avg=14505.70, stdev=5461.83 00:18:51.078 clat (usec): min=163, max=814, avg=323.16, stdev=130.25 00:18:51.078 lat (usec): min=179, max=830, avg=337.66, stdev=130.74 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[ 169], 5.00th=[ 194], 10.00th=[ 202], 20.00th=[ 217], 00:18:51.078 | 30.00th=[ 227], 40.00th=[ 239], 50.00th=[ 253], 60.00th=[ 318], 00:18:51.078 | 70.00th=[ 388], 80.00th=[ 441], 90.00th=[ 529], 95.00th=[ 578], 00:18:51.078 | 99.00th=[ 668], 99.50th=[ 676], 99.90th=[ 816], 99.95th=[ 816], 00:18:51.078 | 99.99th=[ 816] 00:18:51.078 bw ( KiB/s): min= 4096, max= 4096, per=29.66%, avg=4096.00, stdev= 0.00, samples=1 00:18:51.078 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:51.078 lat (usec) : 250=35.78%, 500=51.03%, 750=10.12%, 1000=0.15% 00:18:51.078 lat (msec) : 20=0.15%, 50=2.79% 00:18:51.078 cpu : usr=0.58%, sys=0.78%, ctx=683, majf=0, minf=1 00:18:51.078 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:51.078 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 issued rwts: total=170,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:51.078 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:51.078 job2: (groupid=0, jobs=1): err= 0: pid=2404657: Tue Apr 23 05:03:30 2024 00:18:51.078 read: IOPS=1522, BW=6089KiB/s (6235kB/s)(6156KiB/1011msec) 00:18:51.078 slat (nsec): min=5861, max=46204, avg=9746.77, stdev=5279.91 00:18:51.078 clat (usec): min=232, max=41027, avg=351.98, stdev=1796.85 00:18:51.078 lat (usec): min=238, max=41035, avg=361.73, stdev=1797.30 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[ 239], 5.00th=[ 243], 10.00th=[ 247], 20.00th=[ 251], 00:18:51.078 | 30.00th=[ 255], 40.00th=[ 260], 50.00th=[ 265], 60.00th=[ 269], 00:18:51.078 | 70.00th=[ 281], 80.00th=[ 289], 90.00th=[ 306], 95.00th=[ 338], 00:18:51.078 | 99.00th=[ 416], 99.50th=[ 529], 99.90th=[41157], 99.95th=[41157], 00:18:51.078 | 99.99th=[41157] 00:18:51.078 write: IOPS=2025, BW=8103KiB/s (8297kB/s)(8192KiB/1011msec); 0 zone resets 00:18:51.078 slat (usec): min=6, max=30998, avg=24.99, stdev=684.78 00:18:51.078 clat (usec): min=155, max=3348, avg=191.85, stdev=75.59 00:18:51.078 lat (usec): min=162, max=31239, avg=216.84, stdev=690.11 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[ 161], 5.00th=[ 163], 10.00th=[ 167], 20.00th=[ 169], 00:18:51.078 | 30.00th=[ 174], 40.00th=[ 176], 50.00th=[ 180], 60.00th=[ 186], 00:18:51.078 | 70.00th=[ 196], 80.00th=[ 210], 90.00th=[ 237], 95.00th=[ 245], 00:18:51.078 | 99.00th=[ 262], 99.50th=[ 281], 99.90th=[ 537], 99.95th=[ 611], 00:18:51.078 | 99.99th=[ 3359] 00:18:51.078 bw ( KiB/s): min= 8192, max= 8192, per=59.31%, avg=8192.00, stdev= 0.00, samples=2 00:18:51.078 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=2 00:18:51.078 lat (usec) : 250=62.87%, 500=36.83%, 750=0.20% 00:18:51.078 lat (msec) : 4=0.03%, 50=0.08% 00:18:51.078 cpu : usr=2.97%, sys=3.76%, ctx=3592, majf=0, minf=2 00:18:51.078 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:51.078 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 issued rwts: total=1539,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:51.078 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:51.078 job3: (groupid=0, jobs=1): err= 0: pid=2404658: Tue Apr 23 05:03:30 2024 00:18:51.078 read: IOPS=69, BW=280KiB/s (287kB/s)(288KiB/1029msec) 00:18:51.078 slat (nsec): min=6667, max=35961, avg=11526.14, stdev=6020.91 00:18:51.078 clat (usec): min=338, max=42302, avg=12255.93, stdev=18577.05 00:18:51.078 lat (usec): min=352, max=42324, avg=12267.45, stdev=18580.18 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[ 338], 5.00th=[ 359], 10.00th=[ 371], 20.00th=[ 400], 00:18:51.078 | 30.00th=[ 408], 40.00th=[ 416], 50.00th=[ 441], 60.00th=[ 465], 00:18:51.078 | 70.00th=[ 553], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:18:51.078 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:51.078 | 99.99th=[42206] 00:18:51.078 write: IOPS=497, BW=1990KiB/s (2038kB/s)(2048KiB/1029msec); 0 zone resets 00:18:51.078 slat (usec): min=6, max=18416, avg=48.74, stdev=813.39 00:18:51.078 clat (usec): min=167, max=688, avg=231.74, stdev=42.70 00:18:51.078 lat (usec): min=176, max=18688, avg=280.49, stdev=816.42 00:18:51.078 clat percentiles (usec): 00:18:51.078 | 1.00th=[ 180], 5.00th=[ 186], 10.00th=[ 194], 20.00th=[ 202], 00:18:51.078 | 30.00th=[ 212], 40.00th=[ 221], 50.00th=[ 225], 60.00th=[ 231], 00:18:51.078 | 70.00th=[ 239], 80.00th=[ 249], 90.00th=[ 273], 95.00th=[ 297], 00:18:51.078 | 99.00th=[ 408], 99.50th=[ 416], 99.90th=[ 685], 99.95th=[ 685], 00:18:51.078 | 99.99th=[ 685] 00:18:51.078 bw ( KiB/s): min= 4096, max= 4096, per=29.66%, avg=4096.00, stdev= 0.00, samples=1 00:18:51.078 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:51.078 lat (usec) : 250=70.38%, 500=25.68%, 750=0.34% 00:18:51.078 lat (msec) : 50=3.60% 00:18:51.078 cpu : usr=0.00%, sys=0.97%, ctx=586, majf=0, minf=1 00:18:51.078 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:51.078 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.078 issued rwts: total=72,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:51.078 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:51.078 00:18:51.078 Run status group 0 (all jobs): 00:18:51.078 READ: bw=6944KiB/s (7111kB/s), 80.9KiB/s-6089KiB/s (82.9kB/s-6235kB/s), io=7208KiB (7381kB), run=1011-1038msec 00:18:51.078 WRITE: bw=13.5MiB/s (14.1MB/s), 1973KiB/s-8103KiB/s (2020kB/s-8297kB/s), io=14.0MiB (14.7MB), run=1011-1038msec 00:18:51.078 00:18:51.078 Disk stats (read/write): 00:18:51.078 nvme0n1: ios=65/512, merge=0/0, ticks=1499/163, in_queue=1662, util=85.67% 00:18:51.078 nvme0n2: ios=185/512, merge=0/0, ticks=1518/162, in_queue=1680, util=89.73% 00:18:51.078 nvme0n3: ios=1594/1865, merge=0/0, ticks=718/358, in_queue=1076, util=94.68% 00:18:51.078 nvme0n4: ios=88/512, merge=0/0, ticks=940/114, in_queue=1054, util=95.58% 00:18:51.078 05:03:30 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:18:51.078 [global] 00:18:51.078 thread=1 00:18:51.078 invalidate=1 00:18:51.078 rw=randwrite 00:18:51.078 time_based=1 00:18:51.078 runtime=1 00:18:51.078 ioengine=libaio 00:18:51.078 direct=1 00:18:51.078 bs=4096 00:18:51.078 iodepth=1 00:18:51.078 norandommap=0 00:18:51.078 numjobs=1 00:18:51.078 00:18:51.078 verify_dump=1 00:18:51.079 verify_backlog=512 00:18:51.079 verify_state_save=0 00:18:51.079 do_verify=1 00:18:51.079 verify=crc32c-intel 00:18:51.079 [job0] 00:18:51.079 filename=/dev/nvme0n1 00:18:51.079 [job1] 00:18:51.079 filename=/dev/nvme0n2 00:18:51.079 [job2] 00:18:51.079 filename=/dev/nvme0n3 00:18:51.079 [job3] 00:18:51.079 filename=/dev/nvme0n4 00:18:51.079 Could not set queue depth (nvme0n1) 00:18:51.079 Could not set queue depth (nvme0n2) 00:18:51.079 Could not set queue depth (nvme0n3) 00:18:51.079 Could not set queue depth (nvme0n4) 00:18:51.337 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:51.337 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:51.337 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:51.337 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:51.337 fio-3.35 00:18:51.337 Starting 4 threads 00:18:52.716 00:18:52.716 job0: (groupid=0, jobs=1): err= 0: pid=2404890: Tue Apr 23 05:03:31 2024 00:18:52.716 read: IOPS=25, BW=102KiB/s (105kB/s)(104KiB/1019msec) 00:18:52.716 slat (nsec): min=6942, max=44466, avg=18286.27, stdev=10051.05 00:18:52.716 clat (usec): min=331, max=42400, avg=33644.61, stdev=16509.31 00:18:52.716 lat (usec): min=344, max=42420, avg=33662.90, stdev=16508.70 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 330], 5.00th=[ 334], 10.00th=[ 445], 20.00th=[40633], 00:18:52.716 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:18:52.716 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:18:52.716 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:52.716 | 99.99th=[42206] 00:18:52.716 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:18:52.716 slat (nsec): min=8167, max=53429, avg=18464.99, stdev=8132.85 00:18:52.716 clat (usec): min=176, max=613, avg=257.02, stdev=73.60 00:18:52.716 lat (usec): min=187, max=644, avg=275.48, stdev=74.98 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 182], 5.00th=[ 196], 10.00th=[ 204], 20.00th=[ 212], 00:18:52.716 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 239], 00:18:52.716 | 70.00th=[ 249], 80.00th=[ 281], 90.00th=[ 379], 95.00th=[ 429], 00:18:52.716 | 99.00th=[ 502], 99.50th=[ 529], 99.90th=[ 611], 99.95th=[ 611], 00:18:52.716 | 99.99th=[ 611] 00:18:52.716 bw ( KiB/s): min= 4096, max= 4096, per=26.00%, avg=4096.00, stdev= 0.00, samples=1 00:18:52.716 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:52.716 lat (usec) : 250=67.84%, 500=26.95%, 750=1.12%, 1000=0.19% 00:18:52.716 lat (msec) : 50=3.90% 00:18:52.716 cpu : usr=0.98%, sys=0.88%, ctx=538, majf=0, minf=1 00:18:52.716 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:52.716 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 issued rwts: total=26,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:52.716 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:52.716 job1: (groupid=0, jobs=1): err= 0: pid=2404891: Tue Apr 23 05:03:31 2024 00:18:52.716 read: IOPS=660, BW=2643KiB/s (2706kB/s)(2664KiB/1008msec) 00:18:52.716 slat (nsec): min=5398, max=46700, avg=10136.98, stdev=6452.59 00:18:52.716 clat (usec): min=227, max=42141, avg=1009.37, stdev=5238.52 00:18:52.716 lat (usec): min=233, max=42188, avg=1019.51, stdev=5239.76 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 233], 5.00th=[ 237], 10.00th=[ 241], 20.00th=[ 247], 00:18:52.716 | 30.00th=[ 258], 40.00th=[ 273], 50.00th=[ 326], 60.00th=[ 359], 00:18:52.716 | 70.00th=[ 392], 80.00th=[ 416], 90.00th=[ 449], 95.00th=[ 502], 00:18:52.716 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:18:52.716 | 99.99th=[42206] 00:18:52.716 write: IOPS=1015, BW=4063KiB/s (4161kB/s)(4096KiB/1008msec); 0 zone resets 00:18:52.716 slat (nsec): min=7407, max=77532, avg=16806.46, stdev=10858.61 00:18:52.716 clat (usec): min=188, max=622, avg=298.00, stdev=66.51 00:18:52.716 lat (usec): min=198, max=662, avg=314.81, stdev=71.04 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 206], 5.00th=[ 229], 10.00th=[ 241], 20.00th=[ 253], 00:18:52.716 | 30.00th=[ 260], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 285], 00:18:52.716 | 70.00th=[ 310], 80.00th=[ 351], 90.00th=[ 392], 95.00th=[ 433], 00:18:52.716 | 99.00th=[ 523], 99.50th=[ 553], 99.90th=[ 570], 99.95th=[ 619], 00:18:52.716 | 99.99th=[ 619] 00:18:52.716 bw ( KiB/s): min= 4096, max= 4096, per=26.00%, avg=4096.00, stdev= 0.00, samples=2 00:18:52.716 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:18:52.716 lat (usec) : 250=19.53%, 500=77.57%, 750=2.25% 00:18:52.716 lat (msec) : 50=0.65% 00:18:52.716 cpu : usr=1.69%, sys=3.18%, ctx=1691, majf=0, minf=1 00:18:52.716 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:52.716 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 issued rwts: total=666,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:52.716 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:52.716 job2: (groupid=0, jobs=1): err= 0: pid=2404892: Tue Apr 23 05:03:31 2024 00:18:52.716 read: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec) 00:18:52.716 slat (nsec): min=4785, max=41728, avg=10266.35, stdev=6902.96 00:18:52.716 clat (usec): min=224, max=40978, avg=643.93, stdev=3788.32 00:18:52.716 lat (usec): min=229, max=40996, avg=654.20, stdev=3788.69 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 229], 5.00th=[ 235], 10.00th=[ 239], 20.00th=[ 247], 00:18:52.716 | 30.00th=[ 253], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 281], 00:18:52.716 | 70.00th=[ 293], 80.00th=[ 310], 90.00th=[ 334], 95.00th=[ 449], 00:18:52.716 | 99.00th=[ 717], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:18:52.716 | 99.99th=[41157] 00:18:52.716 write: IOPS=1293, BW=5175KiB/s (5299kB/s)(5180KiB/1001msec); 0 zone resets 00:18:52.716 slat (nsec): min=6417, max=57774, avg=17105.29, stdev=9059.73 00:18:52.716 clat (usec): min=156, max=882, avg=231.15, stdev=64.70 00:18:52.716 lat (usec): min=164, max=922, avg=248.26, stdev=68.42 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 163], 5.00th=[ 174], 10.00th=[ 180], 20.00th=[ 188], 00:18:52.716 | 30.00th=[ 196], 40.00th=[ 206], 50.00th=[ 215], 60.00th=[ 225], 00:18:52.716 | 70.00th=[ 239], 80.00th=[ 262], 90.00th=[ 310], 95.00th=[ 355], 00:18:52.716 | 99.00th=[ 429], 99.50th=[ 529], 99.90th=[ 766], 99.95th=[ 881], 00:18:52.716 | 99.99th=[ 881] 00:18:52.716 bw ( KiB/s): min= 8192, max= 8192, per=51.99%, avg=8192.00, stdev= 0.00, samples=1 00:18:52.716 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:18:52.716 lat (usec) : 250=52.74%, 500=45.15%, 750=1.60%, 1000=0.13% 00:18:52.716 lat (msec) : 50=0.39% 00:18:52.716 cpu : usr=1.80%, sys=4.30%, ctx=2320, majf=0, minf=1 00:18:52.716 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:52.716 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 issued rwts: total=1024,1295,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:52.716 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:52.716 job3: (groupid=0, jobs=1): err= 0: pid=2404893: Tue Apr 23 05:03:31 2024 00:18:52.716 read: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec) 00:18:52.716 slat (nsec): min=5111, max=61546, avg=17956.28, stdev=9168.73 00:18:52.716 clat (usec): min=279, max=44020, avg=652.34, stdev=2867.22 00:18:52.716 lat (usec): min=287, max=44036, avg=670.30, stdev=2866.98 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 306], 5.00th=[ 351], 10.00th=[ 367], 20.00th=[ 388], 00:18:52.716 | 30.00th=[ 408], 40.00th=[ 429], 50.00th=[ 457], 60.00th=[ 474], 00:18:52.716 | 70.00th=[ 486], 80.00th=[ 502], 90.00th=[ 537], 95.00th=[ 570], 00:18:52.716 | 99.00th=[ 685], 99.50th=[ 865], 99.90th=[41157], 99.95th=[43779], 00:18:52.716 | 99.99th=[43779] 00:18:52.716 write: IOPS=1181, BW=4727KiB/s (4841kB/s)(4732KiB/1001msec); 0 zone resets 00:18:52.716 slat (nsec): min=6687, max=66686, avg=14813.40, stdev=7869.46 00:18:52.716 clat (usec): min=160, max=2249, avg=241.96, stdev=73.91 00:18:52.716 lat (usec): min=167, max=2263, avg=256.77, stdev=74.57 00:18:52.716 clat percentiles (usec): 00:18:52.716 | 1.00th=[ 163], 5.00th=[ 174], 10.00th=[ 198], 20.00th=[ 217], 00:18:52.716 | 30.00th=[ 223], 40.00th=[ 229], 50.00th=[ 233], 60.00th=[ 241], 00:18:52.716 | 70.00th=[ 249], 80.00th=[ 262], 90.00th=[ 281], 95.00th=[ 326], 00:18:52.716 | 99.00th=[ 396], 99.50th=[ 449], 99.90th=[ 502], 99.95th=[ 2245], 00:18:52.716 | 99.99th=[ 2245] 00:18:52.716 bw ( KiB/s): min= 4096, max= 4096, per=26.00%, avg=4096.00, stdev= 0.00, samples=1 00:18:52.716 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:52.716 lat (usec) : 250=37.88%, 500=52.02%, 750=9.65%, 1000=0.18% 00:18:52.716 lat (msec) : 4=0.05%, 50=0.23% 00:18:52.716 cpu : usr=2.30%, sys=3.70%, ctx=2209, majf=0, minf=2 00:18:52.716 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:52.716 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:52.716 issued rwts: total=1024,1183,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:52.716 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:52.716 00:18:52.716 Run status group 0 (all jobs): 00:18:52.716 READ: bw=10.5MiB/s (11.0MB/s), 102KiB/s-4092KiB/s (105kB/s-4190kB/s), io=10.7MiB (11.2MB), run=1001-1019msec 00:18:52.716 WRITE: bw=15.4MiB/s (16.1MB/s), 2010KiB/s-5175KiB/s (2058kB/s-5299kB/s), io=15.7MiB (16.4MB), run=1001-1019msec 00:18:52.716 00:18:52.716 Disk stats (read/write): 00:18:52.716 nvme0n1: ios=70/512, merge=0/0, ticks=692/129, in_queue=821, util=86.87% 00:18:52.716 nvme0n2: ios=586/1024, merge=0/0, ticks=1491/298, in_queue=1789, util=99.90% 00:18:52.716 nvme0n3: ios=964/1024, merge=0/0, ticks=1513/222, in_queue=1735, util=98.75% 00:18:52.716 nvme0n4: ios=837/1024, merge=0/0, ticks=703/242, in_queue=945, util=98.21% 00:18:52.716 05:03:31 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:18:52.716 [global] 00:18:52.716 thread=1 00:18:52.716 invalidate=1 00:18:52.717 rw=write 00:18:52.717 time_based=1 00:18:52.717 runtime=1 00:18:52.717 ioengine=libaio 00:18:52.717 direct=1 00:18:52.717 bs=4096 00:18:52.717 iodepth=128 00:18:52.717 norandommap=0 00:18:52.717 numjobs=1 00:18:52.717 00:18:52.717 verify_dump=1 00:18:52.717 verify_backlog=512 00:18:52.717 verify_state_save=0 00:18:52.717 do_verify=1 00:18:52.717 verify=crc32c-intel 00:18:52.717 [job0] 00:18:52.717 filename=/dev/nvme0n1 00:18:52.717 [job1] 00:18:52.717 filename=/dev/nvme0n2 00:18:52.717 [job2] 00:18:52.717 filename=/dev/nvme0n3 00:18:52.717 [job3] 00:18:52.717 filename=/dev/nvme0n4 00:18:52.717 Could not set queue depth (nvme0n1) 00:18:52.717 Could not set queue depth (nvme0n2) 00:18:52.717 Could not set queue depth (nvme0n3) 00:18:52.717 Could not set queue depth (nvme0n4) 00:18:52.717 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:52.717 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:52.717 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:52.717 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:52.717 fio-3.35 00:18:52.717 Starting 4 threads 00:18:54.094 00:18:54.094 job0: (groupid=0, jobs=1): err= 0: pid=2405117: Tue Apr 23 05:03:32 2024 00:18:54.094 read: IOPS=2037, BW=8151KiB/s (8347kB/s)(8192KiB/1005msec) 00:18:54.094 slat (usec): min=2, max=27746, avg=282.88, stdev=1609.84 00:18:54.094 clat (msec): min=15, max=119, avg=36.46, stdev=20.54 00:18:54.094 lat (msec): min=19, max=119, avg=36.74, stdev=20.62 00:18:54.094 clat percentiles (msec): 00:18:54.094 | 1.00th=[ 20], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 25], 00:18:54.094 | 30.00th=[ 26], 40.00th=[ 27], 50.00th=[ 28], 60.00th=[ 30], 00:18:54.094 | 70.00th=[ 37], 80.00th=[ 43], 90.00th=[ 67], 95.00th=[ 87], 00:18:54.094 | 99.00th=[ 113], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], 00:18:54.094 | 99.99th=[ 121] 00:18:54.094 write: IOPS=2508, BW=9.80MiB/s (10.3MB/s)(9.85MiB/1005msec); 0 zone resets 00:18:54.095 slat (usec): min=5, max=14401, avg=159.60, stdev=903.49 00:18:54.095 clat (usec): min=2644, max=43384, avg=20625.38, stdev=6196.80 00:18:54.095 lat (usec): min=6523, max=43406, avg=20784.98, stdev=6172.62 00:18:54.095 clat percentiles (usec): 00:18:54.095 | 1.00th=[ 7111], 5.00th=[12518], 10.00th=[13829], 20.00th=[16581], 00:18:54.095 | 30.00th=[17695], 40.00th=[18220], 50.00th=[19268], 60.00th=[20841], 00:18:54.095 | 70.00th=[22414], 80.00th=[25035], 90.00th=[27132], 95.00th=[31327], 00:18:54.095 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:18:54.095 | 99.99th=[43254] 00:18:54.095 bw ( KiB/s): min= 7104, max=12040, per=16.85%, avg=9572.00, stdev=3490.28, samples=2 00:18:54.095 iops : min= 1776, max= 3010, avg=2393.00, stdev=872.57, samples=2 00:18:54.095 lat (msec) : 4=0.02%, 10=0.74%, 20=32.24%, 50=59.84%, 100=6.17% 00:18:54.095 lat (msec) : 250=0.98% 00:18:54.095 cpu : usr=2.59%, sys=3.88%, ctx=175, majf=0, minf=1 00:18:54.095 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:18:54.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:54.095 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:54.095 issued rwts: total=2048,2521,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:54.095 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:54.095 job1: (groupid=0, jobs=1): err= 0: pid=2405118: Tue Apr 23 05:03:32 2024 00:18:54.095 read: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec) 00:18:54.095 slat (usec): min=2, max=29699, avg=175.15, stdev=1189.91 00:18:54.095 clat (msec): min=3, max=111, avg=23.46, stdev=19.97 00:18:54.095 lat (msec): min=5, max=111, avg=23.63, stdev=20.08 00:18:54.095 clat percentiles (msec): 00:18:54.095 | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 12], 00:18:54.095 | 30.00th=[ 13], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 20], 00:18:54.095 | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 45], 95.00th=[ 70], 00:18:54.095 | 99.00th=[ 105], 99.50th=[ 112], 99.90th=[ 112], 99.95th=[ 112], 00:18:54.095 | 99.99th=[ 112] 00:18:54.095 write: IOPS=3125, BW=12.2MiB/s (12.8MB/s)(12.3MiB/1006msec); 0 zone resets 00:18:54.095 slat (usec): min=4, max=15785, avg=137.56, stdev=659.92 00:18:54.095 clat (usec): min=1642, max=80612, avg=17457.51, stdev=12152.21 00:18:54.095 lat (usec): min=1650, max=80624, avg=17595.08, stdev=12254.07 00:18:54.095 clat percentiles (usec): 00:18:54.095 | 1.00th=[ 3687], 5.00th=[ 8029], 10.00th=[ 9372], 20.00th=[10945], 00:18:54.095 | 30.00th=[11863], 40.00th=[12125], 50.00th=[12518], 60.00th=[13960], 00:18:54.095 | 70.00th=[15139], 80.00th=[21890], 90.00th=[35390], 95.00th=[44303], 00:18:54.095 | 99.00th=[62129], 99.50th=[72877], 99.90th=[80217], 99.95th=[80217], 00:18:54.095 | 99.99th=[80217] 00:18:54.095 bw ( KiB/s): min= 4096, max=20480, per=21.64%, avg=12288.00, stdev=11585.24, samples=2 00:18:54.095 iops : min= 1024, max= 5120, avg=3072.00, stdev=2896.31, samples=2 00:18:54.095 lat (msec) : 2=0.10%, 4=0.50%, 10=8.61%, 20=60.17%, 50=24.86% 00:18:54.095 lat (msec) : 100=5.20%, 250=0.58% 00:18:54.095 cpu : usr=2.59%, sys=4.48%, ctx=377, majf=0, minf=1 00:18:54.095 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:18:54.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:54.095 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:54.095 issued rwts: total=3072,3144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:54.095 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:54.095 job2: (groupid=0, jobs=1): err= 0: pid=2405119: Tue Apr 23 05:03:32 2024 00:18:54.095 read: IOPS=3586, BW=14.0MiB/s (14.7MB/s)(14.2MiB/1012msec) 00:18:54.095 slat (usec): min=3, max=12750, avg=114.19, stdev=853.69 00:18:54.095 clat (usec): min=1246, max=39308, avg=14227.61, stdev=5241.48 00:18:54.095 lat (usec): min=1262, max=39313, avg=14341.80, stdev=5306.47 00:18:54.095 clat percentiles (usec): 00:18:54.095 | 1.00th=[ 2147], 5.00th=[ 3851], 10.00th=[11207], 20.00th=[12125], 00:18:54.095 | 30.00th=[12518], 40.00th=[12780], 50.00th=[13173], 60.00th=[13304], 00:18:54.095 | 70.00th=[15401], 80.00th=[17695], 90.00th=[21103], 95.00th=[24511], 00:18:54.095 | 99.00th=[32375], 99.50th=[35390], 99.90th=[39060], 99.95th=[39060], 00:18:54.095 | 99.99th=[39060] 00:18:54.095 write: IOPS=4047, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1012msec); 0 zone resets 00:18:54.095 slat (usec): min=4, max=10829, avg=122.76, stdev=705.49 00:18:54.095 clat (usec): min=384, max=99729, avg=18558.35, stdev=15957.47 00:18:54.095 lat (usec): min=824, max=99738, avg=18681.12, stdev=16032.06 00:18:54.095 clat percentiles (usec): 00:18:54.095 | 1.00th=[ 1057], 5.00th=[ 2802], 10.00th=[ 6063], 20.00th=[ 7570], 00:18:54.095 | 30.00th=[ 9110], 40.00th=[ 10814], 50.00th=[ 12911], 60.00th=[ 16319], 00:18:54.095 | 70.00th=[ 20055], 80.00th=[ 29492], 90.00th=[ 36963], 95.00th=[ 42730], 00:18:54.095 | 99.00th=[ 92799], 99.50th=[ 98042], 99.90th=[100140], 99.95th=[100140], 00:18:54.095 | 99.99th=[100140] 00:18:54.095 bw ( KiB/s): min=13856, max=18256, per=28.27%, avg=16056.00, stdev=3111.27, samples=2 00:18:54.095 iops : min= 3464, max= 4564, avg=4014.00, stdev=777.82, samples=2 00:18:54.095 lat (usec) : 500=0.01%, 1000=0.26% 00:18:54.095 lat (msec) : 2=1.81%, 4=3.92%, 10=15.98%, 20=55.76%, 50=20.72% 00:18:54.095 lat (msec) : 100=1.53% 00:18:54.095 cpu : usr=4.15%, sys=4.45%, ctx=340, majf=0, minf=1 00:18:54.095 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:18:54.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:54.095 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:54.095 issued rwts: total=3630,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:54.095 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:54.095 job3: (groupid=0, jobs=1): err= 0: pid=2405120: Tue Apr 23 05:03:32 2024 00:18:54.095 read: IOPS=3843, BW=15.0MiB/s (15.7MB/s)(15.1MiB/1004msec) 00:18:54.095 slat (usec): min=2, max=22149, avg=118.26, stdev=930.14 00:18:54.095 clat (usec): min=1320, max=55937, avg=16437.84, stdev=8668.55 00:18:54.095 lat (usec): min=1347, max=55941, avg=16556.11, stdev=8735.66 00:18:54.095 clat percentiles (usec): 00:18:54.095 | 1.00th=[ 2835], 5.00th=[ 6521], 10.00th=[ 8291], 20.00th=[10945], 00:18:54.095 | 30.00th=[11731], 40.00th=[12256], 50.00th=[13304], 60.00th=[15664], 00:18:54.095 | 70.00th=[18744], 80.00th=[20841], 90.00th=[28967], 95.00th=[35914], 00:18:54.095 | 99.00th=[47973], 99.50th=[47973], 99.90th=[55837], 99.95th=[55837], 00:18:54.095 | 99.99th=[55837] 00:18:54.095 write: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec); 0 zone resets 00:18:54.095 slat (usec): min=3, max=11151, avg=88.25, stdev=593.15 00:18:54.095 clat (usec): min=232, max=95695, avg=13885.62, stdev=12660.54 00:18:54.095 lat (usec): min=255, max=97705, avg=13973.87, stdev=12693.95 00:18:54.095 clat percentiles (usec): 00:18:54.095 | 1.00th=[ 1029], 5.00th=[ 1860], 10.00th=[ 2835], 20.00th=[ 6456], 00:18:54.095 | 30.00th=[ 9372], 40.00th=[11338], 50.00th=[12125], 60.00th=[12780], 00:18:54.095 | 70.00th=[14353], 80.00th=[16909], 90.00th=[24773], 95.00th=[27919], 00:18:54.095 | 99.00th=[86508], 99.50th=[92799], 99.90th=[95945], 99.95th=[95945], 00:18:54.095 | 99.99th=[95945] 00:18:54.095 bw ( KiB/s): min=13144, max=23720, per=32.45%, avg=18432.00, stdev=7478.36, samples=2 00:18:54.095 iops : min= 3286, max= 5930, avg=4608.00, stdev=1869.59, samples=2 00:18:54.095 lat (usec) : 250=0.01%, 500=0.04%, 750=0.09%, 1000=0.25% 00:18:54.095 lat (msec) : 2=3.19%, 4=4.58%, 10=17.30%, 20=54.40%, 50=18.76% 00:18:54.095 lat (msec) : 100=1.38% 00:18:54.095 cpu : usr=3.39%, sys=5.28%, ctx=393, majf=0, minf=1 00:18:54.095 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:18:54.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:54.095 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:54.095 issued rwts: total=3859,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:54.095 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:54.095 00:18:54.095 Run status group 0 (all jobs): 00:18:54.095 READ: bw=48.7MiB/s (51.0MB/s), 8151KiB/s-15.0MiB/s (8347kB/s-15.7MB/s), io=49.3MiB (51.6MB), run=1004-1012msec 00:18:54.095 WRITE: bw=55.5MiB/s (58.2MB/s), 9.80MiB/s-17.9MiB/s (10.3MB/s-18.8MB/s), io=56.1MiB (58.9MB), run=1004-1012msec 00:18:54.095 00:18:54.095 Disk stats (read/write): 00:18:54.095 nvme0n1: ios=1828/2048, merge=0/0, ticks=15754/10438, in_queue=26192, util=86.57% 00:18:54.095 nvme0n2: ios=2628/3072, merge=0/0, ticks=21061/21778, in_queue=42839, util=86.69% 00:18:54.095 nvme0n3: ios=3218/3584, merge=0/0, ticks=45599/54850, in_queue=100449, util=96.45% 00:18:54.095 nvme0n4: ios=3129/3751, merge=0/0, ticks=34418/36591, in_queue=71009, util=97.90% 00:18:54.095 05:03:32 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:18:54.095 [global] 00:18:54.095 thread=1 00:18:54.095 invalidate=1 00:18:54.095 rw=randwrite 00:18:54.095 time_based=1 00:18:54.095 runtime=1 00:18:54.095 ioengine=libaio 00:18:54.095 direct=1 00:18:54.095 bs=4096 00:18:54.095 iodepth=128 00:18:54.095 norandommap=0 00:18:54.095 numjobs=1 00:18:54.095 00:18:54.095 verify_dump=1 00:18:54.095 verify_backlog=512 00:18:54.095 verify_state_save=0 00:18:54.095 do_verify=1 00:18:54.095 verify=crc32c-intel 00:18:54.095 [job0] 00:18:54.095 filename=/dev/nvme0n1 00:18:54.095 [job1] 00:18:54.095 filename=/dev/nvme0n2 00:18:54.095 [job2] 00:18:54.095 filename=/dev/nvme0n3 00:18:54.095 [job3] 00:18:54.095 filename=/dev/nvme0n4 00:18:54.095 Could not set queue depth (nvme0n1) 00:18:54.095 Could not set queue depth (nvme0n2) 00:18:54.095 Could not set queue depth (nvme0n3) 00:18:54.095 Could not set queue depth (nvme0n4) 00:18:54.095 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:54.095 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:54.095 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:54.095 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:54.095 fio-3.35 00:18:54.095 Starting 4 threads 00:18:55.480 00:18:55.480 job0: (groupid=0, jobs=1): err= 0: pid=2405472: Tue Apr 23 05:03:34 2024 00:18:55.480 read: IOPS=5062, BW=19.8MiB/s (20.7MB/s)(19.9MiB/1006msec) 00:18:55.480 slat (usec): min=3, max=13649, avg=99.61, stdev=712.02 00:18:55.480 clat (usec): min=1791, max=36025, avg=13168.19, stdev=4315.27 00:18:55.480 lat (usec): min=4774, max=36067, avg=13267.80, stdev=4362.14 00:18:55.480 clat percentiles (usec): 00:18:55.480 | 1.00th=[ 5407], 5.00th=[ 9241], 10.00th=[ 9765], 20.00th=[10290], 00:18:55.480 | 30.00th=[10814], 40.00th=[11338], 50.00th=[11863], 60.00th=[12518], 00:18:55.480 | 70.00th=[13960], 80.00th=[15664], 90.00th=[18220], 95.00th=[21890], 00:18:55.480 | 99.00th=[35390], 99.50th=[35390], 99.90th=[35914], 99.95th=[35914], 00:18:55.480 | 99.99th=[35914] 00:18:55.480 write: IOPS=5089, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1006msec); 0 zone resets 00:18:55.480 slat (usec): min=4, max=39349, avg=85.15, stdev=751.84 00:18:55.480 clat (usec): min=3454, max=49738, avg=11804.76, stdev=5579.11 00:18:55.480 lat (usec): min=4207, max=49758, avg=11889.91, stdev=5614.88 00:18:55.480 clat percentiles (usec): 00:18:55.480 | 1.00th=[ 5080], 5.00th=[ 6194], 10.00th=[ 7832], 20.00th=[ 9110], 00:18:55.480 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11207], 60.00th=[11600], 00:18:55.480 | 70.00th=[11994], 80.00th=[12780], 90.00th=[14877], 95.00th=[15926], 00:18:55.480 | 99.00th=[42730], 99.50th=[42730], 99.90th=[49546], 99.95th=[49546], 00:18:55.480 | 99.99th=[49546] 00:18:55.480 bw ( KiB/s): min=20480, max=20480, per=32.00%, avg=20480.00, stdev= 0.00, samples=2 00:18:55.480 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:18:55.480 lat (msec) : 2=0.01%, 4=0.01%, 10=20.36%, 20=74.81%, 50=4.82% 00:18:55.480 cpu : usr=8.26%, sys=10.75%, ctx=445, majf=0, minf=1 00:18:55.480 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:18:55.480 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.480 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:55.480 issued rwts: total=5093,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.480 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:55.480 job1: (groupid=0, jobs=1): err= 0: pid=2405473: Tue Apr 23 05:03:34 2024 00:18:55.480 read: IOPS=3541, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1012msec) 00:18:55.480 slat (usec): min=2, max=41191, avg=108.84, stdev=968.80 00:18:55.480 clat (usec): min=1915, max=56359, avg=15352.39, stdev=8541.79 00:18:55.480 lat (usec): min=1924, max=56363, avg=15461.23, stdev=8576.88 00:18:55.480 clat percentiles (usec): 00:18:55.480 | 1.00th=[ 5211], 5.00th=[ 8717], 10.00th=[ 9503], 20.00th=[10945], 00:18:55.480 | 30.00th=[11338], 40.00th=[11600], 50.00th=[12518], 60.00th=[13173], 00:18:55.480 | 70.00th=[14746], 80.00th=[19530], 90.00th=[25297], 95.00th=[28181], 00:18:55.481 | 99.00th=[54264], 99.50th=[54789], 99.90th=[56361], 99.95th=[56361], 00:18:55.481 | 99.99th=[56361] 00:18:55.481 write: IOPS=3760, BW=14.7MiB/s (15.4MB/s)(14.9MiB/1012msec); 0 zone resets 00:18:55.481 slat (usec): min=3, max=17515, avg=141.02, stdev=925.79 00:18:55.481 clat (usec): min=592, max=115439, avg=19170.60, stdev=17551.65 00:18:55.481 lat (usec): min=605, max=115447, avg=19311.63, stdev=17628.00 00:18:55.481 clat percentiles (usec): 00:18:55.481 | 1.00th=[ 1319], 5.00th=[ 7504], 10.00th=[ 8979], 20.00th=[ 10814], 00:18:55.481 | 30.00th=[ 11207], 40.00th=[ 11600], 50.00th=[ 12256], 60.00th=[ 14091], 00:18:55.481 | 70.00th=[ 22676], 80.00th=[ 23987], 90.00th=[ 29754], 95.00th=[ 51643], 00:18:55.481 | 99.00th=[108528], 99.50th=[114820], 99.90th=[115868], 99.95th=[115868], 00:18:55.481 | 99.99th=[115868] 00:18:55.481 bw ( KiB/s): min= 8944, max=20480, per=22.99%, avg=14712.00, stdev=8157.18, samples=2 00:18:55.481 iops : min= 2236, max= 5120, avg=3678.00, stdev=2039.30, samples=2 00:18:55.481 lat (usec) : 750=0.26%, 1000=0.11% 00:18:55.481 lat (msec) : 2=1.08%, 4=0.62%, 10=11.00%, 20=61.06%, 50=22.17% 00:18:55.481 lat (msec) : 100=2.86%, 250=0.85% 00:18:55.481 cpu : usr=2.87%, sys=7.22%, ctx=387, majf=0, minf=1 00:18:55.481 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:18:55.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:55.481 issued rwts: total=3584,3806,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.481 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:55.481 job2: (groupid=0, jobs=1): err= 0: pid=2405476: Tue Apr 23 05:03:34 2024 00:18:55.481 read: IOPS=3877, BW=15.1MiB/s (15.9MB/s)(15.2MiB/1006msec) 00:18:55.481 slat (usec): min=3, max=11930, avg=106.18, stdev=808.82 00:18:55.481 clat (usec): min=1457, max=71761, avg=15369.93, stdev=7597.32 00:18:55.481 lat (usec): min=1476, max=71771, avg=15476.11, stdev=7643.23 00:18:55.481 clat percentiles (usec): 00:18:55.481 | 1.00th=[ 4817], 5.00th=[ 7308], 10.00th=[10814], 20.00th=[12387], 00:18:55.481 | 30.00th=[13304], 40.00th=[13829], 50.00th=[14091], 60.00th=[14746], 00:18:55.481 | 70.00th=[15926], 80.00th=[16712], 90.00th=[20317], 95.00th=[22676], 00:18:55.481 | 99.00th=[64750], 99.50th=[68682], 99.90th=[71828], 99.95th=[71828], 00:18:55.481 | 99.99th=[71828] 00:18:55.481 write: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:18:55.481 slat (usec): min=4, max=15571, avg=112.32, stdev=760.29 00:18:55.481 clat (usec): min=454, max=63834, avg=16532.92, stdev=7637.30 00:18:55.481 lat (usec): min=684, max=63845, avg=16645.24, stdev=7693.02 00:18:55.481 clat percentiles (usec): 00:18:55.481 | 1.00th=[ 5538], 5.00th=[ 8094], 10.00th=[ 9765], 20.00th=[10814], 00:18:55.481 | 30.00th=[12125], 40.00th=[12649], 50.00th=[13698], 60.00th=[16057], 00:18:55.481 | 70.00th=[19268], 80.00th=[23725], 90.00th=[25560], 95.00th=[27657], 00:18:55.481 | 99.00th=[42206], 99.50th=[47973], 99.90th=[57934], 99.95th=[57934], 00:18:55.481 | 99.99th=[63701] 00:18:55.481 bw ( KiB/s): min=16384, max=16384, per=25.60%, avg=16384.00, stdev= 0.00, samples=2 00:18:55.481 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:18:55.481 lat (usec) : 500=0.01%, 750=0.04% 00:18:55.481 lat (msec) : 2=0.40%, 4=0.40%, 10=8.54%, 20=71.04%, 50=18.59% 00:18:55.481 lat (msec) : 100=0.98% 00:18:55.481 cpu : usr=5.27%, sys=9.95%, ctx=298, majf=0, minf=1 00:18:55.481 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:18:55.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:55.481 issued rwts: total=3901,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.481 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:55.481 job3: (groupid=0, jobs=1): err= 0: pid=2405477: Tue Apr 23 05:03:34 2024 00:18:55.481 read: IOPS=3065, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1002msec) 00:18:55.481 slat (usec): min=3, max=44648, avg=170.08, stdev=1516.64 00:18:55.481 clat (msec): min=9, max=123, avg=21.94, stdev=21.51 00:18:55.481 lat (msec): min=9, max=123, avg=22.11, stdev=21.69 00:18:55.481 clat percentiles (msec): 00:18:55.481 | 1.00th=[ 11], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 13], 00:18:55.481 | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 14], 60.00th=[ 15], 00:18:55.481 | 70.00th=[ 16], 80.00th=[ 20], 90.00th=[ 56], 95.00th=[ 85], 00:18:55.481 | 99.00th=[ 97], 99.50th=[ 97], 99.90th=[ 106], 99.95th=[ 115], 00:18:55.481 | 99.99th=[ 125] 00:18:55.481 write: IOPS=3162, BW=12.4MiB/s (13.0MB/s)(12.4MiB/1002msec); 0 zone resets 00:18:55.481 slat (usec): min=3, max=25346, avg=140.26, stdev=915.37 00:18:55.481 clat (usec): min=567, max=66872, avg=18460.91, stdev=11178.69 00:18:55.481 lat (usec): min=4517, max=66885, avg=18601.17, stdev=11256.33 00:18:55.481 clat percentiles (usec): 00:18:55.481 | 1.00th=[ 4883], 5.00th=[10683], 10.00th=[12125], 20.00th=[12518], 00:18:55.481 | 30.00th=[12780], 40.00th=[12911], 50.00th=[13042], 60.00th=[13435], 00:18:55.481 | 70.00th=[18482], 80.00th=[25297], 90.00th=[32113], 95.00th=[48497], 00:18:55.481 | 99.00th=[61080], 99.50th=[66847], 99.90th=[66847], 99.95th=[66847], 00:18:55.481 | 99.99th=[66847] 00:18:55.481 bw ( KiB/s): min= 7376, max=17200, per=19.20%, avg=12288.00, stdev=6946.62, samples=2 00:18:55.481 iops : min= 1844, max= 4300, avg=3072.00, stdev=1736.65, samples=2 00:18:55.481 lat (usec) : 750=0.02% 00:18:55.481 lat (msec) : 10=2.58%, 20=74.32%, 50=16.14%, 100=6.71%, 250=0.24% 00:18:55.481 cpu : usr=4.20%, sys=6.99%, ctx=366, majf=0, minf=1 00:18:55.481 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:18:55.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:55.481 issued rwts: total=3072,3169,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.481 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:55.481 00:18:55.481 Run status group 0 (all jobs): 00:18:55.481 READ: bw=60.4MiB/s (63.3MB/s), 12.0MiB/s-19.8MiB/s (12.6MB/s-20.7MB/s), io=61.1MiB (64.1MB), run=1002-1012msec 00:18:55.481 WRITE: bw=62.5MiB/s (65.5MB/s), 12.4MiB/s-19.9MiB/s (13.0MB/s-20.8MB/s), io=63.2MiB (66.3MB), run=1002-1012msec 00:18:55.481 00:18:55.481 Disk stats (read/write): 00:18:55.481 nvme0n1: ios=4146/4268, merge=0/0, ticks=53398/45072, in_queue=98470, util=97.80% 00:18:55.481 nvme0n2: ios=3238/3584, merge=0/0, ticks=29330/31237, in_queue=60567, util=96.75% 00:18:55.481 nvme0n3: ios=3149/3543, merge=0/0, ticks=43752/57165, in_queue=100917, util=97.81% 00:18:55.481 nvme0n4: ios=2353/2560, merge=0/0, ticks=19496/16232, in_queue=35728, util=96.84% 00:18:55.481 05:03:34 -- target/fio.sh@55 -- # sync 00:18:55.481 05:03:34 -- target/fio.sh@59 -- # fio_pid=2405612 00:18:55.481 05:03:34 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:18:55.481 05:03:34 -- target/fio.sh@61 -- # sleep 3 00:18:55.481 [global] 00:18:55.481 thread=1 00:18:55.481 invalidate=1 00:18:55.481 rw=read 00:18:55.481 time_based=1 00:18:55.481 runtime=10 00:18:55.481 ioengine=libaio 00:18:55.481 direct=1 00:18:55.481 bs=4096 00:18:55.481 iodepth=1 00:18:55.481 norandommap=1 00:18:55.481 numjobs=1 00:18:55.481 00:18:55.481 [job0] 00:18:55.481 filename=/dev/nvme0n1 00:18:55.481 [job1] 00:18:55.481 filename=/dev/nvme0n2 00:18:55.481 [job2] 00:18:55.481 filename=/dev/nvme0n3 00:18:55.481 [job3] 00:18:55.481 filename=/dev/nvme0n4 00:18:55.481 Could not set queue depth (nvme0n1) 00:18:55.481 Could not set queue depth (nvme0n2) 00:18:55.481 Could not set queue depth (nvme0n3) 00:18:55.481 Could not set queue depth (nvme0n4) 00:18:55.739 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:55.739 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:55.739 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:55.739 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:55.739 fio-3.35 00:18:55.739 Starting 4 threads 00:18:58.272 05:03:37 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:18:58.530 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=27373568, buflen=4096 00:18:58.530 fio: pid=2405705, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:58.530 05:03:37 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:18:58.788 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=24973312, buflen=4096 00:18:58.788 fio: pid=2405704, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:59.048 05:03:37 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:59.048 05:03:37 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:18:59.309 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=30060544, buflen=4096 00:18:59.309 fio: pid=2405702, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:59.309 05:03:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:59.309 05:03:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:18:59.309 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=16580608, buflen=4096 00:18:59.309 fio: pid=2405703, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:59.569 05:03:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:59.569 05:03:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:18:59.569 00:18:59.569 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2405702: Tue Apr 23 05:03:38 2024 00:18:59.569 read: IOPS=2146, BW=8586KiB/s (8792kB/s)(28.7MiB/3419msec) 00:18:59.569 slat (usec): min=4, max=21340, avg=20.42, stdev=366.72 00:18:59.569 clat (usec): min=203, max=41401, avg=442.37, stdev=2037.50 00:18:59.569 lat (usec): min=210, max=41415, avg=460.48, stdev=2061.12 00:18:59.569 clat percentiles (usec): 00:18:59.569 | 1.00th=[ 221], 5.00th=[ 231], 10.00th=[ 237], 20.00th=[ 245], 00:18:59.569 | 30.00th=[ 255], 40.00th=[ 273], 50.00th=[ 314], 60.00th=[ 351], 00:18:59.569 | 70.00th=[ 379], 80.00th=[ 408], 90.00th=[ 519], 95.00th=[ 553], 00:18:59.569 | 99.00th=[ 660], 99.50th=[ 725], 99.90th=[41157], 99.95th=[41157], 00:18:59.569 | 99.99th=[41157] 00:18:59.569 bw ( KiB/s): min= 3232, max=14424, per=34.61%, avg=9132.00, stdev=4093.25, samples=6 00:18:59.569 iops : min= 808, max= 3606, avg=2283.00, stdev=1023.31, samples=6 00:18:59.569 lat (usec) : 250=26.35%, 500=61.29%, 750=11.93%, 1000=0.15% 00:18:59.569 lat (msec) : 50=0.26% 00:18:59.569 cpu : usr=1.32%, sys=3.69%, ctx=7347, majf=0, minf=1 00:18:59.569 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:59.569 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.569 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.569 issued rwts: total=7340,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:59.569 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:59.569 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2405703: Tue Apr 23 05:03:38 2024 00:18:59.569 read: IOPS=1105, BW=4419KiB/s (4525kB/s)(15.8MiB/3664msec) 00:18:59.569 slat (usec): min=4, max=19909, avg=23.55, stdev=429.18 00:18:59.569 clat (usec): min=203, max=41379, avg=879.11, stdev=4927.06 00:18:59.569 lat (usec): min=208, max=41393, avg=902.67, stdev=4945.41 00:18:59.569 clat percentiles (usec): 00:18:59.569 | 1.00th=[ 210], 5.00th=[ 219], 10.00th=[ 225], 20.00th=[ 233], 00:18:59.569 | 30.00th=[ 241], 40.00th=[ 247], 50.00th=[ 251], 60.00th=[ 260], 00:18:59.569 | 70.00th=[ 269], 80.00th=[ 293], 90.00th=[ 371], 95.00th=[ 453], 00:18:59.569 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:18:59.569 | 99.99th=[41157] 00:18:59.569 bw ( KiB/s): min= 160, max=12093, per=15.13%, avg=3992.71, stdev=4195.19, samples=7 00:18:59.569 iops : min= 40, max= 3023, avg=998.14, stdev=1048.72, samples=7 00:18:59.569 lat (usec) : 250=47.54%, 500=49.25%, 750=1.58%, 1000=0.02% 00:18:59.569 lat (msec) : 2=0.02%, 4=0.05%, 20=0.02%, 50=1.48% 00:18:59.569 cpu : usr=0.41%, sys=1.23%, ctx=4057, majf=0, minf=1 00:18:59.569 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:59.569 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.569 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.569 issued rwts: total=4049,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:59.569 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:59.569 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2405704: Tue Apr 23 05:03:38 2024 00:18:59.569 read: IOPS=1939, BW=7757KiB/s (7943kB/s)(23.8MiB/3144msec) 00:18:59.569 slat (usec): min=5, max=18828, avg=14.77, stdev=241.04 00:18:59.569 clat (usec): min=232, max=42482, avg=498.02, stdev=2651.46 00:18:59.569 lat (usec): min=243, max=61311, avg=512.79, stdev=2711.35 00:18:59.569 clat percentiles (usec): 00:18:59.569 | 1.00th=[ 249], 5.00th=[ 262], 10.00th=[ 269], 20.00th=[ 281], 00:18:59.569 | 30.00th=[ 289], 40.00th=[ 306], 50.00th=[ 326], 60.00th=[ 338], 00:18:59.569 | 70.00th=[ 355], 80.00th=[ 371], 90.00th=[ 379], 95.00th=[ 388], 00:18:59.569 | 99.00th=[ 529], 99.50th=[ 660], 99.90th=[42206], 99.95th=[42206], 00:18:59.569 | 99.99th=[42730] 00:18:59.569 bw ( KiB/s): min= 112, max=12792, per=30.79%, avg=8124.00, stdev=4998.03, samples=6 00:18:59.569 iops : min= 28, max= 3198, avg=2031.00, stdev=1249.51, samples=6 00:18:59.569 lat (usec) : 250=1.36%, 500=97.44%, 750=0.69%, 1000=0.05% 00:18:59.569 lat (msec) : 2=0.02%, 50=0.43% 00:18:59.569 cpu : usr=1.62%, sys=3.12%, ctx=6100, majf=0, minf=1 00:18:59.569 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:59.569 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.569 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.569 issued rwts: total=6098,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:59.569 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:59.569 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2405705: Tue Apr 23 05:03:38 2024 00:18:59.569 read: IOPS=2324, BW=9298KiB/s (9521kB/s)(26.1MiB/2875msec) 00:18:59.569 slat (nsec): min=4392, max=61206, avg=12147.46, stdev=5898.12 00:18:59.569 clat (usec): min=228, max=41211, avg=414.81, stdev=1862.50 00:18:59.569 lat (usec): min=233, max=41234, avg=426.96, stdev=1862.55 00:18:59.569 clat percentiles (usec): 00:18:59.569 | 1.00th=[ 241], 5.00th=[ 255], 10.00th=[ 265], 20.00th=[ 289], 00:18:59.569 | 30.00th=[ 302], 40.00th=[ 318], 50.00th=[ 330], 60.00th=[ 343], 00:18:59.569 | 70.00th=[ 355], 80.00th=[ 371], 90.00th=[ 383], 95.00th=[ 392], 00:18:59.569 | 99.00th=[ 515], 99.50th=[ 603], 99.90th=[41157], 99.95th=[41157], 00:18:59.569 | 99.99th=[41157] 00:18:59.570 bw ( KiB/s): min= 7448, max=11920, per=34.49%, avg=9099.20, stdev=2015.47, samples=5 00:18:59.570 iops : min= 1862, max= 2980, avg=2274.80, stdev=503.87, samples=5 00:18:59.570 lat (usec) : 250=3.35%, 500=95.51%, 750=0.88%, 1000=0.01% 00:18:59.570 lat (msec) : 2=0.01%, 50=0.21% 00:18:59.570 cpu : usr=1.53%, sys=4.52%, ctx=6685, majf=0, minf=1 00:18:59.570 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:59.570 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.570 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.570 issued rwts: total=6684,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:59.570 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:59.570 00:18:59.570 Run status group 0 (all jobs): 00:18:59.570 READ: bw=25.8MiB/s (27.0MB/s), 4419KiB/s-9298KiB/s (4525kB/s-9521kB/s), io=94.4MiB (99.0MB), run=2875-3664msec 00:18:59.570 00:18:59.570 Disk stats (read/write): 00:18:59.570 nvme0n1: ios=7379/0, merge=0/0, ticks=3331/0, in_queue=3331, util=98.68% 00:18:59.570 nvme0n2: ios=3837/0, merge=0/0, ticks=4182/0, in_queue=4182, util=98.47% 00:18:59.570 nvme0n3: ios=6146/0, merge=0/0, ticks=3977/0, in_queue=3977, util=99.13% 00:18:59.570 nvme0n4: ios=6633/0, merge=0/0, ticks=2673/0, in_queue=2673, util=96.71% 00:18:59.828 05:03:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:59.828 05:03:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:00.086 05:03:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:00.086 05:03:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:00.344 05:03:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:00.344 05:03:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:00.344 05:03:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:00.344 05:03:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:00.612 05:03:39 -- target/fio.sh@69 -- # fio_status=0 00:19:00.612 05:03:39 -- target/fio.sh@70 -- # wait 2405612 00:19:00.612 05:03:39 -- target/fio.sh@70 -- # fio_status=4 00:19:00.612 05:03:39 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:00.915 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:00.915 05:03:39 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:00.915 05:03:39 -- common/autotest_common.sh@1205 -- # local i=0 00:19:00.915 05:03:39 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:00.915 05:03:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:00.915 05:03:39 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:00.915 05:03:39 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:00.915 05:03:39 -- common/autotest_common.sh@1217 -- # return 0 00:19:00.915 05:03:39 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:00.915 05:03:39 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:00.915 nvmf hotplug test: fio failed as expected 00:19:00.915 05:03:39 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:01.174 05:03:40 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:01.174 05:03:40 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:01.174 05:03:40 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:01.174 05:03:40 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:01.174 05:03:40 -- target/fio.sh@91 -- # nvmftestfini 00:19:01.174 05:03:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:01.174 05:03:40 -- nvmf/common.sh@117 -- # sync 00:19:01.174 05:03:40 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:19:01.174 05:03:40 -- nvmf/common.sh@120 -- # set +e 00:19:01.174 05:03:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:01.174 05:03:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:19:01.174 rmmod nvme_tcp 00:19:01.174 rmmod nvme_fabrics 00:19:01.174 rmmod nvme_keyring 00:19:01.174 05:03:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:01.174 05:03:40 -- nvmf/common.sh@124 -- # set -e 00:19:01.174 05:03:40 -- nvmf/common.sh@125 -- # return 0 00:19:01.174 05:03:40 -- nvmf/common.sh@478 -- # '[' -n 2403591 ']' 00:19:01.174 05:03:40 -- nvmf/common.sh@479 -- # killprocess 2403591 00:19:01.174 05:03:40 -- common/autotest_common.sh@936 -- # '[' -z 2403591 ']' 00:19:01.174 05:03:40 -- common/autotest_common.sh@940 -- # kill -0 2403591 00:19:01.174 05:03:40 -- common/autotest_common.sh@941 -- # uname 00:19:01.174 05:03:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:01.174 05:03:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2403591 00:19:01.174 05:03:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:01.174 05:03:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:01.174 05:03:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2403591' 00:19:01.174 killing process with pid 2403591 00:19:01.174 05:03:40 -- common/autotest_common.sh@955 -- # kill 2403591 00:19:01.174 05:03:40 -- common/autotest_common.sh@960 -- # wait 2403591 00:19:01.432 05:03:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:01.432 05:03:40 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:19:01.432 05:03:40 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:19:01.432 05:03:40 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:01.432 05:03:40 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:19:01.432 05:03:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:01.432 05:03:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:01.432 05:03:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.968 05:03:42 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:19:03.968 00:19:03.968 real 0m22.970s 00:19:03.968 user 1m18.614s 00:19:03.968 sys 0m7.470s 00:19:03.968 05:03:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:03.968 05:03:42 -- common/autotest_common.sh@10 -- # set +x 00:19:03.968 ************************************ 00:19:03.968 END TEST nvmf_fio_target 00:19:03.968 ************************************ 00:19:03.968 05:03:42 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:03.968 05:03:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:03.968 05:03:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:03.968 05:03:42 -- common/autotest_common.sh@10 -- # set +x 00:19:03.968 ************************************ 00:19:03.968 START TEST nvmf_bdevio 00:19:03.968 ************************************ 00:19:03.968 05:03:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:03.968 * Looking for test storage... 00:19:03.968 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:03.968 05:03:42 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:03.968 05:03:42 -- nvmf/common.sh@7 -- # uname -s 00:19:03.968 05:03:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:03.968 05:03:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:03.968 05:03:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:03.968 05:03:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:03.968 05:03:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:03.968 05:03:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:03.968 05:03:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:03.968 05:03:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:03.968 05:03:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:03.968 05:03:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:03.968 05:03:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:03.968 05:03:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:03.968 05:03:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:03.968 05:03:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:03.968 05:03:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:03.968 05:03:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:03.968 05:03:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:03.968 05:03:42 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:03.968 05:03:42 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:03.968 05:03:42 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:03.968 05:03:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.968 05:03:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.968 05:03:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.968 05:03:42 -- paths/export.sh@5 -- # export PATH 00:19:03.968 05:03:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.968 05:03:42 -- nvmf/common.sh@47 -- # : 0 00:19:03.968 05:03:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:03.968 05:03:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:03.968 05:03:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:03.968 05:03:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:03.968 05:03:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:03.968 05:03:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:03.968 05:03:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:03.968 05:03:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:03.968 05:03:42 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:03.968 05:03:42 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:03.968 05:03:42 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:03.968 05:03:42 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:19:03.968 05:03:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:03.968 05:03:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:03.968 05:03:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:03.968 05:03:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:03.968 05:03:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:03.968 05:03:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:03.968 05:03:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.968 05:03:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:03.968 05:03:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:03.968 05:03:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:03.968 05:03:42 -- common/autotest_common.sh@10 -- # set +x 00:19:05.869 05:03:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:05.869 05:03:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:05.869 05:03:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:05.869 05:03:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:05.869 05:03:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:05.869 05:03:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:05.869 05:03:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:05.869 05:03:44 -- nvmf/common.sh@295 -- # net_devs=() 00:19:05.869 05:03:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:05.869 05:03:44 -- nvmf/common.sh@296 -- # e810=() 00:19:05.869 05:03:44 -- nvmf/common.sh@296 -- # local -ga e810 00:19:05.870 05:03:44 -- nvmf/common.sh@297 -- # x722=() 00:19:05.870 05:03:44 -- nvmf/common.sh@297 -- # local -ga x722 00:19:05.870 05:03:44 -- nvmf/common.sh@298 -- # mlx=() 00:19:05.870 05:03:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:05.870 05:03:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:05.870 05:03:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:05.870 05:03:44 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:05.870 05:03:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:05.870 05:03:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:05.870 05:03:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:05.870 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:05.870 05:03:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:05.870 05:03:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:05.870 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:05.870 05:03:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:05.870 05:03:44 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:05.870 05:03:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:05.870 05:03:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:05.870 05:03:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:05.870 05:03:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:05.870 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:05.870 05:03:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:05.870 05:03:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:05.870 05:03:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:05.870 05:03:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:05.870 05:03:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:05.870 05:03:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:05.870 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:05.870 05:03:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:05.870 05:03:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:05.870 05:03:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:05.870 05:03:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:19:05.870 05:03:44 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:05.870 05:03:44 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:05.870 05:03:44 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:05.870 05:03:44 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:19:05.870 05:03:44 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:05.870 05:03:44 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:05.870 05:03:44 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:19:05.870 05:03:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:05.870 05:03:44 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:05.870 05:03:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:19:05.870 05:03:44 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:19:05.870 05:03:44 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:19:05.870 05:03:44 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:05.870 05:03:44 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:05.870 05:03:44 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:05.870 05:03:44 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:19:05.870 05:03:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:05.870 05:03:44 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:05.870 05:03:44 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:05.870 05:03:44 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:19:05.870 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:05.870 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:19:05.870 00:19:05.870 --- 10.0.0.2 ping statistics --- 00:19:05.870 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:05.870 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:19:05.870 05:03:44 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:05.870 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:05.870 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:19:05.870 00:19:05.870 --- 10.0.0.1 ping statistics --- 00:19:05.870 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:05.870 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:19:05.870 05:03:44 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:05.870 05:03:44 -- nvmf/common.sh@411 -- # return 0 00:19:05.870 05:03:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:05.870 05:03:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:05.870 05:03:44 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:19:05.870 05:03:44 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:05.870 05:03:44 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:19:05.870 05:03:44 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:19:05.870 05:03:44 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:05.870 05:03:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:05.870 05:03:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:05.870 05:03:44 -- common/autotest_common.sh@10 -- # set +x 00:19:05.870 05:03:44 -- nvmf/common.sh@470 -- # nvmfpid=2408331 00:19:05.870 05:03:44 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:05.870 05:03:44 -- nvmf/common.sh@471 -- # waitforlisten 2408331 00:19:05.870 05:03:44 -- common/autotest_common.sh@817 -- # '[' -z 2408331 ']' 00:19:05.870 05:03:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:05.870 05:03:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:05.870 05:03:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:05.870 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:05.870 05:03:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:05.870 05:03:44 -- common/autotest_common.sh@10 -- # set +x 00:19:05.870 [2024-04-23 05:03:44.936845] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:05.870 [2024-04-23 05:03:44.936946] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:05.870 EAL: No free 2048 kB hugepages reported on node 1 00:19:05.870 [2024-04-23 05:03:44.984792] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:05.870 [2024-04-23 05:03:45.015926] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:06.128 [2024-04-23 05:03:45.114172] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:06.128 [2024-04-23 05:03:45.114242] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:06.128 [2024-04-23 05:03:45.114258] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:06.128 [2024-04-23 05:03:45.114271] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:06.128 [2024-04-23 05:03:45.114284] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:06.128 [2024-04-23 05:03:45.114368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:06.128 [2024-04-23 05:03:45.114452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:06.128 [2024-04-23 05:03:45.114525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:06.128 [2024-04-23 05:03:45.114527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:06.128 05:03:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:06.128 05:03:45 -- common/autotest_common.sh@850 -- # return 0 00:19:06.128 05:03:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:06.128 05:03:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:06.128 05:03:45 -- common/autotest_common.sh@10 -- # set +x 00:19:06.128 05:03:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:06.128 05:03:45 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:06.128 05:03:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.128 05:03:45 -- common/autotest_common.sh@10 -- # set +x 00:19:06.128 [2024-04-23 05:03:45.264292] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:06.128 05:03:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.128 05:03:45 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:06.128 05:03:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.128 05:03:45 -- common/autotest_common.sh@10 -- # set +x 00:19:06.387 Malloc0 00:19:06.387 05:03:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.387 05:03:45 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:06.387 05:03:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.387 05:03:45 -- common/autotest_common.sh@10 -- # set +x 00:19:06.387 05:03:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.387 05:03:45 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:06.387 05:03:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.387 05:03:45 -- common/autotest_common.sh@10 -- # set +x 00:19:06.387 05:03:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.387 05:03:45 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:06.387 05:03:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.387 05:03:45 -- common/autotest_common.sh@10 -- # set +x 00:19:06.388 [2024-04-23 05:03:45.315754] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:06.388 05:03:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.388 05:03:45 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:06.388 05:03:45 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:06.388 05:03:45 -- nvmf/common.sh@521 -- # config=() 00:19:06.388 05:03:45 -- nvmf/common.sh@521 -- # local subsystem config 00:19:06.388 05:03:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:19:06.388 05:03:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:19:06.388 { 00:19:06.388 "params": { 00:19:06.388 "name": "Nvme$subsystem", 00:19:06.388 "trtype": "$TEST_TRANSPORT", 00:19:06.388 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:06.388 "adrfam": "ipv4", 00:19:06.388 "trsvcid": "$NVMF_PORT", 00:19:06.388 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:06.388 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:06.388 "hdgst": ${hdgst:-false}, 00:19:06.388 "ddgst": ${ddgst:-false} 00:19:06.388 }, 00:19:06.388 "method": "bdev_nvme_attach_controller" 00:19:06.388 } 00:19:06.388 EOF 00:19:06.388 )") 00:19:06.388 05:03:45 -- nvmf/common.sh@543 -- # cat 00:19:06.388 05:03:45 -- nvmf/common.sh@545 -- # jq . 00:19:06.388 05:03:45 -- nvmf/common.sh@546 -- # IFS=, 00:19:06.388 05:03:45 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:19:06.388 "params": { 00:19:06.388 "name": "Nvme1", 00:19:06.388 "trtype": "tcp", 00:19:06.388 "traddr": "10.0.0.2", 00:19:06.388 "adrfam": "ipv4", 00:19:06.388 "trsvcid": "4420", 00:19:06.388 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:06.388 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:06.388 "hdgst": false, 00:19:06.388 "ddgst": false 00:19:06.388 }, 00:19:06.388 "method": "bdev_nvme_attach_controller" 00:19:06.388 }' 00:19:06.388 [2024-04-23 05:03:45.357840] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:06.388 [2024-04-23 05:03:45.357927] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2408364 ] 00:19:06.388 EAL: No free 2048 kB hugepages reported on node 1 00:19:06.388 [2024-04-23 05:03:45.390704] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:06.388 [2024-04-23 05:03:45.419668] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:06.388 [2024-04-23 05:03:45.505878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:06.388 [2024-04-23 05:03:45.505930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:06.388 [2024-04-23 05:03:45.505933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:06.646 I/O targets: 00:19:06.646 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:06.646 00:19:06.646 00:19:06.646 CUnit - A unit testing framework for C - Version 2.1-3 00:19:06.646 http://cunit.sourceforge.net/ 00:19:06.646 00:19:06.646 00:19:06.646 Suite: bdevio tests on: Nvme1n1 00:19:06.646 Test: blockdev write read block ...passed 00:19:06.646 Test: blockdev write zeroes read block ...passed 00:19:06.646 Test: blockdev write zeroes read no split ...passed 00:19:06.905 Test: blockdev write zeroes read split ...passed 00:19:06.906 Test: blockdev write zeroes read split partial ...passed 00:19:06.906 Test: blockdev reset ...[2024-04-23 05:03:45.834901] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:06.906 [2024-04-23 05:03:45.835006] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1089400 (9): Bad file descriptor 00:19:06.906 [2024-04-23 05:03:45.927627] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:06.906 passed 00:19:06.906 Test: blockdev write read 8 blocks ...passed 00:19:06.906 Test: blockdev write read size > 128k ...passed 00:19:06.906 Test: blockdev write read invalid size ...passed 00:19:06.906 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:06.906 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:06.906 Test: blockdev write read max offset ...passed 00:19:06.906 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:06.906 Test: blockdev writev readv 8 blocks ...passed 00:19:06.906 Test: blockdev writev readv 30 x 1block ...passed 00:19:07.165 Test: blockdev writev readv block ...passed 00:19:07.165 Test: blockdev writev readv size > 128k ...passed 00:19:07.165 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:07.165 Test: blockdev comparev and writev ...[2024-04-23 05:03:46.101982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.165 [2024-04-23 05:03:46.102020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:07.165 [2024-04-23 05:03:46.102044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.165 [2024-04-23 05:03:46.102062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:07.165 [2024-04-23 05:03:46.102434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.166 [2024-04-23 05:03:46.102459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.102480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.166 [2024-04-23 05:03:46.102496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.102852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.166 [2024-04-23 05:03:46.102876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.102897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.166 [2024-04-23 05:03:46.102913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.103263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.166 [2024-04-23 05:03:46.103288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.103311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:07.166 [2024-04-23 05:03:46.103327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:07.166 passed 00:19:07.166 Test: blockdev nvme passthru rw ...passed 00:19:07.166 Test: blockdev nvme passthru vendor specific ...[2024-04-23 05:03:46.187813] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:07.166 [2024-04-23 05:03:46.187841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.188011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:07.166 [2024-04-23 05:03:46.188033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.188188] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:07.166 [2024-04-23 05:03:46.188211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:07.166 [2024-04-23 05:03:46.188365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:07.166 [2024-04-23 05:03:46.188388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:07.166 passed 00:19:07.166 Test: blockdev nvme admin passthru ...passed 00:19:07.166 Test: blockdev copy ...passed 00:19:07.166 00:19:07.166 Run Summary: Type Total Ran Passed Failed Inactive 00:19:07.166 suites 1 1 n/a 0 0 00:19:07.166 tests 23 23 23 0 0 00:19:07.166 asserts 152 152 152 0 n/a 00:19:07.166 00:19:07.166 Elapsed time = 1.141 seconds 00:19:07.426 05:03:46 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:07.426 05:03:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:07.426 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:19:07.426 05:03:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:07.426 05:03:46 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:07.426 05:03:46 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:07.426 05:03:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:07.426 05:03:46 -- nvmf/common.sh@117 -- # sync 00:19:07.426 05:03:46 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:19:07.426 05:03:46 -- nvmf/common.sh@120 -- # set +e 00:19:07.426 05:03:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:07.426 05:03:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:19:07.426 rmmod nvme_tcp 00:19:07.426 rmmod nvme_fabrics 00:19:07.426 rmmod nvme_keyring 00:19:07.426 05:03:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:07.426 05:03:46 -- nvmf/common.sh@124 -- # set -e 00:19:07.426 05:03:46 -- nvmf/common.sh@125 -- # return 0 00:19:07.426 05:03:46 -- nvmf/common.sh@478 -- # '[' -n 2408331 ']' 00:19:07.426 05:03:46 -- nvmf/common.sh@479 -- # killprocess 2408331 00:19:07.426 05:03:46 -- common/autotest_common.sh@936 -- # '[' -z 2408331 ']' 00:19:07.426 05:03:46 -- common/autotest_common.sh@940 -- # kill -0 2408331 00:19:07.426 05:03:46 -- common/autotest_common.sh@941 -- # uname 00:19:07.426 05:03:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:07.426 05:03:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2408331 00:19:07.426 05:03:46 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:07.426 05:03:46 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:07.426 05:03:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2408331' 00:19:07.426 killing process with pid 2408331 00:19:07.426 05:03:46 -- common/autotest_common.sh@955 -- # kill 2408331 00:19:07.426 05:03:46 -- common/autotest_common.sh@960 -- # wait 2408331 00:19:07.684 05:03:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:07.684 05:03:46 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:19:07.684 05:03:46 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:19:07.684 05:03:46 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:07.684 05:03:46 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:19:07.684 05:03:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:07.684 05:03:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:07.684 05:03:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:10.224 05:03:48 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:19:10.224 00:19:10.224 real 0m6.167s 00:19:10.224 user 0m9.359s 00:19:10.224 sys 0m2.079s 00:19:10.224 05:03:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:10.224 05:03:48 -- common/autotest_common.sh@10 -- # set +x 00:19:10.224 ************************************ 00:19:10.224 END TEST nvmf_bdevio 00:19:10.224 ************************************ 00:19:10.224 05:03:48 -- nvmf/nvmf.sh@58 -- # '[' tcp = tcp ']' 00:19:10.225 05:03:48 -- nvmf/nvmf.sh@59 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:10.225 05:03:48 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:10.225 05:03:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:10.225 05:03:48 -- common/autotest_common.sh@10 -- # set +x 00:19:10.225 ************************************ 00:19:10.225 START TEST nvmf_bdevio_no_huge 00:19:10.225 ************************************ 00:19:10.225 05:03:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:10.225 * Looking for test storage... 00:19:10.225 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:10.225 05:03:49 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:10.225 05:03:49 -- nvmf/common.sh@7 -- # uname -s 00:19:10.225 05:03:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:10.225 05:03:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:10.225 05:03:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:10.225 05:03:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:10.225 05:03:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:10.225 05:03:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:10.225 05:03:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:10.225 05:03:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:10.225 05:03:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:10.225 05:03:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:10.225 05:03:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:10.225 05:03:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:10.225 05:03:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:10.225 05:03:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:10.225 05:03:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:10.225 05:03:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:10.225 05:03:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:10.225 05:03:49 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:10.225 05:03:49 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:10.225 05:03:49 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:10.225 05:03:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.225 05:03:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.225 05:03:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.225 05:03:49 -- paths/export.sh@5 -- # export PATH 00:19:10.225 05:03:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.225 05:03:49 -- nvmf/common.sh@47 -- # : 0 00:19:10.225 05:03:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:10.225 05:03:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:10.225 05:03:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:10.225 05:03:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:10.225 05:03:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:10.225 05:03:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:10.225 05:03:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:10.225 05:03:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:10.225 05:03:49 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:10.225 05:03:49 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:10.225 05:03:49 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:10.225 05:03:49 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:19:10.225 05:03:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:10.225 05:03:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:10.225 05:03:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:10.225 05:03:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:10.225 05:03:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:10.225 05:03:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:10.225 05:03:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:10.225 05:03:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:10.225 05:03:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:10.225 05:03:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:10.225 05:03:49 -- common/autotest_common.sh@10 -- # set +x 00:19:12.131 05:03:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:12.131 05:03:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:12.131 05:03:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:12.131 05:03:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:12.131 05:03:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:12.131 05:03:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:12.131 05:03:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:12.131 05:03:50 -- nvmf/common.sh@295 -- # net_devs=() 00:19:12.131 05:03:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:12.131 05:03:50 -- nvmf/common.sh@296 -- # e810=() 00:19:12.131 05:03:50 -- nvmf/common.sh@296 -- # local -ga e810 00:19:12.131 05:03:50 -- nvmf/common.sh@297 -- # x722=() 00:19:12.131 05:03:50 -- nvmf/common.sh@297 -- # local -ga x722 00:19:12.131 05:03:50 -- nvmf/common.sh@298 -- # mlx=() 00:19:12.131 05:03:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:12.131 05:03:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:12.131 05:03:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:12.131 05:03:50 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:12.131 05:03:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:12.131 05:03:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:12.131 05:03:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:12.131 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:12.131 05:03:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:12.131 05:03:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:12.131 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:12.131 05:03:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:12.131 05:03:50 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:12.131 05:03:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:12.131 05:03:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:12.131 05:03:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:12.131 05:03:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:12.131 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:12.131 05:03:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:12.131 05:03:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:12.131 05:03:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:12.131 05:03:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:12.131 05:03:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:12.131 05:03:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:12.131 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:12.131 05:03:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:12.131 05:03:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:12.131 05:03:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:12.131 05:03:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:19:12.131 05:03:50 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:19:12.131 05:03:50 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:12.131 05:03:50 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:12.131 05:03:50 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:12.131 05:03:50 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:19:12.131 05:03:50 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:12.131 05:03:50 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:12.131 05:03:50 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:19:12.131 05:03:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:12.131 05:03:50 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:12.131 05:03:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:19:12.131 05:03:50 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:19:12.131 05:03:50 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:19:12.131 05:03:50 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:12.131 05:03:51 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:12.131 05:03:51 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:12.131 05:03:51 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:19:12.131 05:03:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:12.131 05:03:51 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:12.131 05:03:51 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:12.131 05:03:51 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:19:12.131 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:12.131 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.136 ms 00:19:12.131 00:19:12.131 --- 10.0.0.2 ping statistics --- 00:19:12.131 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:12.131 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:19:12.131 05:03:51 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:12.131 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:12.131 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:19:12.131 00:19:12.131 --- 10.0.0.1 ping statistics --- 00:19:12.131 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:12.131 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:19:12.131 05:03:51 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:12.131 05:03:51 -- nvmf/common.sh@411 -- # return 0 00:19:12.131 05:03:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:12.131 05:03:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:12.131 05:03:51 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:19:12.131 05:03:51 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:19:12.131 05:03:51 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:12.131 05:03:51 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:19:12.131 05:03:51 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:19:12.131 05:03:51 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:12.131 05:03:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:12.131 05:03:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:12.131 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.131 05:03:51 -- nvmf/common.sh@470 -- # nvmfpid=2410436 00:19:12.131 05:03:51 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:12.131 05:03:51 -- nvmf/common.sh@471 -- # waitforlisten 2410436 00:19:12.131 05:03:51 -- common/autotest_common.sh@817 -- # '[' -z 2410436 ']' 00:19:12.131 05:03:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:12.131 05:03:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:12.131 05:03:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:12.131 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:12.131 05:03:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:12.131 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.131 [2024-04-23 05:03:51.182324] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:12.131 [2024-04-23 05:03:51.182414] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:12.131 [2024-04-23 05:03:51.232427] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:12.131 [2024-04-23 05:03:51.250774] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:12.390 [2024-04-23 05:03:51.329657] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:12.390 [2024-04-23 05:03:51.329717] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:12.390 [2024-04-23 05:03:51.329731] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:12.390 [2024-04-23 05:03:51.329742] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:12.390 [2024-04-23 05:03:51.329752] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:12.390 [2024-04-23 05:03:51.329837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:12.390 [2024-04-23 05:03:51.329900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:12.390 [2024-04-23 05:03:51.329965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:12.390 [2024-04-23 05:03:51.329967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:12.390 05:03:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:12.390 05:03:51 -- common/autotest_common.sh@850 -- # return 0 00:19:12.390 05:03:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:12.390 05:03:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:12.390 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.390 05:03:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:12.390 05:03:51 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:12.390 05:03:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:12.390 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.390 [2024-04-23 05:03:51.447783] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:12.390 05:03:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:12.390 05:03:51 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:12.390 05:03:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:12.390 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.390 Malloc0 00:19:12.390 05:03:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:12.390 05:03:51 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:12.390 05:03:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:12.390 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.390 05:03:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:12.390 05:03:51 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:12.390 05:03:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:12.390 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.390 05:03:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:12.390 05:03:51 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:12.390 05:03:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:12.390 05:03:51 -- common/autotest_common.sh@10 -- # set +x 00:19:12.390 [2024-04-23 05:03:51.486017] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:12.390 05:03:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:12.390 05:03:51 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:12.390 05:03:51 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:12.390 05:03:51 -- nvmf/common.sh@521 -- # config=() 00:19:12.390 05:03:51 -- nvmf/common.sh@521 -- # local subsystem config 00:19:12.390 05:03:51 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:19:12.390 05:03:51 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:19:12.390 { 00:19:12.390 "params": { 00:19:12.390 "name": "Nvme$subsystem", 00:19:12.390 "trtype": "$TEST_TRANSPORT", 00:19:12.390 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:12.390 "adrfam": "ipv4", 00:19:12.390 "trsvcid": "$NVMF_PORT", 00:19:12.390 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:12.390 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:12.390 "hdgst": ${hdgst:-false}, 00:19:12.390 "ddgst": ${ddgst:-false} 00:19:12.390 }, 00:19:12.390 "method": "bdev_nvme_attach_controller" 00:19:12.390 } 00:19:12.390 EOF 00:19:12.390 )") 00:19:12.390 05:03:51 -- nvmf/common.sh@543 -- # cat 00:19:12.390 05:03:51 -- nvmf/common.sh@545 -- # jq . 00:19:12.390 05:03:51 -- nvmf/common.sh@546 -- # IFS=, 00:19:12.390 05:03:51 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:19:12.390 "params": { 00:19:12.390 "name": "Nvme1", 00:19:12.390 "trtype": "tcp", 00:19:12.390 "traddr": "10.0.0.2", 00:19:12.390 "adrfam": "ipv4", 00:19:12.390 "trsvcid": "4420", 00:19:12.390 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:12.390 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:12.390 "hdgst": false, 00:19:12.390 "ddgst": false 00:19:12.390 }, 00:19:12.390 "method": "bdev_nvme_attach_controller" 00:19:12.390 }' 00:19:12.390 [2024-04-23 05:03:51.531473] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:12.390 [2024-04-23 05:03:51.531605] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2410576 ] 00:19:12.648 [2024-04-23 05:03:51.574653] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:12.648 [2024-04-23 05:03:51.594617] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:12.648 [2024-04-23 05:03:51.678507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:12.648 [2024-04-23 05:03:51.678559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:12.649 [2024-04-23 05:03:51.678564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:12.906 I/O targets: 00:19:12.906 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:12.906 00:19:12.906 00:19:12.906 CUnit - A unit testing framework for C - Version 2.1-3 00:19:12.906 http://cunit.sourceforge.net/ 00:19:12.906 00:19:12.906 00:19:12.906 Suite: bdevio tests on: Nvme1n1 00:19:12.906 Test: blockdev write read block ...passed 00:19:12.906 Test: blockdev write zeroes read block ...passed 00:19:12.906 Test: blockdev write zeroes read no split ...passed 00:19:12.906 Test: blockdev write zeroes read split ...passed 00:19:12.906 Test: blockdev write zeroes read split partial ...passed 00:19:12.906 Test: blockdev reset ...[2024-04-23 05:03:52.035937] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:12.906 [2024-04-23 05:03:52.036048] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bbc840 (9): Bad file descriptor 00:19:13.165 [2024-04-23 05:03:52.130265] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:13.165 passed 00:19:13.165 Test: blockdev write read 8 blocks ...passed 00:19:13.165 Test: blockdev write read size > 128k ...passed 00:19:13.165 Test: blockdev write read invalid size ...passed 00:19:13.165 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:13.165 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:13.165 Test: blockdev write read max offset ...passed 00:19:13.165 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:13.165 Test: blockdev writev readv 8 blocks ...passed 00:19:13.425 Test: blockdev writev readv 30 x 1block ...passed 00:19:13.425 Test: blockdev writev readv block ...passed 00:19:13.425 Test: blockdev writev readv size > 128k ...passed 00:19:13.425 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:13.425 Test: blockdev comparev and writev ...[2024-04-23 05:03:52.387225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.387261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.387285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.387302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.387672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.387698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.387719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.387735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.388089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.388112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.388134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.388149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.388507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.388538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.388560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:13.425 [2024-04-23 05:03:52.388575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:13.425 passed 00:19:13.425 Test: blockdev nvme passthru rw ...passed 00:19:13.425 Test: blockdev nvme passthru vendor specific ...[2024-04-23 05:03:52.472818] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:13.425 [2024-04-23 05:03:52.472845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:13.425 [2024-04-23 05:03:52.473011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:13.426 [2024-04-23 05:03:52.473034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:13.426 [2024-04-23 05:03:52.473194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:13.426 [2024-04-23 05:03:52.473217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:13.426 [2024-04-23 05:03:52.473382] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:13.426 [2024-04-23 05:03:52.473406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:13.426 passed 00:19:13.426 Test: blockdev nvme admin passthru ...passed 00:19:13.426 Test: blockdev copy ...passed 00:19:13.426 00:19:13.426 Run Summary: Type Total Ran Passed Failed Inactive 00:19:13.426 suites 1 1 n/a 0 0 00:19:13.426 tests 23 23 23 0 0 00:19:13.426 asserts 152 152 152 0 n/a 00:19:13.426 00:19:13.426 Elapsed time = 1.397 seconds 00:19:13.994 05:03:52 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:13.995 05:03:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:13.995 05:03:52 -- common/autotest_common.sh@10 -- # set +x 00:19:13.995 05:03:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:13.995 05:03:52 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:13.995 05:03:52 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:13.995 05:03:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:13.995 05:03:52 -- nvmf/common.sh@117 -- # sync 00:19:13.995 05:03:52 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:19:13.995 05:03:52 -- nvmf/common.sh@120 -- # set +e 00:19:13.995 05:03:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:13.995 05:03:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:19:13.995 rmmod nvme_tcp 00:19:13.995 rmmod nvme_fabrics 00:19:13.995 rmmod nvme_keyring 00:19:13.995 05:03:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:13.995 05:03:52 -- nvmf/common.sh@124 -- # set -e 00:19:13.995 05:03:52 -- nvmf/common.sh@125 -- # return 0 00:19:13.995 05:03:52 -- nvmf/common.sh@478 -- # '[' -n 2410436 ']' 00:19:13.995 05:03:52 -- nvmf/common.sh@479 -- # killprocess 2410436 00:19:13.995 05:03:52 -- common/autotest_common.sh@936 -- # '[' -z 2410436 ']' 00:19:13.995 05:03:52 -- common/autotest_common.sh@940 -- # kill -0 2410436 00:19:13.995 05:03:52 -- common/autotest_common.sh@941 -- # uname 00:19:13.995 05:03:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:13.995 05:03:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2410436 00:19:13.995 05:03:52 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:13.995 05:03:52 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:13.995 05:03:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2410436' 00:19:13.995 killing process with pid 2410436 00:19:13.995 05:03:52 -- common/autotest_common.sh@955 -- # kill 2410436 00:19:13.995 05:03:52 -- common/autotest_common.sh@960 -- # wait 2410436 00:19:14.254 05:03:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:14.254 05:03:53 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:19:14.254 05:03:53 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:19:14.254 05:03:53 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:14.254 05:03:53 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:19:14.254 05:03:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:14.254 05:03:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:14.254 05:03:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:16.789 05:03:55 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:19:16.789 00:19:16.789 real 0m6.418s 00:19:16.789 user 0m10.506s 00:19:16.789 sys 0m2.540s 00:19:16.789 05:03:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:16.789 05:03:55 -- common/autotest_common.sh@10 -- # set +x 00:19:16.789 ************************************ 00:19:16.789 END TEST nvmf_bdevio_no_huge 00:19:16.789 ************************************ 00:19:16.789 05:03:55 -- nvmf/nvmf.sh@60 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:16.789 05:03:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:16.789 05:03:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:16.789 05:03:55 -- common/autotest_common.sh@10 -- # set +x 00:19:16.789 ************************************ 00:19:16.789 START TEST nvmf_tls 00:19:16.789 ************************************ 00:19:16.789 05:03:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:16.789 * Looking for test storage... 00:19:16.789 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:16.789 05:03:55 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:16.789 05:03:55 -- nvmf/common.sh@7 -- # uname -s 00:19:16.789 05:03:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:16.789 05:03:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:16.789 05:03:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:16.789 05:03:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:16.789 05:03:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:16.789 05:03:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:16.789 05:03:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:16.789 05:03:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:16.789 05:03:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:16.789 05:03:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:16.789 05:03:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:16.789 05:03:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:16.789 05:03:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:16.789 05:03:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:16.789 05:03:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:16.789 05:03:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:16.789 05:03:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:16.789 05:03:55 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:16.789 05:03:55 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:16.789 05:03:55 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:16.789 05:03:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.789 05:03:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.789 05:03:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.789 05:03:55 -- paths/export.sh@5 -- # export PATH 00:19:16.789 05:03:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.789 05:03:55 -- nvmf/common.sh@47 -- # : 0 00:19:16.789 05:03:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:16.789 05:03:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:16.789 05:03:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:16.789 05:03:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:16.789 05:03:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:16.789 05:03:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:16.789 05:03:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:16.789 05:03:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:16.789 05:03:55 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:16.789 05:03:55 -- target/tls.sh@62 -- # nvmftestinit 00:19:16.789 05:03:55 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:19:16.789 05:03:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:16.789 05:03:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:16.789 05:03:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:16.789 05:03:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:16.789 05:03:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:16.789 05:03:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:16.789 05:03:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:16.789 05:03:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:16.789 05:03:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:16.789 05:03:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:16.789 05:03:55 -- common/autotest_common.sh@10 -- # set +x 00:19:18.701 05:03:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:18.701 05:03:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:18.701 05:03:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:18.701 05:03:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:18.701 05:03:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:18.701 05:03:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:18.701 05:03:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:18.701 05:03:57 -- nvmf/common.sh@295 -- # net_devs=() 00:19:18.701 05:03:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:18.701 05:03:57 -- nvmf/common.sh@296 -- # e810=() 00:19:18.701 05:03:57 -- nvmf/common.sh@296 -- # local -ga e810 00:19:18.701 05:03:57 -- nvmf/common.sh@297 -- # x722=() 00:19:18.701 05:03:57 -- nvmf/common.sh@297 -- # local -ga x722 00:19:18.701 05:03:57 -- nvmf/common.sh@298 -- # mlx=() 00:19:18.701 05:03:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:18.701 05:03:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:18.701 05:03:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:18.701 05:03:57 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:18.701 05:03:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:18.701 05:03:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:18.701 05:03:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:18.701 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:18.701 05:03:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:18.701 05:03:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:18.701 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:18.701 05:03:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:18.701 05:03:57 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:18.701 05:03:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.701 05:03:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:18.701 05:03:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.701 05:03:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:18.701 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:18.701 05:03:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.701 05:03:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:18.701 05:03:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.701 05:03:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:18.701 05:03:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.701 05:03:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:18.701 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:18.701 05:03:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.701 05:03:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:18.701 05:03:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:18.701 05:03:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:19:18.701 05:03:57 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:19:18.701 05:03:57 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:18.701 05:03:57 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:18.701 05:03:57 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:18.701 05:03:57 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:19:18.701 05:03:57 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:18.701 05:03:57 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:18.701 05:03:57 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:19:18.701 05:03:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:18.702 05:03:57 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:18.702 05:03:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:19:18.702 05:03:57 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:19:18.702 05:03:57 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:19:18.702 05:03:57 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:18.702 05:03:57 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:18.702 05:03:57 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:18.702 05:03:57 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:19:18.702 05:03:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:18.702 05:03:57 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:18.702 05:03:57 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:18.702 05:03:57 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:19:18.702 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:18.702 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.253 ms 00:19:18.702 00:19:18.702 --- 10.0.0.2 ping statistics --- 00:19:18.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:18.702 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:19:18.702 05:03:57 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:18.702 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:18.702 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:19:18.702 00:19:18.702 --- 10.0.0.1 ping statistics --- 00:19:18.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:18.702 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:19:18.702 05:03:57 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:18.702 05:03:57 -- nvmf/common.sh@411 -- # return 0 00:19:18.702 05:03:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:18.702 05:03:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:18.702 05:03:57 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:19:18.702 05:03:57 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:19:18.702 05:03:57 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:18.702 05:03:57 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:19:18.702 05:03:57 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:19:18.702 05:03:57 -- target/tls.sh@63 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:18.702 05:03:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:18.702 05:03:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:18.702 05:03:57 -- common/autotest_common.sh@10 -- # set +x 00:19:18.702 05:03:57 -- nvmf/common.sh@470 -- # nvmfpid=2412656 00:19:18.702 05:03:57 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:18.702 05:03:57 -- nvmf/common.sh@471 -- # waitforlisten 2412656 00:19:18.702 05:03:57 -- common/autotest_common.sh@817 -- # '[' -z 2412656 ']' 00:19:18.702 05:03:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:18.702 05:03:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:18.702 05:03:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:18.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:18.702 05:03:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:18.702 05:03:57 -- common/autotest_common.sh@10 -- # set +x 00:19:18.702 [2024-04-23 05:03:57.685660] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:18.702 [2024-04-23 05:03:57.685761] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:18.702 EAL: No free 2048 kB hugepages reported on node 1 00:19:18.702 [2024-04-23 05:03:57.725187] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:18.702 [2024-04-23 05:03:57.755538] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:18.702 [2024-04-23 05:03:57.848047] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:18.702 [2024-04-23 05:03:57.848120] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:18.702 [2024-04-23 05:03:57.848150] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:18.702 [2024-04-23 05:03:57.848161] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:18.702 [2024-04-23 05:03:57.848171] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:18.702 [2024-04-23 05:03:57.848206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:18.961 05:03:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:18.961 05:03:57 -- common/autotest_common.sh@850 -- # return 0 00:19:18.961 05:03:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:18.961 05:03:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:18.961 05:03:57 -- common/autotest_common.sh@10 -- # set +x 00:19:18.961 05:03:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:18.961 05:03:57 -- target/tls.sh@65 -- # '[' tcp '!=' tcp ']' 00:19:18.961 05:03:57 -- target/tls.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:19.220 true 00:19:19.220 05:03:58 -- target/tls.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:19.220 05:03:58 -- target/tls.sh@73 -- # jq -r .tls_version 00:19:19.479 05:03:58 -- target/tls.sh@73 -- # version=0 00:19:19.479 05:03:58 -- target/tls.sh@74 -- # [[ 0 != \0 ]] 00:19:19.479 05:03:58 -- target/tls.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:19.738 05:03:58 -- target/tls.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:19.738 05:03:58 -- target/tls.sh@81 -- # jq -r .tls_version 00:19:19.998 05:03:58 -- target/tls.sh@81 -- # version=13 00:19:19.998 05:03:58 -- target/tls.sh@82 -- # [[ 13 != \1\3 ]] 00:19:19.998 05:03:58 -- target/tls.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:20.257 05:03:59 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:20.257 05:03:59 -- target/tls.sh@89 -- # jq -r .tls_version 00:19:20.516 05:03:59 -- target/tls.sh@89 -- # version=7 00:19:20.516 05:03:59 -- target/tls.sh@90 -- # [[ 7 != \7 ]] 00:19:20.516 05:03:59 -- target/tls.sh@96 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:20.516 05:03:59 -- target/tls.sh@96 -- # jq -r .enable_ktls 00:19:20.516 05:03:59 -- target/tls.sh@96 -- # ktls=false 00:19:20.516 05:03:59 -- target/tls.sh@97 -- # [[ false != \f\a\l\s\e ]] 00:19:20.516 05:03:59 -- target/tls.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:20.773 05:03:59 -- target/tls.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:20.773 05:03:59 -- target/tls.sh@104 -- # jq -r .enable_ktls 00:19:21.031 05:04:00 -- target/tls.sh@104 -- # ktls=true 00:19:21.031 05:04:00 -- target/tls.sh@105 -- # [[ true != \t\r\u\e ]] 00:19:21.031 05:04:00 -- target/tls.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:21.288 05:04:00 -- target/tls.sh@112 -- # jq -r .enable_ktls 00:19:21.289 05:04:00 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:21.546 05:04:00 -- target/tls.sh@112 -- # ktls=false 00:19:21.546 05:04:00 -- target/tls.sh@113 -- # [[ false != \f\a\l\s\e ]] 00:19:21.546 05:04:00 -- target/tls.sh@118 -- # format_interchange_psk 00112233445566778899aabbccddeeff 1 00:19:21.546 05:04:00 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 1 00:19:21.546 05:04:00 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:21.546 05:04:00 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:19:21.546 05:04:00 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff 00:19:21.546 05:04:00 -- nvmf/common.sh@693 -- # digest=1 00:19:21.546 05:04:00 -- nvmf/common.sh@694 -- # python - 00:19:21.834 05:04:00 -- target/tls.sh@118 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:21.834 05:04:00 -- target/tls.sh@119 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 1 00:19:21.834 05:04:00 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 ffeeddccbbaa99887766554433221100 1 00:19:21.834 05:04:00 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:21.834 05:04:00 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:19:21.834 05:04:00 -- nvmf/common.sh@693 -- # key=ffeeddccbbaa99887766554433221100 00:19:21.834 05:04:00 -- nvmf/common.sh@693 -- # digest=1 00:19:21.834 05:04:00 -- nvmf/common.sh@694 -- # python - 00:19:21.834 05:04:00 -- target/tls.sh@119 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:21.834 05:04:00 -- target/tls.sh@121 -- # mktemp 00:19:21.834 05:04:00 -- target/tls.sh@121 -- # key_path=/tmp/tmp.pNonMghSiZ 00:19:21.834 05:04:00 -- target/tls.sh@122 -- # mktemp 00:19:21.834 05:04:00 -- target/tls.sh@122 -- # key_2_path=/tmp/tmp.Z29ePglaXD 00:19:21.834 05:04:00 -- target/tls.sh@124 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:21.834 05:04:00 -- target/tls.sh@125 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:21.834 05:04:00 -- target/tls.sh@127 -- # chmod 0600 /tmp/tmp.pNonMghSiZ 00:19:21.834 05:04:00 -- target/tls.sh@128 -- # chmod 0600 /tmp/tmp.Z29ePglaXD 00:19:21.834 05:04:00 -- target/tls.sh@130 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:22.095 05:04:01 -- target/tls.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:22.352 05:04:01 -- target/tls.sh@133 -- # setup_nvmf_tgt /tmp/tmp.pNonMghSiZ 00:19:22.352 05:04:01 -- target/tls.sh@49 -- # local key=/tmp/tmp.pNonMghSiZ 00:19:22.352 05:04:01 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:22.610 [2024-04-23 05:04:01.686897] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:22.610 05:04:01 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:22.867 05:04:01 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:23.125 [2024-04-23 05:04:02.196266] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:23.125 [2024-04-23 05:04:02.196545] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:23.125 05:04:02 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:23.381 malloc0 00:19:23.381 05:04:02 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:23.640 05:04:02 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.pNonMghSiZ 00:19:23.898 [2024-04-23 05:04:03.042108] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:19:23.898 05:04:03 -- target/tls.sh@137 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /tmp/tmp.pNonMghSiZ 00:19:24.156 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.136 Initializing NVMe Controllers 00:19:34.136 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:34.136 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:34.136 Initialization complete. Launching workers. 00:19:34.136 ======================================================== 00:19:34.136 Latency(us) 00:19:34.136 Device Information : IOPS MiB/s Average min max 00:19:34.136 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7618.18 29.76 8403.36 1333.92 9228.19 00:19:34.136 ======================================================== 00:19:34.136 Total : 7618.18 29.76 8403.36 1333.92 9228.19 00:19:34.136 00:19:34.136 05:04:13 -- target/tls.sh@143 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.pNonMghSiZ 00:19:34.136 05:04:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:34.136 05:04:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:34.136 05:04:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:34.136 05:04:13 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.pNonMghSiZ' 00:19:34.136 05:04:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:34.136 05:04:13 -- target/tls.sh@28 -- # bdevperf_pid=2414545 00:19:34.136 05:04:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:34.136 05:04:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:34.137 05:04:13 -- target/tls.sh@31 -- # waitforlisten 2414545 /var/tmp/bdevperf.sock 00:19:34.137 05:04:13 -- common/autotest_common.sh@817 -- # '[' -z 2414545 ']' 00:19:34.137 05:04:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:34.137 05:04:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:34.137 05:04:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:34.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:34.137 05:04:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:34.137 05:04:13 -- common/autotest_common.sh@10 -- # set +x 00:19:34.137 [2024-04-23 05:04:13.202783] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:34.137 [2024-04-23 05:04:13.202865] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2414545 ] 00:19:34.137 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.137 [2024-04-23 05:04:13.233533] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:34.137 [2024-04-23 05:04:13.260877] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:34.394 [2024-04-23 05:04:13.345363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:34.394 05:04:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:34.394 05:04:13 -- common/autotest_common.sh@850 -- # return 0 00:19:34.394 05:04:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.pNonMghSiZ 00:19:34.651 [2024-04-23 05:04:13.672621] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:34.651 [2024-04-23 05:04:13.672755] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:19:34.651 TLSTESTn1 00:19:34.651 05:04:13 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:34.909 Running I/O for 10 seconds... 00:19:44.893 00:19:44.893 Latency(us) 00:19:44.893 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:44.893 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:44.893 Verification LBA range: start 0x0 length 0x2000 00:19:44.893 TLSTESTn1 : 10.03 3627.98 14.17 0.00 0.00 35211.83 10582.85 55147.33 00:19:44.893 =================================================================================================================== 00:19:44.893 Total : 3627.98 14.17 0.00 0.00 35211.83 10582.85 55147.33 00:19:44.893 0 00:19:44.893 05:04:23 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:44.893 05:04:23 -- target/tls.sh@45 -- # killprocess 2414545 00:19:44.893 05:04:23 -- common/autotest_common.sh@936 -- # '[' -z 2414545 ']' 00:19:44.893 05:04:23 -- common/autotest_common.sh@940 -- # kill -0 2414545 00:19:44.893 05:04:23 -- common/autotest_common.sh@941 -- # uname 00:19:44.893 05:04:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:44.893 05:04:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2414545 00:19:44.893 05:04:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:44.893 05:04:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:44.893 05:04:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2414545' 00:19:44.893 killing process with pid 2414545 00:19:44.893 05:04:23 -- common/autotest_common.sh@955 -- # kill 2414545 00:19:44.893 Received shutdown signal, test time was about 10.000000 seconds 00:19:44.893 00:19:44.893 Latency(us) 00:19:44.893 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:44.893 =================================================================================================================== 00:19:44.893 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:44.893 [2024-04-23 05:04:23.970330] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:19:44.893 05:04:23 -- common/autotest_common.sh@960 -- # wait 2414545 00:19:45.152 05:04:24 -- target/tls.sh@146 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.Z29ePglaXD 00:19:45.152 05:04:24 -- common/autotest_common.sh@638 -- # local es=0 00:19:45.152 05:04:24 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.Z29ePglaXD 00:19:45.152 05:04:24 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:19:45.152 05:04:24 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:45.152 05:04:24 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:19:45.152 05:04:24 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:45.152 05:04:24 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.Z29ePglaXD 00:19:45.152 05:04:24 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:45.152 05:04:24 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:45.152 05:04:24 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:45.152 05:04:24 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.Z29ePglaXD' 00:19:45.152 05:04:24 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:45.152 05:04:24 -- target/tls.sh@28 -- # bdevperf_pid=2415746 00:19:45.152 05:04:24 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:45.152 05:04:24 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:45.152 05:04:24 -- target/tls.sh@31 -- # waitforlisten 2415746 /var/tmp/bdevperf.sock 00:19:45.152 05:04:24 -- common/autotest_common.sh@817 -- # '[' -z 2415746 ']' 00:19:45.152 05:04:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:45.152 05:04:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:45.152 05:04:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:45.152 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:45.152 05:04:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:45.152 05:04:24 -- common/autotest_common.sh@10 -- # set +x 00:19:45.152 [2024-04-23 05:04:24.239856] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:45.152 [2024-04-23 05:04:24.239926] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2415746 ] 00:19:45.152 EAL: No free 2048 kB hugepages reported on node 1 00:19:45.152 [2024-04-23 05:04:24.271327] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:45.152 [2024-04-23 05:04:24.297863] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:45.411 [2024-04-23 05:04:24.377421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:45.411 05:04:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:45.411 05:04:24 -- common/autotest_common.sh@850 -- # return 0 00:19:45.411 05:04:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Z29ePglaXD 00:19:45.670 [2024-04-23 05:04:24.717910] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:45.670 [2024-04-23 05:04:24.718049] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:19:45.670 [2024-04-23 05:04:24.729602] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:45.670 [2024-04-23 05:04:24.729941] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20193b0 (107): Transport endpoint is not connected 00:19:45.670 [2024-04-23 05:04:24.730929] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20193b0 (9): Bad file descriptor 00:19:45.670 [2024-04-23 05:04:24.731927] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:45.670 [2024-04-23 05:04:24.731945] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:45.670 [2024-04-23 05:04:24.731972] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:45.670 request: 00:19:45.670 { 00:19:45.670 "name": "TLSTEST", 00:19:45.670 "trtype": "tcp", 00:19:45.670 "traddr": "10.0.0.2", 00:19:45.670 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:45.670 "adrfam": "ipv4", 00:19:45.670 "trsvcid": "4420", 00:19:45.670 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:45.670 "psk": "/tmp/tmp.Z29ePglaXD", 00:19:45.670 "method": "bdev_nvme_attach_controller", 00:19:45.670 "req_id": 1 00:19:45.670 } 00:19:45.670 Got JSON-RPC error response 00:19:45.670 response: 00:19:45.670 { 00:19:45.670 "code": -32602, 00:19:45.670 "message": "Invalid parameters" 00:19:45.670 } 00:19:45.670 05:04:24 -- target/tls.sh@36 -- # killprocess 2415746 00:19:45.670 05:04:24 -- common/autotest_common.sh@936 -- # '[' -z 2415746 ']' 00:19:45.670 05:04:24 -- common/autotest_common.sh@940 -- # kill -0 2415746 00:19:45.670 05:04:24 -- common/autotest_common.sh@941 -- # uname 00:19:45.670 05:04:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:45.670 05:04:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2415746 00:19:45.670 05:04:24 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:45.671 05:04:24 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:45.671 05:04:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2415746' 00:19:45.671 killing process with pid 2415746 00:19:45.671 05:04:24 -- common/autotest_common.sh@955 -- # kill 2415746 00:19:45.671 Received shutdown signal, test time was about 10.000000 seconds 00:19:45.671 00:19:45.671 Latency(us) 00:19:45.671 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:45.671 =================================================================================================================== 00:19:45.671 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:45.671 [2024-04-23 05:04:24.773702] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:19:45.671 05:04:24 -- common/autotest_common.sh@960 -- # wait 2415746 00:19:45.929 05:04:24 -- target/tls.sh@37 -- # return 1 00:19:45.929 05:04:24 -- common/autotest_common.sh@641 -- # es=1 00:19:45.929 05:04:24 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:19:45.929 05:04:24 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:19:45.929 05:04:24 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:19:45.929 05:04:24 -- target/tls.sh@149 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.pNonMghSiZ 00:19:45.929 05:04:24 -- common/autotest_common.sh@638 -- # local es=0 00:19:45.929 05:04:24 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.pNonMghSiZ 00:19:45.929 05:04:24 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:19:45.929 05:04:24 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:45.929 05:04:24 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:19:45.929 05:04:24 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:45.929 05:04:24 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.pNonMghSiZ 00:19:45.929 05:04:24 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:45.929 05:04:24 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:45.929 05:04:24 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:19:45.929 05:04:24 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.pNonMghSiZ' 00:19:45.929 05:04:24 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:45.929 05:04:24 -- target/tls.sh@28 -- # bdevperf_pid=2415885 00:19:45.929 05:04:24 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:45.929 05:04:24 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:45.929 05:04:24 -- target/tls.sh@31 -- # waitforlisten 2415885 /var/tmp/bdevperf.sock 00:19:45.929 05:04:24 -- common/autotest_common.sh@817 -- # '[' -z 2415885 ']' 00:19:45.929 05:04:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:45.929 05:04:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:45.929 05:04:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:45.929 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:45.929 05:04:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:45.929 05:04:24 -- common/autotest_common.sh@10 -- # set +x 00:19:45.929 [2024-04-23 05:04:25.004586] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:45.929 [2024-04-23 05:04:25.004660] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2415885 ] 00:19:45.929 EAL: No free 2048 kB hugepages reported on node 1 00:19:45.929 [2024-04-23 05:04:25.036386] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:45.929 [2024-04-23 05:04:25.063645] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:46.188 [2024-04-23 05:04:25.148397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:46.188 05:04:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:46.188 05:04:25 -- common/autotest_common.sh@850 -- # return 0 00:19:46.188 05:04:25 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /tmp/tmp.pNonMghSiZ 00:19:46.446 [2024-04-23 05:04:25.467044] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:46.446 [2024-04-23 05:04:25.467176] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:19:46.446 [2024-04-23 05:04:25.472394] tcp.c: 878:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:19:46.446 [2024-04-23 05:04:25.472425] posix.c: 588:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:19:46.446 [2024-04-23 05:04:25.472480] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:46.446 [2024-04-23 05:04:25.473024] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9913b0 (107): Transport endpoint is not connected 00:19:46.446 [2024-04-23 05:04:25.474010] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9913b0 (9): Bad file descriptor 00:19:46.446 [2024-04-23 05:04:25.475010] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:46.446 [2024-04-23 05:04:25.475030] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:46.446 [2024-04-23 05:04:25.475058] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:46.446 request: 00:19:46.446 { 00:19:46.446 "name": "TLSTEST", 00:19:46.446 "trtype": "tcp", 00:19:46.446 "traddr": "10.0.0.2", 00:19:46.446 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:19:46.446 "adrfam": "ipv4", 00:19:46.446 "trsvcid": "4420", 00:19:46.446 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:46.446 "psk": "/tmp/tmp.pNonMghSiZ", 00:19:46.446 "method": "bdev_nvme_attach_controller", 00:19:46.446 "req_id": 1 00:19:46.446 } 00:19:46.446 Got JSON-RPC error response 00:19:46.446 response: 00:19:46.446 { 00:19:46.446 "code": -32602, 00:19:46.446 "message": "Invalid parameters" 00:19:46.446 } 00:19:46.446 05:04:25 -- target/tls.sh@36 -- # killprocess 2415885 00:19:46.446 05:04:25 -- common/autotest_common.sh@936 -- # '[' -z 2415885 ']' 00:19:46.446 05:04:25 -- common/autotest_common.sh@940 -- # kill -0 2415885 00:19:46.446 05:04:25 -- common/autotest_common.sh@941 -- # uname 00:19:46.446 05:04:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:46.446 05:04:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2415885 00:19:46.446 05:04:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:46.446 05:04:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:46.446 05:04:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2415885' 00:19:46.446 killing process with pid 2415885 00:19:46.446 05:04:25 -- common/autotest_common.sh@955 -- # kill 2415885 00:19:46.446 Received shutdown signal, test time was about 10.000000 seconds 00:19:46.446 00:19:46.446 Latency(us) 00:19:46.446 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:46.446 =================================================================================================================== 00:19:46.446 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:46.446 [2024-04-23 05:04:25.525073] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:19:46.446 05:04:25 -- common/autotest_common.sh@960 -- # wait 2415885 00:19:46.705 05:04:25 -- target/tls.sh@37 -- # return 1 00:19:46.705 05:04:25 -- common/autotest_common.sh@641 -- # es=1 00:19:46.705 05:04:25 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:19:46.705 05:04:25 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:19:46.705 05:04:25 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:19:46.705 05:04:25 -- target/tls.sh@152 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.pNonMghSiZ 00:19:46.705 05:04:25 -- common/autotest_common.sh@638 -- # local es=0 00:19:46.705 05:04:25 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.pNonMghSiZ 00:19:46.705 05:04:25 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:19:46.705 05:04:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:46.705 05:04:25 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:19:46.705 05:04:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:46.705 05:04:25 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.pNonMghSiZ 00:19:46.705 05:04:25 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:46.705 05:04:25 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:19:46.705 05:04:25 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:46.705 05:04:25 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.pNonMghSiZ' 00:19:46.705 05:04:25 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:46.705 05:04:25 -- target/tls.sh@28 -- # bdevperf_pid=2416018 00:19:46.705 05:04:25 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:46.705 05:04:25 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:46.705 05:04:25 -- target/tls.sh@31 -- # waitforlisten 2416018 /var/tmp/bdevperf.sock 00:19:46.705 05:04:25 -- common/autotest_common.sh@817 -- # '[' -z 2416018 ']' 00:19:46.705 05:04:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:46.705 05:04:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:46.705 05:04:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:46.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:46.705 05:04:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:46.705 05:04:25 -- common/autotest_common.sh@10 -- # set +x 00:19:46.705 [2024-04-23 05:04:25.778902] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:46.705 [2024-04-23 05:04:25.778974] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2416018 ] 00:19:46.705 EAL: No free 2048 kB hugepages reported on node 1 00:19:46.705 [2024-04-23 05:04:25.810095] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:46.705 [2024-04-23 05:04:25.836777] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:46.964 [2024-04-23 05:04:25.915739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:46.964 05:04:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:46.964 05:04:26 -- common/autotest_common.sh@850 -- # return 0 00:19:46.964 05:04:26 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.pNonMghSiZ 00:19:47.224 [2024-04-23 05:04:26.240946] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:47.224 [2024-04-23 05:04:26.241056] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:19:47.224 [2024-04-23 05:04:26.246220] tcp.c: 878:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:19:47.224 [2024-04-23 05:04:26.246251] posix.c: 588:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:19:47.224 [2024-04-23 05:04:26.246289] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:47.224 [2024-04-23 05:04:26.246859] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c8b3b0 (107): Transport endpoint is not connected 00:19:47.224 [2024-04-23 05:04:26.247847] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c8b3b0 (9): Bad file descriptor 00:19:47.224 [2024-04-23 05:04:26.248846] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:19:47.224 [2024-04-23 05:04:26.248867] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:47.224 [2024-04-23 05:04:26.248881] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:19:47.224 request: 00:19:47.224 { 00:19:47.224 "name": "TLSTEST", 00:19:47.224 "trtype": "tcp", 00:19:47.224 "traddr": "10.0.0.2", 00:19:47.224 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:47.224 "adrfam": "ipv4", 00:19:47.224 "trsvcid": "4420", 00:19:47.224 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:19:47.224 "psk": "/tmp/tmp.pNonMghSiZ", 00:19:47.224 "method": "bdev_nvme_attach_controller", 00:19:47.224 "req_id": 1 00:19:47.224 } 00:19:47.224 Got JSON-RPC error response 00:19:47.224 response: 00:19:47.224 { 00:19:47.224 "code": -32602, 00:19:47.224 "message": "Invalid parameters" 00:19:47.224 } 00:19:47.224 05:04:26 -- target/tls.sh@36 -- # killprocess 2416018 00:19:47.224 05:04:26 -- common/autotest_common.sh@936 -- # '[' -z 2416018 ']' 00:19:47.224 05:04:26 -- common/autotest_common.sh@940 -- # kill -0 2416018 00:19:47.224 05:04:26 -- common/autotest_common.sh@941 -- # uname 00:19:47.224 05:04:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:47.224 05:04:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2416018 00:19:47.224 05:04:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:47.224 05:04:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:47.224 05:04:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2416018' 00:19:47.224 killing process with pid 2416018 00:19:47.224 05:04:26 -- common/autotest_common.sh@955 -- # kill 2416018 00:19:47.224 Received shutdown signal, test time was about 10.000000 seconds 00:19:47.224 00:19:47.224 Latency(us) 00:19:47.224 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:47.224 =================================================================================================================== 00:19:47.224 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:47.224 [2024-04-23 05:04:26.300927] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:19:47.224 05:04:26 -- common/autotest_common.sh@960 -- # wait 2416018 00:19:47.483 05:04:26 -- target/tls.sh@37 -- # return 1 00:19:47.483 05:04:26 -- common/autotest_common.sh@641 -- # es=1 00:19:47.483 05:04:26 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:19:47.483 05:04:26 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:19:47.483 05:04:26 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:19:47.483 05:04:26 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:47.483 05:04:26 -- common/autotest_common.sh@638 -- # local es=0 00:19:47.483 05:04:26 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:47.483 05:04:26 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:19:47.483 05:04:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:47.483 05:04:26 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:19:47.483 05:04:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:47.483 05:04:26 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:47.483 05:04:26 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:47.483 05:04:26 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:47.483 05:04:26 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:47.483 05:04:26 -- target/tls.sh@23 -- # psk= 00:19:47.483 05:04:26 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:47.483 05:04:26 -- target/tls.sh@28 -- # bdevperf_pid=2416042 00:19:47.483 05:04:26 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:47.483 05:04:26 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:47.483 05:04:26 -- target/tls.sh@31 -- # waitforlisten 2416042 /var/tmp/bdevperf.sock 00:19:47.483 05:04:26 -- common/autotest_common.sh@817 -- # '[' -z 2416042 ']' 00:19:47.483 05:04:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:47.483 05:04:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:47.483 05:04:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:47.483 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:47.483 05:04:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:47.483 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:19:47.483 [2024-04-23 05:04:26.566457] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:47.483 [2024-04-23 05:04:26.566549] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2416042 ] 00:19:47.483 EAL: No free 2048 kB hugepages reported on node 1 00:19:47.483 [2024-04-23 05:04:26.597687] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:47.483 [2024-04-23 05:04:26.625215] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:47.742 [2024-04-23 05:04:26.711489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:47.742 05:04:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:47.742 05:04:26 -- common/autotest_common.sh@850 -- # return 0 00:19:47.742 05:04:26 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:19:48.000 [2024-04-23 05:04:27.035959] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:48.000 [2024-04-23 05:04:27.037843] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xedb9c0 (9): Bad file descriptor 00:19:48.000 [2024-04-23 05:04:27.038836] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:48.000 [2024-04-23 05:04:27.038857] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:48.000 [2024-04-23 05:04:27.038870] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:48.000 request: 00:19:48.000 { 00:19:48.000 "name": "TLSTEST", 00:19:48.000 "trtype": "tcp", 00:19:48.000 "traddr": "10.0.0.2", 00:19:48.000 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:48.000 "adrfam": "ipv4", 00:19:48.000 "trsvcid": "4420", 00:19:48.000 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:48.000 "method": "bdev_nvme_attach_controller", 00:19:48.000 "req_id": 1 00:19:48.000 } 00:19:48.000 Got JSON-RPC error response 00:19:48.000 response: 00:19:48.000 { 00:19:48.000 "code": -32602, 00:19:48.000 "message": "Invalid parameters" 00:19:48.000 } 00:19:48.000 05:04:27 -- target/tls.sh@36 -- # killprocess 2416042 00:19:48.000 05:04:27 -- common/autotest_common.sh@936 -- # '[' -z 2416042 ']' 00:19:48.000 05:04:27 -- common/autotest_common.sh@940 -- # kill -0 2416042 00:19:48.000 05:04:27 -- common/autotest_common.sh@941 -- # uname 00:19:48.000 05:04:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:48.000 05:04:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2416042 00:19:48.000 05:04:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:48.000 05:04:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:48.000 05:04:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2416042' 00:19:48.000 killing process with pid 2416042 00:19:48.000 05:04:27 -- common/autotest_common.sh@955 -- # kill 2416042 00:19:48.000 Received shutdown signal, test time was about 10.000000 seconds 00:19:48.000 00:19:48.000 Latency(us) 00:19:48.000 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:48.000 =================================================================================================================== 00:19:48.000 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:48.000 05:04:27 -- common/autotest_common.sh@960 -- # wait 2416042 00:19:48.258 05:04:27 -- target/tls.sh@37 -- # return 1 00:19:48.258 05:04:27 -- common/autotest_common.sh@641 -- # es=1 00:19:48.258 05:04:27 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:19:48.258 05:04:27 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:19:48.258 05:04:27 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:19:48.258 05:04:27 -- target/tls.sh@158 -- # killprocess 2412656 00:19:48.258 05:04:27 -- common/autotest_common.sh@936 -- # '[' -z 2412656 ']' 00:19:48.258 05:04:27 -- common/autotest_common.sh@940 -- # kill -0 2412656 00:19:48.258 05:04:27 -- common/autotest_common.sh@941 -- # uname 00:19:48.258 05:04:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:48.258 05:04:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2412656 00:19:48.258 05:04:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:48.258 05:04:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:48.258 05:04:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2412656' 00:19:48.258 killing process with pid 2412656 00:19:48.258 05:04:27 -- common/autotest_common.sh@955 -- # kill 2412656 00:19:48.258 [2024-04-23 05:04:27.325415] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:19:48.258 05:04:27 -- common/autotest_common.sh@960 -- # wait 2412656 00:19:48.517 05:04:27 -- target/tls.sh@159 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 2 00:19:48.517 05:04:27 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff0011223344556677 2 00:19:48.517 05:04:27 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:48.517 05:04:27 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:19:48.517 05:04:27 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:19:48.517 05:04:27 -- nvmf/common.sh@693 -- # digest=2 00:19:48.517 05:04:27 -- nvmf/common.sh@694 -- # python - 00:19:48.517 05:04:27 -- target/tls.sh@159 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:48.517 05:04:27 -- target/tls.sh@160 -- # mktemp 00:19:48.517 05:04:27 -- target/tls.sh@160 -- # key_long_path=/tmp/tmp.nafEgLW9h1 00:19:48.517 05:04:27 -- target/tls.sh@161 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:48.517 05:04:27 -- target/tls.sh@162 -- # chmod 0600 /tmp/tmp.nafEgLW9h1 00:19:48.517 05:04:27 -- target/tls.sh@163 -- # nvmfappstart -m 0x2 00:19:48.517 05:04:27 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:48.517 05:04:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:48.517 05:04:27 -- common/autotest_common.sh@10 -- # set +x 00:19:48.517 05:04:27 -- nvmf/common.sh@470 -- # nvmfpid=2416190 00:19:48.517 05:04:27 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:48.517 05:04:27 -- nvmf/common.sh@471 -- # waitforlisten 2416190 00:19:48.517 05:04:27 -- common/autotest_common.sh@817 -- # '[' -z 2416190 ']' 00:19:48.517 05:04:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:48.517 05:04:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:48.517 05:04:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:48.517 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:48.517 05:04:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:48.517 05:04:27 -- common/autotest_common.sh@10 -- # set +x 00:19:48.517 [2024-04-23 05:04:27.678904] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:48.517 [2024-04-23 05:04:27.678981] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:48.777 EAL: No free 2048 kB hugepages reported on node 1 00:19:48.777 [2024-04-23 05:04:27.716551] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:48.777 [2024-04-23 05:04:27.748757] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:48.777 [2024-04-23 05:04:27.836925] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:48.777 [2024-04-23 05:04:27.836996] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:48.777 [2024-04-23 05:04:27.837012] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:48.777 [2024-04-23 05:04:27.837026] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:48.777 [2024-04-23 05:04:27.837037] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:48.777 [2024-04-23 05:04:27.837076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:49.036 05:04:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:49.036 05:04:27 -- common/autotest_common.sh@850 -- # return 0 00:19:49.036 05:04:27 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:49.036 05:04:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:49.036 05:04:27 -- common/autotest_common.sh@10 -- # set +x 00:19:49.036 05:04:27 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:49.036 05:04:27 -- target/tls.sh@165 -- # setup_nvmf_tgt /tmp/tmp.nafEgLW9h1 00:19:49.036 05:04:27 -- target/tls.sh@49 -- # local key=/tmp/tmp.nafEgLW9h1 00:19:49.036 05:04:27 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:49.036 [2024-04-23 05:04:28.189637] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:49.294 05:04:28 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:49.294 05:04:28 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:49.552 [2024-04-23 05:04:28.662906] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:49.552 [2024-04-23 05:04:28.663188] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:49.552 05:04:28 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:49.810 malloc0 00:19:49.810 05:04:28 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:50.068 05:04:29 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.nafEgLW9h1 00:19:50.326 [2024-04-23 05:04:29.385094] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:19:50.326 05:04:29 -- target/tls.sh@167 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.nafEgLW9h1 00:19:50.326 05:04:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:50.326 05:04:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:50.326 05:04:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:50.326 05:04:29 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.nafEgLW9h1' 00:19:50.326 05:04:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:50.326 05:04:29 -- target/tls.sh@28 -- # bdevperf_pid=2416462 00:19:50.326 05:04:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:50.326 05:04:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:50.326 05:04:29 -- target/tls.sh@31 -- # waitforlisten 2416462 /var/tmp/bdevperf.sock 00:19:50.326 05:04:29 -- common/autotest_common.sh@817 -- # '[' -z 2416462 ']' 00:19:50.326 05:04:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:50.326 05:04:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:50.326 05:04:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:50.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:50.326 05:04:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:50.326 05:04:29 -- common/autotest_common.sh@10 -- # set +x 00:19:50.326 [2024-04-23 05:04:29.448471] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:19:50.326 [2024-04-23 05:04:29.448549] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2416462 ] 00:19:50.326 EAL: No free 2048 kB hugepages reported on node 1 00:19:50.327 [2024-04-23 05:04:29.480118] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:19:50.585 [2024-04-23 05:04:29.508238] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:50.585 [2024-04-23 05:04:29.593942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:50.585 05:04:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:50.585 05:04:29 -- common/autotest_common.sh@850 -- # return 0 00:19:50.585 05:04:29 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.nafEgLW9h1 00:19:50.843 [2024-04-23 05:04:29.920067] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:50.843 [2024-04-23 05:04:29.920185] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:19:50.843 TLSTESTn1 00:19:51.101 05:04:30 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:51.102 Running I/O for 10 seconds... 00:20:01.099 00:20:01.099 Latency(us) 00:20:01.099 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:01.099 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:01.099 Verification LBA range: start 0x0 length 0x2000 00:20:01.099 TLSTESTn1 : 10.03 2903.45 11.34 0.00 0.00 44010.79 7281.78 59419.31 00:20:01.099 =================================================================================================================== 00:20:01.099 Total : 2903.45 11.34 0.00 0.00 44010.79 7281.78 59419.31 00:20:01.099 0 00:20:01.099 05:04:40 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:01.099 05:04:40 -- target/tls.sh@45 -- # killprocess 2416462 00:20:01.099 05:04:40 -- common/autotest_common.sh@936 -- # '[' -z 2416462 ']' 00:20:01.099 05:04:40 -- common/autotest_common.sh@940 -- # kill -0 2416462 00:20:01.099 05:04:40 -- common/autotest_common.sh@941 -- # uname 00:20:01.099 05:04:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:01.099 05:04:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2416462 00:20:01.099 05:04:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:01.099 05:04:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:01.099 05:04:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2416462' 00:20:01.099 killing process with pid 2416462 00:20:01.099 05:04:40 -- common/autotest_common.sh@955 -- # kill 2416462 00:20:01.099 Received shutdown signal, test time was about 10.000000 seconds 00:20:01.099 00:20:01.099 Latency(us) 00:20:01.099 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:01.099 =================================================================================================================== 00:20:01.099 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:01.099 [2024-04-23 05:04:40.226048] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:20:01.099 05:04:40 -- common/autotest_common.sh@960 -- # wait 2416462 00:20:01.357 05:04:40 -- target/tls.sh@170 -- # chmod 0666 /tmp/tmp.nafEgLW9h1 00:20:01.357 05:04:40 -- target/tls.sh@171 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.nafEgLW9h1 00:20:01.357 05:04:40 -- common/autotest_common.sh@638 -- # local es=0 00:20:01.357 05:04:40 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.nafEgLW9h1 00:20:01.357 05:04:40 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:20:01.357 05:04:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:01.357 05:04:40 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:20:01.357 05:04:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:01.357 05:04:40 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.nafEgLW9h1 00:20:01.357 05:04:40 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:01.357 05:04:40 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:01.357 05:04:40 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:01.357 05:04:40 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.nafEgLW9h1' 00:20:01.357 05:04:40 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:01.357 05:04:40 -- target/tls.sh@28 -- # bdevperf_pid=2417784 00:20:01.357 05:04:40 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:01.357 05:04:40 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:01.357 05:04:40 -- target/tls.sh@31 -- # waitforlisten 2417784 /var/tmp/bdevperf.sock 00:20:01.357 05:04:40 -- common/autotest_common.sh@817 -- # '[' -z 2417784 ']' 00:20:01.357 05:04:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:01.357 05:04:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:01.357 05:04:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:01.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:01.357 05:04:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:01.357 05:04:40 -- common/autotest_common.sh@10 -- # set +x 00:20:01.357 [2024-04-23 05:04:40.487293] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:01.357 [2024-04-23 05:04:40.487365] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2417784 ] 00:20:01.357 EAL: No free 2048 kB hugepages reported on node 1 00:20:01.357 [2024-04-23 05:04:40.518021] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:01.614 [2024-04-23 05:04:40.546951] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:01.614 [2024-04-23 05:04:40.626737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:01.614 05:04:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:01.614 05:04:40 -- common/autotest_common.sh@850 -- # return 0 00:20:01.614 05:04:40 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.nafEgLW9h1 00:20:01.872 [2024-04-23 05:04:40.994277] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:01.872 [2024-04-23 05:04:40.994364] bdev_nvme.c:6067:bdev_nvme_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:01.872 [2024-04-23 05:04:40.994378] bdev_nvme.c:6176:bdev_nvme_create: *ERROR*: Could not load PSK from /tmp/tmp.nafEgLW9h1 00:20:01.872 request: 00:20:01.872 { 00:20:01.872 "name": "TLSTEST", 00:20:01.872 "trtype": "tcp", 00:20:01.872 "traddr": "10.0.0.2", 00:20:01.872 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:01.872 "adrfam": "ipv4", 00:20:01.872 "trsvcid": "4420", 00:20:01.872 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:01.872 "psk": "/tmp/tmp.nafEgLW9h1", 00:20:01.872 "method": "bdev_nvme_attach_controller", 00:20:01.872 "req_id": 1 00:20:01.872 } 00:20:01.872 Got JSON-RPC error response 00:20:01.872 response: 00:20:01.872 { 00:20:01.872 "code": -1, 00:20:01.872 "message": "Operation not permitted" 00:20:01.872 } 00:20:01.872 05:04:41 -- target/tls.sh@36 -- # killprocess 2417784 00:20:01.872 05:04:41 -- common/autotest_common.sh@936 -- # '[' -z 2417784 ']' 00:20:01.872 05:04:41 -- common/autotest_common.sh@940 -- # kill -0 2417784 00:20:01.872 05:04:41 -- common/autotest_common.sh@941 -- # uname 00:20:01.872 05:04:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:01.872 05:04:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2417784 00:20:02.129 05:04:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:02.129 05:04:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:02.129 05:04:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2417784' 00:20:02.129 killing process with pid 2417784 00:20:02.129 05:04:41 -- common/autotest_common.sh@955 -- # kill 2417784 00:20:02.129 Received shutdown signal, test time was about 10.000000 seconds 00:20:02.129 00:20:02.129 Latency(us) 00:20:02.129 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:02.129 =================================================================================================================== 00:20:02.129 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:02.129 05:04:41 -- common/autotest_common.sh@960 -- # wait 2417784 00:20:02.129 05:04:41 -- target/tls.sh@37 -- # return 1 00:20:02.129 05:04:41 -- common/autotest_common.sh@641 -- # es=1 00:20:02.129 05:04:41 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:20:02.129 05:04:41 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:20:02.129 05:04:41 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:20:02.129 05:04:41 -- target/tls.sh@174 -- # killprocess 2416190 00:20:02.129 05:04:41 -- common/autotest_common.sh@936 -- # '[' -z 2416190 ']' 00:20:02.129 05:04:41 -- common/autotest_common.sh@940 -- # kill -0 2416190 00:20:02.129 05:04:41 -- common/autotest_common.sh@941 -- # uname 00:20:02.130 05:04:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:02.130 05:04:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2416190 00:20:02.130 05:04:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:02.130 05:04:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:02.130 05:04:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2416190' 00:20:02.130 killing process with pid 2416190 00:20:02.130 05:04:41 -- common/autotest_common.sh@955 -- # kill 2416190 00:20:02.130 [2024-04-23 05:04:41.286749] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:20:02.130 05:04:41 -- common/autotest_common.sh@960 -- # wait 2416190 00:20:02.387 05:04:41 -- target/tls.sh@175 -- # nvmfappstart -m 0x2 00:20:02.387 05:04:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:02.387 05:04:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:02.387 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:20:02.387 05:04:41 -- nvmf/common.sh@470 -- # nvmfpid=2417928 00:20:02.387 05:04:41 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:02.387 05:04:41 -- nvmf/common.sh@471 -- # waitforlisten 2417928 00:20:02.387 05:04:41 -- common/autotest_common.sh@817 -- # '[' -z 2417928 ']' 00:20:02.387 05:04:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:02.387 05:04:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:02.387 05:04:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:02.387 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:02.387 05:04:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:02.387 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:20:02.645 [2024-04-23 05:04:41.558837] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:02.645 [2024-04-23 05:04:41.558910] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:02.645 EAL: No free 2048 kB hugepages reported on node 1 00:20:02.645 [2024-04-23 05:04:41.594696] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:02.645 [2024-04-23 05:04:41.626506] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:02.645 [2024-04-23 05:04:41.716466] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:02.645 [2024-04-23 05:04:41.716565] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:02.645 [2024-04-23 05:04:41.716582] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:02.645 [2024-04-23 05:04:41.716594] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:02.645 [2024-04-23 05:04:41.716604] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:02.645 [2024-04-23 05:04:41.716639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:02.903 05:04:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:02.903 05:04:41 -- common/autotest_common.sh@850 -- # return 0 00:20:02.903 05:04:41 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:02.903 05:04:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:02.903 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:20:02.903 05:04:41 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:02.903 05:04:41 -- target/tls.sh@177 -- # NOT setup_nvmf_tgt /tmp/tmp.nafEgLW9h1 00:20:02.903 05:04:41 -- common/autotest_common.sh@638 -- # local es=0 00:20:02.903 05:04:41 -- common/autotest_common.sh@640 -- # valid_exec_arg setup_nvmf_tgt /tmp/tmp.nafEgLW9h1 00:20:02.903 05:04:41 -- common/autotest_common.sh@626 -- # local arg=setup_nvmf_tgt 00:20:02.903 05:04:41 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:02.903 05:04:41 -- common/autotest_common.sh@630 -- # type -t setup_nvmf_tgt 00:20:02.903 05:04:41 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:02.903 05:04:41 -- common/autotest_common.sh@641 -- # setup_nvmf_tgt /tmp/tmp.nafEgLW9h1 00:20:02.903 05:04:41 -- target/tls.sh@49 -- # local key=/tmp/tmp.nafEgLW9h1 00:20:02.903 05:04:41 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:03.162 [2024-04-23 05:04:42.083838] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:03.162 05:04:42 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:03.420 05:04:42 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:03.420 [2024-04-23 05:04:42.573132] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:03.420 [2024-04-23 05:04:42.573395] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:03.678 05:04:42 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:03.678 malloc0 00:20:03.678 05:04:42 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:03.936 05:04:43 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.nafEgLW9h1 00:20:04.192 [2024-04-23 05:04:43.347381] tcp.c:3562:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:04.192 [2024-04-23 05:04:43.347423] tcp.c:3648:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:04.193 [2024-04-23 05:04:43.347459] subsystem.c: 971:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:04.193 request: 00:20:04.193 { 00:20:04.193 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:04.193 "host": "nqn.2016-06.io.spdk:host1", 00:20:04.193 "psk": "/tmp/tmp.nafEgLW9h1", 00:20:04.193 "method": "nvmf_subsystem_add_host", 00:20:04.193 "req_id": 1 00:20:04.193 } 00:20:04.193 Got JSON-RPC error response 00:20:04.193 response: 00:20:04.193 { 00:20:04.193 "code": -32603, 00:20:04.193 "message": "Internal error" 00:20:04.193 } 00:20:04.449 05:04:43 -- common/autotest_common.sh@641 -- # es=1 00:20:04.449 05:04:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:20:04.449 05:04:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:20:04.449 05:04:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:20:04.449 05:04:43 -- target/tls.sh@180 -- # killprocess 2417928 00:20:04.449 05:04:43 -- common/autotest_common.sh@936 -- # '[' -z 2417928 ']' 00:20:04.449 05:04:43 -- common/autotest_common.sh@940 -- # kill -0 2417928 00:20:04.449 05:04:43 -- common/autotest_common.sh@941 -- # uname 00:20:04.449 05:04:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:04.449 05:04:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2417928 00:20:04.450 05:04:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:04.450 05:04:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:04.450 05:04:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2417928' 00:20:04.450 killing process with pid 2417928 00:20:04.450 05:04:43 -- common/autotest_common.sh@955 -- # kill 2417928 00:20:04.450 05:04:43 -- common/autotest_common.sh@960 -- # wait 2417928 00:20:04.707 05:04:43 -- target/tls.sh@181 -- # chmod 0600 /tmp/tmp.nafEgLW9h1 00:20:04.707 05:04:43 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:04.707 05:04:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:04.707 05:04:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:04.707 05:04:43 -- common/autotest_common.sh@10 -- # set +x 00:20:04.707 05:04:43 -- nvmf/common.sh@470 -- # nvmfpid=2418107 00:20:04.707 05:04:43 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:04.707 05:04:43 -- nvmf/common.sh@471 -- # waitforlisten 2418107 00:20:04.707 05:04:43 -- common/autotest_common.sh@817 -- # '[' -z 2418107 ']' 00:20:04.707 05:04:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:04.707 05:04:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:04.707 05:04:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:04.707 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:04.707 05:04:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:04.707 05:04:43 -- common/autotest_common.sh@10 -- # set +x 00:20:04.707 [2024-04-23 05:04:43.694252] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:04.707 [2024-04-23 05:04:43.694335] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:04.707 EAL: No free 2048 kB hugepages reported on node 1 00:20:04.707 [2024-04-23 05:04:43.734289] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:04.707 [2024-04-23 05:04:43.766913] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:04.707 [2024-04-23 05:04:43.855786] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:04.707 [2024-04-23 05:04:43.855857] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:04.707 [2024-04-23 05:04:43.855883] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:04.707 [2024-04-23 05:04:43.855895] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:04.707 [2024-04-23 05:04:43.855907] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:04.707 [2024-04-23 05:04:43.855937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:04.964 05:04:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:04.964 05:04:43 -- common/autotest_common.sh@850 -- # return 0 00:20:04.964 05:04:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:04.964 05:04:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:04.964 05:04:43 -- common/autotest_common.sh@10 -- # set +x 00:20:04.964 05:04:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:04.965 05:04:43 -- target/tls.sh@185 -- # setup_nvmf_tgt /tmp/tmp.nafEgLW9h1 00:20:04.965 05:04:43 -- target/tls.sh@49 -- # local key=/tmp/tmp.nafEgLW9h1 00:20:04.965 05:04:43 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:05.222 [2024-04-23 05:04:44.264439] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:05.222 05:04:44 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:05.480 05:04:44 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:05.738 [2024-04-23 05:04:44.773845] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:05.738 [2024-04-23 05:04:44.774085] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:05.738 05:04:44 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:05.996 malloc0 00:20:05.996 05:04:45 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:06.254 05:04:45 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.nafEgLW9h1 00:20:06.512 [2024-04-23 05:04:45.554835] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:20:06.512 05:04:45 -- target/tls.sh@188 -- # bdevperf_pid=2418389 00:20:06.512 05:04:45 -- target/tls.sh@187 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:06.512 05:04:45 -- target/tls.sh@190 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:06.512 05:04:45 -- target/tls.sh@191 -- # waitforlisten 2418389 /var/tmp/bdevperf.sock 00:20:06.512 05:04:45 -- common/autotest_common.sh@817 -- # '[' -z 2418389 ']' 00:20:06.512 05:04:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:06.512 05:04:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:06.512 05:04:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:06.512 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:06.512 05:04:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:06.512 05:04:45 -- common/autotest_common.sh@10 -- # set +x 00:20:06.512 [2024-04-23 05:04:45.614731] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:06.512 [2024-04-23 05:04:45.614833] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2418389 ] 00:20:06.512 EAL: No free 2048 kB hugepages reported on node 1 00:20:06.512 [2024-04-23 05:04:45.647845] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:06.512 [2024-04-23 05:04:45.675396] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:06.771 [2024-04-23 05:04:45.758961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:06.771 05:04:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:06.771 05:04:45 -- common/autotest_common.sh@850 -- # return 0 00:20:06.771 05:04:45 -- target/tls.sh@192 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.nafEgLW9h1 00:20:07.029 [2024-04-23 05:04:46.102946] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:07.029 [2024-04-23 05:04:46.103065] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:20:07.029 TLSTESTn1 00:20:07.029 05:04:46 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:07.595 05:04:46 -- target/tls.sh@196 -- # tgtconf='{ 00:20:07.595 "subsystems": [ 00:20:07.595 { 00:20:07.595 "subsystem": "keyring", 00:20:07.595 "config": [] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "iobuf", 00:20:07.595 "config": [ 00:20:07.595 { 00:20:07.595 "method": "iobuf_set_options", 00:20:07.595 "params": { 00:20:07.595 "small_pool_count": 8192, 00:20:07.595 "large_pool_count": 1024, 00:20:07.595 "small_bufsize": 8192, 00:20:07.595 "large_bufsize": 135168 00:20:07.595 } 00:20:07.595 } 00:20:07.595 ] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "sock", 00:20:07.595 "config": [ 00:20:07.595 { 00:20:07.595 "method": "sock_impl_set_options", 00:20:07.595 "params": { 00:20:07.595 "impl_name": "posix", 00:20:07.595 "recv_buf_size": 2097152, 00:20:07.595 "send_buf_size": 2097152, 00:20:07.595 "enable_recv_pipe": true, 00:20:07.595 "enable_quickack": false, 00:20:07.595 "enable_placement_id": 0, 00:20:07.595 "enable_zerocopy_send_server": true, 00:20:07.595 "enable_zerocopy_send_client": false, 00:20:07.595 "zerocopy_threshold": 0, 00:20:07.595 "tls_version": 0, 00:20:07.595 "enable_ktls": false 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "sock_impl_set_options", 00:20:07.595 "params": { 00:20:07.595 "impl_name": "ssl", 00:20:07.595 "recv_buf_size": 4096, 00:20:07.595 "send_buf_size": 4096, 00:20:07.595 "enable_recv_pipe": true, 00:20:07.595 "enable_quickack": false, 00:20:07.595 "enable_placement_id": 0, 00:20:07.595 "enable_zerocopy_send_server": true, 00:20:07.595 "enable_zerocopy_send_client": false, 00:20:07.595 "zerocopy_threshold": 0, 00:20:07.595 "tls_version": 0, 00:20:07.595 "enable_ktls": false 00:20:07.595 } 00:20:07.595 } 00:20:07.595 ] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "vmd", 00:20:07.595 "config": [] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "accel", 00:20:07.595 "config": [ 00:20:07.595 { 00:20:07.595 "method": "accel_set_options", 00:20:07.595 "params": { 00:20:07.595 "small_cache_size": 128, 00:20:07.595 "large_cache_size": 16, 00:20:07.595 "task_count": 2048, 00:20:07.595 "sequence_count": 2048, 00:20:07.595 "buf_count": 2048 00:20:07.595 } 00:20:07.595 } 00:20:07.595 ] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "bdev", 00:20:07.595 "config": [ 00:20:07.595 { 00:20:07.595 "method": "bdev_set_options", 00:20:07.595 "params": { 00:20:07.595 "bdev_io_pool_size": 65535, 00:20:07.595 "bdev_io_cache_size": 256, 00:20:07.595 "bdev_auto_examine": true, 00:20:07.595 "iobuf_small_cache_size": 128, 00:20:07.595 "iobuf_large_cache_size": 16 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "bdev_raid_set_options", 00:20:07.595 "params": { 00:20:07.595 "process_window_size_kb": 1024 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "bdev_iscsi_set_options", 00:20:07.595 "params": { 00:20:07.595 "timeout_sec": 30 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "bdev_nvme_set_options", 00:20:07.595 "params": { 00:20:07.595 "action_on_timeout": "none", 00:20:07.595 "timeout_us": 0, 00:20:07.595 "timeout_admin_us": 0, 00:20:07.595 "keep_alive_timeout_ms": 10000, 00:20:07.595 "arbitration_burst": 0, 00:20:07.595 "low_priority_weight": 0, 00:20:07.595 "medium_priority_weight": 0, 00:20:07.595 "high_priority_weight": 0, 00:20:07.595 "nvme_adminq_poll_period_us": 10000, 00:20:07.595 "nvme_ioq_poll_period_us": 0, 00:20:07.595 "io_queue_requests": 0, 00:20:07.595 "delay_cmd_submit": true, 00:20:07.595 "transport_retry_count": 4, 00:20:07.595 "bdev_retry_count": 3, 00:20:07.595 "transport_ack_timeout": 0, 00:20:07.595 "ctrlr_loss_timeout_sec": 0, 00:20:07.595 "reconnect_delay_sec": 0, 00:20:07.595 "fast_io_fail_timeout_sec": 0, 00:20:07.595 "disable_auto_failback": false, 00:20:07.595 "generate_uuids": false, 00:20:07.595 "transport_tos": 0, 00:20:07.595 "nvme_error_stat": false, 00:20:07.595 "rdma_srq_size": 0, 00:20:07.595 "io_path_stat": false, 00:20:07.595 "allow_accel_sequence": false, 00:20:07.595 "rdma_max_cq_size": 0, 00:20:07.595 "rdma_cm_event_timeout_ms": 0, 00:20:07.595 "dhchap_digests": [ 00:20:07.595 "sha256", 00:20:07.595 "sha384", 00:20:07.595 "sha512" 00:20:07.595 ], 00:20:07.595 "dhchap_dhgroups": [ 00:20:07.595 "null", 00:20:07.595 "ffdhe2048", 00:20:07.595 "ffdhe3072", 00:20:07.595 "ffdhe4096", 00:20:07.595 "ffdhe6144", 00:20:07.595 "ffdhe8192" 00:20:07.595 ] 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "bdev_nvme_set_hotplug", 00:20:07.595 "params": { 00:20:07.595 "period_us": 100000, 00:20:07.595 "enable": false 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "bdev_malloc_create", 00:20:07.595 "params": { 00:20:07.595 "name": "malloc0", 00:20:07.595 "num_blocks": 8192, 00:20:07.595 "block_size": 4096, 00:20:07.595 "physical_block_size": 4096, 00:20:07.595 "uuid": "7aa0fb5c-2efa-46f8-91c3-027e0b118674", 00:20:07.595 "optimal_io_boundary": 0 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "bdev_wait_for_examine" 00:20:07.595 } 00:20:07.595 ] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "nbd", 00:20:07.595 "config": [] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "scheduler", 00:20:07.595 "config": [ 00:20:07.595 { 00:20:07.595 "method": "framework_set_scheduler", 00:20:07.595 "params": { 00:20:07.595 "name": "static" 00:20:07.595 } 00:20:07.595 } 00:20:07.595 ] 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "subsystem": "nvmf", 00:20:07.595 "config": [ 00:20:07.595 { 00:20:07.595 "method": "nvmf_set_config", 00:20:07.595 "params": { 00:20:07.595 "discovery_filter": "match_any", 00:20:07.595 "admin_cmd_passthru": { 00:20:07.595 "identify_ctrlr": false 00:20:07.595 } 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "nvmf_set_max_subsystems", 00:20:07.595 "params": { 00:20:07.595 "max_subsystems": 1024 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.595 "method": "nvmf_set_crdt", 00:20:07.595 "params": { 00:20:07.595 "crdt1": 0, 00:20:07.595 "crdt2": 0, 00:20:07.595 "crdt3": 0 00:20:07.595 } 00:20:07.595 }, 00:20:07.595 { 00:20:07.596 "method": "nvmf_create_transport", 00:20:07.596 "params": { 00:20:07.596 "trtype": "TCP", 00:20:07.596 "max_queue_depth": 128, 00:20:07.596 "max_io_qpairs_per_ctrlr": 127, 00:20:07.596 "in_capsule_data_size": 4096, 00:20:07.596 "max_io_size": 131072, 00:20:07.596 "io_unit_size": 131072, 00:20:07.596 "max_aq_depth": 128, 00:20:07.596 "num_shared_buffers": 511, 00:20:07.596 "buf_cache_size": 4294967295, 00:20:07.596 "dif_insert_or_strip": false, 00:20:07.596 "zcopy": false, 00:20:07.596 "c2h_success": false, 00:20:07.596 "sock_priority": 0, 00:20:07.596 "abort_timeout_sec": 1, 00:20:07.596 "ack_timeout": 0, 00:20:07.596 "data_wr_pool_size": 0 00:20:07.596 } 00:20:07.596 }, 00:20:07.596 { 00:20:07.596 "method": "nvmf_create_subsystem", 00:20:07.596 "params": { 00:20:07.596 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:07.596 "allow_any_host": false, 00:20:07.596 "serial_number": "SPDK00000000000001", 00:20:07.596 "model_number": "SPDK bdev Controller", 00:20:07.596 "max_namespaces": 10, 00:20:07.596 "min_cntlid": 1, 00:20:07.596 "max_cntlid": 65519, 00:20:07.596 "ana_reporting": false 00:20:07.596 } 00:20:07.596 }, 00:20:07.596 { 00:20:07.596 "method": "nvmf_subsystem_add_host", 00:20:07.596 "params": { 00:20:07.596 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:07.596 "host": "nqn.2016-06.io.spdk:host1", 00:20:07.596 "psk": "/tmp/tmp.nafEgLW9h1" 00:20:07.596 } 00:20:07.596 }, 00:20:07.596 { 00:20:07.596 "method": "nvmf_subsystem_add_ns", 00:20:07.596 "params": { 00:20:07.596 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:07.596 "namespace": { 00:20:07.596 "nsid": 1, 00:20:07.596 "bdev_name": "malloc0", 00:20:07.596 "nguid": "7AA0FB5C2EFA46F891C3027E0B118674", 00:20:07.596 "uuid": "7aa0fb5c-2efa-46f8-91c3-027e0b118674", 00:20:07.596 "no_auto_visible": false 00:20:07.596 } 00:20:07.596 } 00:20:07.596 }, 00:20:07.596 { 00:20:07.596 "method": "nvmf_subsystem_add_listener", 00:20:07.596 "params": { 00:20:07.596 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:07.596 "listen_address": { 00:20:07.596 "trtype": "TCP", 00:20:07.596 "adrfam": "IPv4", 00:20:07.596 "traddr": "10.0.0.2", 00:20:07.596 "trsvcid": "4420" 00:20:07.596 }, 00:20:07.596 "secure_channel": true 00:20:07.596 } 00:20:07.596 } 00:20:07.596 ] 00:20:07.596 } 00:20:07.596 ] 00:20:07.596 }' 00:20:07.596 05:04:46 -- target/tls.sh@197 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:07.854 05:04:46 -- target/tls.sh@197 -- # bdevperfconf='{ 00:20:07.854 "subsystems": [ 00:20:07.854 { 00:20:07.854 "subsystem": "keyring", 00:20:07.854 "config": [] 00:20:07.854 }, 00:20:07.854 { 00:20:07.854 "subsystem": "iobuf", 00:20:07.854 "config": [ 00:20:07.854 { 00:20:07.854 "method": "iobuf_set_options", 00:20:07.854 "params": { 00:20:07.854 "small_pool_count": 8192, 00:20:07.854 "large_pool_count": 1024, 00:20:07.854 "small_bufsize": 8192, 00:20:07.854 "large_bufsize": 135168 00:20:07.854 } 00:20:07.854 } 00:20:07.854 ] 00:20:07.854 }, 00:20:07.854 { 00:20:07.854 "subsystem": "sock", 00:20:07.854 "config": [ 00:20:07.854 { 00:20:07.854 "method": "sock_impl_set_options", 00:20:07.854 "params": { 00:20:07.854 "impl_name": "posix", 00:20:07.854 "recv_buf_size": 2097152, 00:20:07.854 "send_buf_size": 2097152, 00:20:07.854 "enable_recv_pipe": true, 00:20:07.854 "enable_quickack": false, 00:20:07.854 "enable_placement_id": 0, 00:20:07.854 "enable_zerocopy_send_server": true, 00:20:07.854 "enable_zerocopy_send_client": false, 00:20:07.854 "zerocopy_threshold": 0, 00:20:07.854 "tls_version": 0, 00:20:07.854 "enable_ktls": false 00:20:07.854 } 00:20:07.854 }, 00:20:07.854 { 00:20:07.854 "method": "sock_impl_set_options", 00:20:07.854 "params": { 00:20:07.854 "impl_name": "ssl", 00:20:07.854 "recv_buf_size": 4096, 00:20:07.854 "send_buf_size": 4096, 00:20:07.854 "enable_recv_pipe": true, 00:20:07.854 "enable_quickack": false, 00:20:07.854 "enable_placement_id": 0, 00:20:07.854 "enable_zerocopy_send_server": true, 00:20:07.854 "enable_zerocopy_send_client": false, 00:20:07.854 "zerocopy_threshold": 0, 00:20:07.855 "tls_version": 0, 00:20:07.855 "enable_ktls": false 00:20:07.855 } 00:20:07.855 } 00:20:07.855 ] 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "subsystem": "vmd", 00:20:07.855 "config": [] 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "subsystem": "accel", 00:20:07.855 "config": [ 00:20:07.855 { 00:20:07.855 "method": "accel_set_options", 00:20:07.855 "params": { 00:20:07.855 "small_cache_size": 128, 00:20:07.855 "large_cache_size": 16, 00:20:07.855 "task_count": 2048, 00:20:07.855 "sequence_count": 2048, 00:20:07.855 "buf_count": 2048 00:20:07.855 } 00:20:07.855 } 00:20:07.855 ] 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "subsystem": "bdev", 00:20:07.855 "config": [ 00:20:07.855 { 00:20:07.855 "method": "bdev_set_options", 00:20:07.855 "params": { 00:20:07.855 "bdev_io_pool_size": 65535, 00:20:07.855 "bdev_io_cache_size": 256, 00:20:07.855 "bdev_auto_examine": true, 00:20:07.855 "iobuf_small_cache_size": 128, 00:20:07.855 "iobuf_large_cache_size": 16 00:20:07.855 } 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "method": "bdev_raid_set_options", 00:20:07.855 "params": { 00:20:07.855 "process_window_size_kb": 1024 00:20:07.855 } 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "method": "bdev_iscsi_set_options", 00:20:07.855 "params": { 00:20:07.855 "timeout_sec": 30 00:20:07.855 } 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "method": "bdev_nvme_set_options", 00:20:07.855 "params": { 00:20:07.855 "action_on_timeout": "none", 00:20:07.855 "timeout_us": 0, 00:20:07.855 "timeout_admin_us": 0, 00:20:07.855 "keep_alive_timeout_ms": 10000, 00:20:07.855 "arbitration_burst": 0, 00:20:07.855 "low_priority_weight": 0, 00:20:07.855 "medium_priority_weight": 0, 00:20:07.855 "high_priority_weight": 0, 00:20:07.855 "nvme_adminq_poll_period_us": 10000, 00:20:07.855 "nvme_ioq_poll_period_us": 0, 00:20:07.855 "io_queue_requests": 512, 00:20:07.855 "delay_cmd_submit": true, 00:20:07.855 "transport_retry_count": 4, 00:20:07.855 "bdev_retry_count": 3, 00:20:07.855 "transport_ack_timeout": 0, 00:20:07.855 "ctrlr_loss_timeout_sec": 0, 00:20:07.855 "reconnect_delay_sec": 0, 00:20:07.855 "fast_io_fail_timeout_sec": 0, 00:20:07.855 "disable_auto_failback": false, 00:20:07.855 "generate_uuids": false, 00:20:07.855 "transport_tos": 0, 00:20:07.855 "nvme_error_stat": false, 00:20:07.855 "rdma_srq_size": 0, 00:20:07.855 "io_path_stat": false, 00:20:07.855 "allow_accel_sequence": false, 00:20:07.855 "rdma_max_cq_size": 0, 00:20:07.855 "rdma_cm_event_timeout_ms": 0, 00:20:07.855 "dhchap_digests": [ 00:20:07.855 "sha256", 00:20:07.855 "sha384", 00:20:07.855 "sha512" 00:20:07.855 ], 00:20:07.855 "dhchap_dhgroups": [ 00:20:07.855 "null", 00:20:07.855 "ffdhe2048", 00:20:07.855 "ffdhe3072", 00:20:07.855 "ffdhe4096", 00:20:07.855 "ffdhe6144", 00:20:07.855 "ffdhe8192" 00:20:07.855 ] 00:20:07.855 } 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "method": "bdev_nvme_attach_controller", 00:20:07.855 "params": { 00:20:07.855 "name": "TLSTEST", 00:20:07.855 "trtype": "TCP", 00:20:07.855 "adrfam": "IPv4", 00:20:07.855 "traddr": "10.0.0.2", 00:20:07.855 "trsvcid": "4420", 00:20:07.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:07.855 "prchk_reftag": false, 00:20:07.855 "prchk_guard": false, 00:20:07.855 "ctrlr_loss_timeout_sec": 0, 00:20:07.855 "reconnect_delay_sec": 0, 00:20:07.855 "fast_io_fail_timeout_sec": 0, 00:20:07.855 "psk": "/tmp/tmp.nafEgLW9h1", 00:20:07.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:07.855 "hdgst": false, 00:20:07.855 "ddgst": false 00:20:07.855 } 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "method": "bdev_nvme_set_hotplug", 00:20:07.855 "params": { 00:20:07.855 "period_us": 100000, 00:20:07.855 "enable": false 00:20:07.855 } 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "method": "bdev_wait_for_examine" 00:20:07.855 } 00:20:07.855 ] 00:20:07.855 }, 00:20:07.855 { 00:20:07.855 "subsystem": "nbd", 00:20:07.855 "config": [] 00:20:07.855 } 00:20:07.855 ] 00:20:07.855 }' 00:20:07.855 05:04:46 -- target/tls.sh@199 -- # killprocess 2418389 00:20:07.855 05:04:46 -- common/autotest_common.sh@936 -- # '[' -z 2418389 ']' 00:20:07.855 05:04:46 -- common/autotest_common.sh@940 -- # kill -0 2418389 00:20:07.855 05:04:46 -- common/autotest_common.sh@941 -- # uname 00:20:07.855 05:04:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:07.855 05:04:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2418389 00:20:07.855 05:04:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:07.855 05:04:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:07.855 05:04:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2418389' 00:20:07.855 killing process with pid 2418389 00:20:07.855 05:04:46 -- common/autotest_common.sh@955 -- # kill 2418389 00:20:07.855 Received shutdown signal, test time was about 10.000000 seconds 00:20:07.855 00:20:07.855 Latency(us) 00:20:07.855 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:07.855 =================================================================================================================== 00:20:07.855 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:07.855 [2024-04-23 05:04:46.847235] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:20:07.855 05:04:46 -- common/autotest_common.sh@960 -- # wait 2418389 00:20:08.114 05:04:47 -- target/tls.sh@200 -- # killprocess 2418107 00:20:08.114 05:04:47 -- common/autotest_common.sh@936 -- # '[' -z 2418107 ']' 00:20:08.114 05:04:47 -- common/autotest_common.sh@940 -- # kill -0 2418107 00:20:08.114 05:04:47 -- common/autotest_common.sh@941 -- # uname 00:20:08.114 05:04:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:08.114 05:04:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2418107 00:20:08.114 05:04:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:08.114 05:04:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:08.114 05:04:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2418107' 00:20:08.114 killing process with pid 2418107 00:20:08.114 05:04:47 -- common/autotest_common.sh@955 -- # kill 2418107 00:20:08.114 [2024-04-23 05:04:47.096652] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:20:08.114 05:04:47 -- common/autotest_common.sh@960 -- # wait 2418107 00:20:08.372 05:04:47 -- target/tls.sh@203 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:08.372 05:04:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:08.372 05:04:47 -- target/tls.sh@203 -- # echo '{ 00:20:08.372 "subsystems": [ 00:20:08.372 { 00:20:08.372 "subsystem": "keyring", 00:20:08.372 "config": [] 00:20:08.372 }, 00:20:08.372 { 00:20:08.372 "subsystem": "iobuf", 00:20:08.372 "config": [ 00:20:08.372 { 00:20:08.372 "method": "iobuf_set_options", 00:20:08.372 "params": { 00:20:08.372 "small_pool_count": 8192, 00:20:08.372 "large_pool_count": 1024, 00:20:08.372 "small_bufsize": 8192, 00:20:08.372 "large_bufsize": 135168 00:20:08.372 } 00:20:08.372 } 00:20:08.372 ] 00:20:08.372 }, 00:20:08.372 { 00:20:08.372 "subsystem": "sock", 00:20:08.372 "config": [ 00:20:08.372 { 00:20:08.372 "method": "sock_impl_set_options", 00:20:08.372 "params": { 00:20:08.372 "impl_name": "posix", 00:20:08.372 "recv_buf_size": 2097152, 00:20:08.372 "send_buf_size": 2097152, 00:20:08.372 "enable_recv_pipe": true, 00:20:08.372 "enable_quickack": false, 00:20:08.372 "enable_placement_id": 0, 00:20:08.372 "enable_zerocopy_send_server": true, 00:20:08.372 "enable_zerocopy_send_client": false, 00:20:08.372 "zerocopy_threshold": 0, 00:20:08.372 "tls_version": 0, 00:20:08.372 "enable_ktls": false 00:20:08.372 } 00:20:08.372 }, 00:20:08.372 { 00:20:08.372 "method": "sock_impl_set_options", 00:20:08.373 "params": { 00:20:08.373 "impl_name": "ssl", 00:20:08.373 "recv_buf_size": 4096, 00:20:08.373 "send_buf_size": 4096, 00:20:08.373 "enable_recv_pipe": true, 00:20:08.373 "enable_quickack": false, 00:20:08.373 "enable_placement_id": 0, 00:20:08.373 "enable_zerocopy_send_server": true, 00:20:08.373 "enable_zerocopy_send_client": false, 00:20:08.373 "zerocopy_threshold": 0, 00:20:08.373 "tls_version": 0, 00:20:08.373 "enable_ktls": false 00:20:08.373 } 00:20:08.373 } 00:20:08.373 ] 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "subsystem": "vmd", 00:20:08.373 "config": [] 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "subsystem": "accel", 00:20:08.373 "config": [ 00:20:08.373 { 00:20:08.373 "method": "accel_set_options", 00:20:08.373 "params": { 00:20:08.373 "small_cache_size": 128, 00:20:08.373 "large_cache_size": 16, 00:20:08.373 "task_count": 2048, 00:20:08.373 "sequence_count": 2048, 00:20:08.373 "buf_count": 2048 00:20:08.373 } 00:20:08.373 } 00:20:08.373 ] 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "subsystem": "bdev", 00:20:08.373 "config": [ 00:20:08.373 { 00:20:08.373 "method": "bdev_set_options", 00:20:08.373 "params": { 00:20:08.373 "bdev_io_pool_size": 65535, 00:20:08.373 "bdev_io_cache_size": 256, 00:20:08.373 "bdev_auto_examine": true, 00:20:08.373 "iobuf_small_cache_size": 128, 00:20:08.373 "iobuf_large_cache_size": 16 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "bdev_raid_set_options", 00:20:08.373 "params": { 00:20:08.373 "process_window_size_kb": 1024 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "bdev_iscsi_set_options", 00:20:08.373 "params": { 00:20:08.373 "timeout_sec": 30 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "bdev_nvme_set_options", 00:20:08.373 "params": { 00:20:08.373 "action_on_timeout": "none", 00:20:08.373 "timeout_us": 0, 00:20:08.373 "timeout_admin_us": 0, 00:20:08.373 "keep_alive_timeout_ms": 10000, 00:20:08.373 "arbitration_burst": 0, 00:20:08.373 "low_priority_weight": 0, 00:20:08.373 "medium_priority_weight": 0, 00:20:08.373 "high_priority_weight": 0, 00:20:08.373 "nvme_adminq_poll_period_us": 10000, 00:20:08.373 "nvme_ioq_poll_period_us": 0, 00:20:08.373 "io_queue_requests": 0, 00:20:08.373 "delay_cmd_submit": true, 00:20:08.373 "transport_retry_count": 4, 00:20:08.373 "bdev_retry_count": 3, 00:20:08.373 "transport_ack_timeout": 0, 00:20:08.373 "ctrlr_loss_timeout_sec": 0, 00:20:08.373 "reconnect_delay_sec": 0, 00:20:08.373 "fast_io_fail_timeout_sec": 0, 00:20:08.373 "disable_auto_failback": false, 00:20:08.373 "generate_uuids": false, 00:20:08.373 "transport_tos": 0, 00:20:08.373 "nvme_error_stat": false, 00:20:08.373 "rdma_srq_size": 0, 00:20:08.373 "io_path_stat": false, 00:20:08.373 "allow_accel_sequence": false, 00:20:08.373 "rdma_max_cq_size": 0, 00:20:08.373 "rdma_cm_event_timeout_ms": 0, 00:20:08.373 "dhchap_digests": [ 00:20:08.373 "sha256", 00:20:08.373 "sha384", 00:20:08.373 "sha512" 00:20:08.373 ], 00:20:08.373 "dhchap_dhgroups": [ 00:20:08.373 "null", 00:20:08.373 "ffdhe2048", 00:20:08.373 "ffdhe3072", 00:20:08.373 "ffdhe4096", 00:20:08.373 "ffdhe6144", 00:20:08.373 "ffdhe8192" 00:20:08.373 ] 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "bdev_nvme_set_hotplug", 00:20:08.373 "params": { 00:20:08.373 "period_us": 100000, 00:20:08.373 "enable": false 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "bdev_malloc_create", 00:20:08.373 "params": { 00:20:08.373 "name": "malloc0", 00:20:08.373 "num_blocks": 8192, 00:20:08.373 "block_size": 4096, 00:20:08.373 "physical_block_size": 4096, 00:20:08.373 "uuid": "7aa0fb5c-2efa-46f8-91c3-027e0b118674", 00:20:08.373 "optimal_io_boundary": 0 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "bdev_wait_for_examine" 00:20:08.373 } 00:20:08.373 ] 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "subsystem": "nbd", 00:20:08.373 "config": [] 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "subsystem": "scheduler", 00:20:08.373 "config": [ 00:20:08.373 { 00:20:08.373 "method": "framework_set_scheduler", 00:20:08.373 "params": { 00:20:08.373 "name": "static" 00:20:08.373 } 00:20:08.373 } 00:20:08.373 ] 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "subsystem": "nvmf", 00:20:08.373 "config": [ 00:20:08.373 { 00:20:08.373 "method": "nvmf_set_config", 00:20:08.373 "params": { 00:20:08.373 "discovery_filter": "match_any", 00:20:08.373 "admin_cmd_passthru": { 00:20:08.373 "identify_ctrlr": false 00:20:08.373 } 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "nvmf_set_max_subsystems", 00:20:08.373 "params": { 00:20:08.373 "max_subsystems": 1024 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "nvmf_set_crdt", 00:20:08.373 "params": { 00:20:08.373 "crdt1": 0, 00:20:08.373 "crdt2": 0, 00:20:08.373 "crdt3": 0 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "nvmf_create_transport", 00:20:08.373 "params": { 00:20:08.373 "trtype": "TCP", 00:20:08.373 "max_queue_depth": 128, 00:20:08.373 "max_io_qpairs_per_ctrlr": 127, 00:20:08.373 "in_capsule_data_size": 4096, 00:20:08.373 "max_io_size": 131072, 00:20:08.373 "io_unit_size": 131072, 00:20:08.373 "max_aq_depth": 128, 00:20:08.373 "num_shared_buffers": 511, 00:20:08.373 "buf_cache_size": 4294967295, 00:20:08.373 "dif_insert_or_strip": false, 00:20:08.373 "zcopy": false, 00:20:08.373 "c2h_success": false, 00:20:08.373 "sock_priority": 0, 00:20:08.373 "abort_timeout_sec": 1, 00:20:08.373 "ack_timeout": 0, 00:20:08.373 "data_wr_pool_size": 0 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "nvmf_create_subsystem", 00:20:08.373 "params": { 00:20:08.373 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:08.373 "allow_any_host": false, 00:20:08.373 "serial_number": "SPDK00000000000001", 00:20:08.373 "model_number": "SPDK bdev Controller", 00:20:08.373 "max_namespaces": 10, 00:20:08.373 "min_cntlid": 1, 00:20:08.373 "max_cntlid": 65519, 00:20:08.373 "ana_reporting": false 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "nvmf_subsystem_add_host", 00:20:08.373 "params": { 00:20:08.373 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:08.373 "host": "nqn.2016-06.io.spdk:host1", 00:20:08.373 "psk": "/tmp/tmp.nafEgLW9h1" 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "nvmf_subsystem_add_ns", 00:20:08.373 "params": { 00:20:08.373 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:08.373 "namespace": { 00:20:08.373 "nsid": 1, 00:20:08.373 "bdev_name": "malloc0", 00:20:08.373 "nguid": "7AA0FB5C2EFA46F891C3027E0B118674", 00:20:08.373 "uuid": "7aa0fb5c-2efa-46f8-91c3-027e0b118674", 00:20:08.373 "no_auto_visible": false 00:20:08.373 } 00:20:08.373 } 00:20:08.373 }, 00:20:08.373 { 00:20:08.373 "method": "nvmf_subsystem_add_listener", 00:20:08.373 "params": { 00:20:08.373 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:08.373 "listen_address": { 00:20:08.373 "trtype": "TCP", 00:20:08.373 "adrfam": "IPv4", 00:20:08.373 "traddr": "10.0.0.2", 00:20:08.373 "trsvcid": "4420" 00:20:08.373 }, 00:20:08.373 "secure_channel": true 00:20:08.373 } 00:20:08.373 } 00:20:08.373 ] 00:20:08.373 } 00:20:08.373 ] 00:20:08.373 }' 00:20:08.373 05:04:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:08.373 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:20:08.373 05:04:47 -- nvmf/common.sh@470 -- # nvmfpid=2418664 00:20:08.374 05:04:47 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:08.374 05:04:47 -- nvmf/common.sh@471 -- # waitforlisten 2418664 00:20:08.374 05:04:47 -- common/autotest_common.sh@817 -- # '[' -z 2418664 ']' 00:20:08.374 05:04:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:08.374 05:04:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:08.374 05:04:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:08.374 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:08.374 05:04:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:08.374 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:20:08.374 [2024-04-23 05:04:47.398473] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:08.374 [2024-04-23 05:04:47.398568] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:08.374 EAL: No free 2048 kB hugepages reported on node 1 00:20:08.374 [2024-04-23 05:04:47.436327] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:08.374 [2024-04-23 05:04:47.468188] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:08.632 [2024-04-23 05:04:47.553415] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:08.632 [2024-04-23 05:04:47.553472] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:08.632 [2024-04-23 05:04:47.553498] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:08.632 [2024-04-23 05:04:47.553531] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:08.632 [2024-04-23 05:04:47.553557] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:08.632 [2024-04-23 05:04:47.553648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:08.632 [2024-04-23 05:04:47.783206] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:08.890 [2024-04-23 05:04:47.799144] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:20:08.890 [2024-04-23 05:04:47.815193] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:08.890 [2024-04-23 05:04:47.838746] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:09.457 05:04:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:09.457 05:04:48 -- common/autotest_common.sh@850 -- # return 0 00:20:09.457 05:04:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:09.457 05:04:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:09.457 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:20:09.457 05:04:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:09.457 05:04:48 -- target/tls.sh@207 -- # bdevperf_pid=2418817 00:20:09.457 05:04:48 -- target/tls.sh@208 -- # waitforlisten 2418817 /var/tmp/bdevperf.sock 00:20:09.457 05:04:48 -- common/autotest_common.sh@817 -- # '[' -z 2418817 ']' 00:20:09.457 05:04:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:09.457 05:04:48 -- target/tls.sh@204 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:09.457 05:04:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:09.457 05:04:48 -- target/tls.sh@204 -- # echo '{ 00:20:09.457 "subsystems": [ 00:20:09.457 { 00:20:09.457 "subsystem": "keyring", 00:20:09.457 "config": [] 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "subsystem": "iobuf", 00:20:09.457 "config": [ 00:20:09.457 { 00:20:09.457 "method": "iobuf_set_options", 00:20:09.457 "params": { 00:20:09.457 "small_pool_count": 8192, 00:20:09.457 "large_pool_count": 1024, 00:20:09.457 "small_bufsize": 8192, 00:20:09.457 "large_bufsize": 135168 00:20:09.457 } 00:20:09.457 } 00:20:09.457 ] 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "subsystem": "sock", 00:20:09.457 "config": [ 00:20:09.457 { 00:20:09.457 "method": "sock_impl_set_options", 00:20:09.457 "params": { 00:20:09.457 "impl_name": "posix", 00:20:09.457 "recv_buf_size": 2097152, 00:20:09.457 "send_buf_size": 2097152, 00:20:09.457 "enable_recv_pipe": true, 00:20:09.457 "enable_quickack": false, 00:20:09.457 "enable_placement_id": 0, 00:20:09.457 "enable_zerocopy_send_server": true, 00:20:09.457 "enable_zerocopy_send_client": false, 00:20:09.457 "zerocopy_threshold": 0, 00:20:09.457 "tls_version": 0, 00:20:09.457 "enable_ktls": false 00:20:09.457 } 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "method": "sock_impl_set_options", 00:20:09.457 "params": { 00:20:09.457 "impl_name": "ssl", 00:20:09.457 "recv_buf_size": 4096, 00:20:09.457 "send_buf_size": 4096, 00:20:09.457 "enable_recv_pipe": true, 00:20:09.457 "enable_quickack": false, 00:20:09.457 "enable_placement_id": 0, 00:20:09.457 "enable_zerocopy_send_server": true, 00:20:09.457 "enable_zerocopy_send_client": false, 00:20:09.457 "zerocopy_threshold": 0, 00:20:09.457 "tls_version": 0, 00:20:09.457 "enable_ktls": false 00:20:09.457 } 00:20:09.457 } 00:20:09.457 ] 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "subsystem": "vmd", 00:20:09.457 "config": [] 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "subsystem": "accel", 00:20:09.457 "config": [ 00:20:09.457 { 00:20:09.457 "method": "accel_set_options", 00:20:09.457 "params": { 00:20:09.457 "small_cache_size": 128, 00:20:09.457 "large_cache_size": 16, 00:20:09.457 "task_count": 2048, 00:20:09.457 "sequence_count": 2048, 00:20:09.457 "buf_count": 2048 00:20:09.457 } 00:20:09.457 } 00:20:09.457 ] 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "subsystem": "bdev", 00:20:09.457 "config": [ 00:20:09.457 { 00:20:09.457 "method": "bdev_set_options", 00:20:09.457 "params": { 00:20:09.457 "bdev_io_pool_size": 65535, 00:20:09.457 "bdev_io_cache_size": 256, 00:20:09.457 "bdev_auto_examine": true, 00:20:09.457 "iobuf_small_cache_size": 128, 00:20:09.457 "iobuf_large_cache_size": 16 00:20:09.457 } 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "method": "bdev_raid_set_options", 00:20:09.457 "params": { 00:20:09.457 "process_window_size_kb": 1024 00:20:09.457 } 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "method": "bdev_iscsi_set_options", 00:20:09.457 "params": { 00:20:09.457 "timeout_sec": 30 00:20:09.457 } 00:20:09.457 }, 00:20:09.457 { 00:20:09.457 "method": "bdev_nvme_set_options", 00:20:09.457 "params": { 00:20:09.457 "action_on_timeout": "none", 00:20:09.457 "timeout_us": 0, 00:20:09.457 "timeout_admin_us": 0, 00:20:09.457 "keep_alive_timeout_ms": 10000, 00:20:09.457 "arbitration_burst": 0, 00:20:09.457 "low_priority_weight": 0, 00:20:09.457 "medium_priority_weight": 0, 00:20:09.457 "high_priority_weight": 0, 00:20:09.457 "nvme_adminq_poll_period_us": 10000, 00:20:09.457 "nvme_ioq_poll_period_us": 0, 00:20:09.457 "io_queue_requests": 512, 00:20:09.457 "delay_cmd_submit": true, 00:20:09.457 "transport_retry_count": 4, 00:20:09.457 "bdev_retry_count": 3, 00:20:09.457 "transport_ack_timeout": 0, 00:20:09.457 "ctrlr_loss_timeout_sec": 0, 00:20:09.457 "reconnect_delay_sec": 0, 00:20:09.457 "fast_io_fail_timeout_sec": 0, 00:20:09.457 "disable_auto_failback": false, 00:20:09.457 "generate_uuids": false, 00:20:09.457 "transport_tos": 0, 00:20:09.457 "nvme_error_stat": false, 00:20:09.457 "rdma_srq_size": 0, 00:20:09.457 "io_path_stat": false, 00:20:09.457 "allow_accel_sequence": false, 00:20:09.457 "rdma_max_cq_size": 0, 00:20:09.457 "rdma_cm_event_timeout_ms": 0, 00:20:09.457 "dhchap_digests": [ 00:20:09.457 "sha256", 00:20:09.458 "sha384", 00:20:09.458 "sha512" 00:20:09.458 ], 00:20:09.458 "dhchap_dhgroups": [ 00:20:09.458 "null", 00:20:09.458 "ffdhe2048", 00:20:09.458 "ffdhe3072", 00:20:09.458 "ffdhe4096", 00:20:09.458 "ffdhe6144", 00:20:09.458 "ffdhe8192" 00:20:09.458 ] 00:20:09.458 } 00:20:09.458 }, 00:20:09.458 { 00:20:09.458 "method": "bdev_nvme_attach_controller", 00:20:09.458 "params": { 00:20:09.458 "name": "TLSTEST", 00:20:09.458 "trtype": "TCP", 00:20:09.458 "adrfam": "IPv4", 00:20:09.458 "traddr": "10.0.0.2", 00:20:09.458 "trsvcid": "4420", 00:20:09.458 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:09.458 "prchk_reftag": false, 00:20:09.458 "prchk_guard": false, 00:20:09.458 "ctrlr_loss_timeout_sec": 0, 00:20:09.458 "reconnect_delay_sec": 0, 00:20:09.458 "fast_io_fail_timeout_sec": 0, 00:20:09.458 "psk": "/tmp/tmp.nafEgLW9h1", 00:20:09.458 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:09.458 "hdgst": false, 00:20:09.458 "ddgst": false 00:20:09.458 } 00:20:09.458 }, 00:20:09.458 { 00:20:09.458 "method": "bdev_nvme_set_hotplug", 00:20:09.458 "params": { 00:20:09.458 "period_us": 100000, 00:20:09.458 "enable": false 00:20:09.458 } 00:20:09.458 }, 00:20:09.458 { 00:20:09.458 "method": "bdev_wait_for_examine" 00:20:09.458 } 00:20:09.458 ] 00:20:09.458 }, 00:20:09.458 { 00:20:09.458 "subsystem": "nbd", 00:20:09.458 "config": [] 00:20:09.458 } 00:20:09.458 ] 00:20:09.458 }' 00:20:09.458 05:04:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:09.458 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:09.458 05:04:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:09.458 05:04:48 -- common/autotest_common.sh@10 -- # set +x 00:20:09.458 [2024-04-23 05:04:48.447568] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:09.458 [2024-04-23 05:04:48.447657] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2418817 ] 00:20:09.458 EAL: No free 2048 kB hugepages reported on node 1 00:20:09.458 [2024-04-23 05:04:48.479904] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:09.458 [2024-04-23 05:04:48.507389] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:09.458 [2024-04-23 05:04:48.589633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:09.715 [2024-04-23 05:04:48.748730] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:09.715 [2024-04-23 05:04:48.748895] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:20:10.279 05:04:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:10.279 05:04:49 -- common/autotest_common.sh@850 -- # return 0 00:20:10.279 05:04:49 -- target/tls.sh@211 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:10.537 Running I/O for 10 seconds... 00:20:20.503 00:20:20.503 Latency(us) 00:20:20.503 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:20.503 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:20.503 Verification LBA range: start 0x0 length 0x2000 00:20:20.503 TLSTESTn1 : 10.02 3575.56 13.97 0.00 0.00 35730.79 5971.06 36311.80 00:20:20.503 =================================================================================================================== 00:20:20.503 Total : 3575.56 13.97 0.00 0.00 35730.79 5971.06 36311.80 00:20:20.503 0 00:20:20.503 05:04:59 -- target/tls.sh@213 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:20.503 05:04:59 -- target/tls.sh@214 -- # killprocess 2418817 00:20:20.503 05:04:59 -- common/autotest_common.sh@936 -- # '[' -z 2418817 ']' 00:20:20.503 05:04:59 -- common/autotest_common.sh@940 -- # kill -0 2418817 00:20:20.503 05:04:59 -- common/autotest_common.sh@941 -- # uname 00:20:20.503 05:04:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:20.503 05:04:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2418817 00:20:20.504 05:04:59 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:20.504 05:04:59 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:20.504 05:04:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2418817' 00:20:20.504 killing process with pid 2418817 00:20:20.504 05:04:59 -- common/autotest_common.sh@955 -- # kill 2418817 00:20:20.504 Received shutdown signal, test time was about 10.000000 seconds 00:20:20.504 00:20:20.504 Latency(us) 00:20:20.504 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:20.504 =================================================================================================================== 00:20:20.504 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:20.504 [2024-04-23 05:04:59.639342] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:20:20.504 05:04:59 -- common/autotest_common.sh@960 -- # wait 2418817 00:20:20.761 05:04:59 -- target/tls.sh@215 -- # killprocess 2418664 00:20:20.761 05:04:59 -- common/autotest_common.sh@936 -- # '[' -z 2418664 ']' 00:20:20.761 05:04:59 -- common/autotest_common.sh@940 -- # kill -0 2418664 00:20:20.761 05:04:59 -- common/autotest_common.sh@941 -- # uname 00:20:20.761 05:04:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:20.761 05:04:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2418664 00:20:20.761 05:04:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:20.761 05:04:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:20.761 05:04:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2418664' 00:20:20.761 killing process with pid 2418664 00:20:20.761 05:04:59 -- common/autotest_common.sh@955 -- # kill 2418664 00:20:20.761 [2024-04-23 05:04:59.894463] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:20:20.761 05:04:59 -- common/autotest_common.sh@960 -- # wait 2418664 00:20:21.018 05:05:00 -- target/tls.sh@218 -- # nvmfappstart 00:20:21.018 05:05:00 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:21.018 05:05:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:21.018 05:05:00 -- common/autotest_common.sh@10 -- # set +x 00:20:21.018 05:05:00 -- nvmf/common.sh@470 -- # nvmfpid=2420150 00:20:21.018 05:05:00 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:20:21.018 05:05:00 -- nvmf/common.sh@471 -- # waitforlisten 2420150 00:20:21.018 05:05:00 -- common/autotest_common.sh@817 -- # '[' -z 2420150 ']' 00:20:21.018 05:05:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:21.018 05:05:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:21.018 05:05:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:21.018 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:21.018 05:05:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:21.018 05:05:00 -- common/autotest_common.sh@10 -- # set +x 00:20:21.278 [2024-04-23 05:05:00.191053] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:21.278 [2024-04-23 05:05:00.191137] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:21.278 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.278 [2024-04-23 05:05:00.228967] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:21.278 [2024-04-23 05:05:00.256996] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:21.278 [2024-04-23 05:05:00.340415] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:21.278 [2024-04-23 05:05:00.340471] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:21.278 [2024-04-23 05:05:00.340494] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:21.278 [2024-04-23 05:05:00.340530] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:21.278 [2024-04-23 05:05:00.340543] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:21.278 [2024-04-23 05:05:00.340592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:21.565 05:05:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:21.565 05:05:00 -- common/autotest_common.sh@850 -- # return 0 00:20:21.565 05:05:00 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:21.565 05:05:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:21.565 05:05:00 -- common/autotest_common.sh@10 -- # set +x 00:20:21.565 05:05:00 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:21.565 05:05:00 -- target/tls.sh@219 -- # setup_nvmf_tgt /tmp/tmp.nafEgLW9h1 00:20:21.565 05:05:00 -- target/tls.sh@49 -- # local key=/tmp/tmp.nafEgLW9h1 00:20:21.565 05:05:00 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:21.823 [2024-04-23 05:05:00.754271] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:21.823 05:05:00 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:22.081 05:05:01 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:22.339 [2024-04-23 05:05:01.291696] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:22.339 [2024-04-23 05:05:01.291958] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:22.339 05:05:01 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:22.597 malloc0 00:20:22.597 05:05:01 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:22.855 05:05:01 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.nafEgLW9h1 00:20:23.113 [2024-04-23 05:05:02.093924] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:20:23.113 05:05:02 -- target/tls.sh@222 -- # bdevperf_pid=2420434 00:20:23.113 05:05:02 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:20:23.113 05:05:02 -- target/tls.sh@224 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:23.113 05:05:02 -- target/tls.sh@225 -- # waitforlisten 2420434 /var/tmp/bdevperf.sock 00:20:23.113 05:05:02 -- common/autotest_common.sh@817 -- # '[' -z 2420434 ']' 00:20:23.113 05:05:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:23.113 05:05:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:23.113 05:05:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:23.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:23.113 05:05:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:23.113 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:20:23.113 [2024-04-23 05:05:02.156563] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:23.113 [2024-04-23 05:05:02.156644] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2420434 ] 00:20:23.113 EAL: No free 2048 kB hugepages reported on node 1 00:20:23.113 [2024-04-23 05:05:02.188222] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:23.113 [2024-04-23 05:05:02.215673] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:23.371 [2024-04-23 05:05:02.300774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:23.371 05:05:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:23.371 05:05:02 -- common/autotest_common.sh@850 -- # return 0 00:20:23.371 05:05:02 -- target/tls.sh@227 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.nafEgLW9h1 00:20:23.629 05:05:02 -- target/tls.sh@228 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:23.887 [2024-04-23 05:05:02.912193] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:23.887 nvme0n1 00:20:23.887 05:05:03 -- target/tls.sh@232 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:24.146 Running I/O for 1 seconds... 00:20:25.086 00:20:25.086 Latency(us) 00:20:25.086 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:25.086 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:20:25.086 Verification LBA range: start 0x0 length 0x2000 00:20:25.086 nvme0n1 : 1.03 3217.29 12.57 0.00 0.00 39148.53 6262.33 37671.06 00:20:25.086 =================================================================================================================== 00:20:25.086 Total : 3217.29 12.57 0.00 0.00 39148.53 6262.33 37671.06 00:20:25.086 0 00:20:25.086 05:05:04 -- target/tls.sh@234 -- # killprocess 2420434 00:20:25.086 05:05:04 -- common/autotest_common.sh@936 -- # '[' -z 2420434 ']' 00:20:25.086 05:05:04 -- common/autotest_common.sh@940 -- # kill -0 2420434 00:20:25.086 05:05:04 -- common/autotest_common.sh@941 -- # uname 00:20:25.086 05:05:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:25.086 05:05:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2420434 00:20:25.086 05:05:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:25.086 05:05:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:25.086 05:05:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2420434' 00:20:25.086 killing process with pid 2420434 00:20:25.086 05:05:04 -- common/autotest_common.sh@955 -- # kill 2420434 00:20:25.086 Received shutdown signal, test time was about 1.000000 seconds 00:20:25.086 00:20:25.086 Latency(us) 00:20:25.086 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:25.086 =================================================================================================================== 00:20:25.086 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:25.086 05:05:04 -- common/autotest_common.sh@960 -- # wait 2420434 00:20:25.347 05:05:04 -- target/tls.sh@235 -- # killprocess 2420150 00:20:25.347 05:05:04 -- common/autotest_common.sh@936 -- # '[' -z 2420150 ']' 00:20:25.347 05:05:04 -- common/autotest_common.sh@940 -- # kill -0 2420150 00:20:25.347 05:05:04 -- common/autotest_common.sh@941 -- # uname 00:20:25.347 05:05:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:25.347 05:05:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2420150 00:20:25.347 05:05:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:25.347 05:05:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:25.347 05:05:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2420150' 00:20:25.347 killing process with pid 2420150 00:20:25.347 05:05:04 -- common/autotest_common.sh@955 -- # kill 2420150 00:20:25.347 [2024-04-23 05:05:04.442734] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:20:25.347 05:05:04 -- common/autotest_common.sh@960 -- # wait 2420150 00:20:25.606 05:05:04 -- target/tls.sh@238 -- # nvmfappstart 00:20:25.606 05:05:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:25.606 05:05:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:25.606 05:05:04 -- common/autotest_common.sh@10 -- # set +x 00:20:25.606 05:05:04 -- nvmf/common.sh@470 -- # nvmfpid=2420710 00:20:25.606 05:05:04 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:20:25.606 05:05:04 -- nvmf/common.sh@471 -- # waitforlisten 2420710 00:20:25.606 05:05:04 -- common/autotest_common.sh@817 -- # '[' -z 2420710 ']' 00:20:25.606 05:05:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:25.606 05:05:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:25.606 05:05:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:25.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:25.606 05:05:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:25.606 05:05:04 -- common/autotest_common.sh@10 -- # set +x 00:20:25.606 [2024-04-23 05:05:04.743450] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:25.606 [2024-04-23 05:05:04.743551] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:25.864 EAL: No free 2048 kB hugepages reported on node 1 00:20:25.864 [2024-04-23 05:05:04.781523] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:25.864 [2024-04-23 05:05:04.813198] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:25.864 [2024-04-23 05:05:04.898080] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:25.864 [2024-04-23 05:05:04.898149] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:25.864 [2024-04-23 05:05:04.898175] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:25.864 [2024-04-23 05:05:04.898188] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:25.864 [2024-04-23 05:05:04.898200] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:25.864 [2024-04-23 05:05:04.898231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:25.864 05:05:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:25.864 05:05:05 -- common/autotest_common.sh@850 -- # return 0 00:20:25.864 05:05:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:25.864 05:05:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:25.864 05:05:05 -- common/autotest_common.sh@10 -- # set +x 00:20:26.123 05:05:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:26.123 05:05:05 -- target/tls.sh@239 -- # rpc_cmd 00:20:26.123 05:05:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.123 05:05:05 -- common/autotest_common.sh@10 -- # set +x 00:20:26.123 [2024-04-23 05:05:05.045086] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:26.123 malloc0 00:20:26.123 [2024-04-23 05:05:05.078060] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:26.123 [2024-04-23 05:05:05.078391] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:26.123 05:05:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.123 05:05:05 -- target/tls.sh@252 -- # bdevperf_pid=2420735 00:20:26.123 05:05:05 -- target/tls.sh@250 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:20:26.123 05:05:05 -- target/tls.sh@254 -- # waitforlisten 2420735 /var/tmp/bdevperf.sock 00:20:26.123 05:05:05 -- common/autotest_common.sh@817 -- # '[' -z 2420735 ']' 00:20:26.123 05:05:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:26.123 05:05:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:26.123 05:05:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:26.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:26.123 05:05:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:26.123 05:05:05 -- common/autotest_common.sh@10 -- # set +x 00:20:26.123 [2024-04-23 05:05:05.148154] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:26.123 [2024-04-23 05:05:05.148216] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2420735 ] 00:20:26.123 EAL: No free 2048 kB hugepages reported on node 1 00:20:26.123 [2024-04-23 05:05:05.183193] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:26.123 [2024-04-23 05:05:05.214141] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:26.380 [2024-04-23 05:05:05.305939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:26.380 05:05:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:26.381 05:05:05 -- common/autotest_common.sh@850 -- # return 0 00:20:26.381 05:05:05 -- target/tls.sh@255 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.nafEgLW9h1 00:20:26.639 05:05:05 -- target/tls.sh@256 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:26.897 [2024-04-23 05:05:05.924622] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:26.897 nvme0n1 00:20:26.897 05:05:06 -- target/tls.sh@260 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:27.155 Running I/O for 1 seconds... 00:20:28.094 00:20:28.094 Latency(us) 00:20:28.094 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.094 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:20:28.094 Verification LBA range: start 0x0 length 0x2000 00:20:28.094 nvme0n1 : 1.03 3525.18 13.77 0.00 0.00 35853.48 6407.96 37865.24 00:20:28.094 =================================================================================================================== 00:20:28.094 Total : 3525.18 13.77 0.00 0.00 35853.48 6407.96 37865.24 00:20:28.094 0 00:20:28.094 05:05:07 -- target/tls.sh@263 -- # rpc_cmd save_config 00:20:28.094 05:05:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.094 05:05:07 -- common/autotest_common.sh@10 -- # set +x 00:20:28.352 05:05:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.353 05:05:07 -- target/tls.sh@263 -- # tgtcfg='{ 00:20:28.353 "subsystems": [ 00:20:28.353 { 00:20:28.353 "subsystem": "keyring", 00:20:28.353 "config": [ 00:20:28.353 { 00:20:28.353 "method": "keyring_file_add_key", 00:20:28.353 "params": { 00:20:28.353 "name": "key0", 00:20:28.353 "path": "/tmp/tmp.nafEgLW9h1" 00:20:28.353 } 00:20:28.353 } 00:20:28.353 ] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "iobuf", 00:20:28.353 "config": [ 00:20:28.353 { 00:20:28.353 "method": "iobuf_set_options", 00:20:28.353 "params": { 00:20:28.353 "small_pool_count": 8192, 00:20:28.353 "large_pool_count": 1024, 00:20:28.353 "small_bufsize": 8192, 00:20:28.353 "large_bufsize": 135168 00:20:28.353 } 00:20:28.353 } 00:20:28.353 ] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "sock", 00:20:28.353 "config": [ 00:20:28.353 { 00:20:28.353 "method": "sock_impl_set_options", 00:20:28.353 "params": { 00:20:28.353 "impl_name": "posix", 00:20:28.353 "recv_buf_size": 2097152, 00:20:28.353 "send_buf_size": 2097152, 00:20:28.353 "enable_recv_pipe": true, 00:20:28.353 "enable_quickack": false, 00:20:28.353 "enable_placement_id": 0, 00:20:28.353 "enable_zerocopy_send_server": true, 00:20:28.353 "enable_zerocopy_send_client": false, 00:20:28.353 "zerocopy_threshold": 0, 00:20:28.353 "tls_version": 0, 00:20:28.353 "enable_ktls": false 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "sock_impl_set_options", 00:20:28.353 "params": { 00:20:28.353 "impl_name": "ssl", 00:20:28.353 "recv_buf_size": 4096, 00:20:28.353 "send_buf_size": 4096, 00:20:28.353 "enable_recv_pipe": true, 00:20:28.353 "enable_quickack": false, 00:20:28.353 "enable_placement_id": 0, 00:20:28.353 "enable_zerocopy_send_server": true, 00:20:28.353 "enable_zerocopy_send_client": false, 00:20:28.353 "zerocopy_threshold": 0, 00:20:28.353 "tls_version": 0, 00:20:28.353 "enable_ktls": false 00:20:28.353 } 00:20:28.353 } 00:20:28.353 ] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "vmd", 00:20:28.353 "config": [] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "accel", 00:20:28.353 "config": [ 00:20:28.353 { 00:20:28.353 "method": "accel_set_options", 00:20:28.353 "params": { 00:20:28.353 "small_cache_size": 128, 00:20:28.353 "large_cache_size": 16, 00:20:28.353 "task_count": 2048, 00:20:28.353 "sequence_count": 2048, 00:20:28.353 "buf_count": 2048 00:20:28.353 } 00:20:28.353 } 00:20:28.353 ] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "bdev", 00:20:28.353 "config": [ 00:20:28.353 { 00:20:28.353 "method": "bdev_set_options", 00:20:28.353 "params": { 00:20:28.353 "bdev_io_pool_size": 65535, 00:20:28.353 "bdev_io_cache_size": 256, 00:20:28.353 "bdev_auto_examine": true, 00:20:28.353 "iobuf_small_cache_size": 128, 00:20:28.353 "iobuf_large_cache_size": 16 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "bdev_raid_set_options", 00:20:28.353 "params": { 00:20:28.353 "process_window_size_kb": 1024 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "bdev_iscsi_set_options", 00:20:28.353 "params": { 00:20:28.353 "timeout_sec": 30 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "bdev_nvme_set_options", 00:20:28.353 "params": { 00:20:28.353 "action_on_timeout": "none", 00:20:28.353 "timeout_us": 0, 00:20:28.353 "timeout_admin_us": 0, 00:20:28.353 "keep_alive_timeout_ms": 10000, 00:20:28.353 "arbitration_burst": 0, 00:20:28.353 "low_priority_weight": 0, 00:20:28.353 "medium_priority_weight": 0, 00:20:28.353 "high_priority_weight": 0, 00:20:28.353 "nvme_adminq_poll_period_us": 10000, 00:20:28.353 "nvme_ioq_poll_period_us": 0, 00:20:28.353 "io_queue_requests": 0, 00:20:28.353 "delay_cmd_submit": true, 00:20:28.353 "transport_retry_count": 4, 00:20:28.353 "bdev_retry_count": 3, 00:20:28.353 "transport_ack_timeout": 0, 00:20:28.353 "ctrlr_loss_timeout_sec": 0, 00:20:28.353 "reconnect_delay_sec": 0, 00:20:28.353 "fast_io_fail_timeout_sec": 0, 00:20:28.353 "disable_auto_failback": false, 00:20:28.353 "generate_uuids": false, 00:20:28.353 "transport_tos": 0, 00:20:28.353 "nvme_error_stat": false, 00:20:28.353 "rdma_srq_size": 0, 00:20:28.353 "io_path_stat": false, 00:20:28.353 "allow_accel_sequence": false, 00:20:28.353 "rdma_max_cq_size": 0, 00:20:28.353 "rdma_cm_event_timeout_ms": 0, 00:20:28.353 "dhchap_digests": [ 00:20:28.353 "sha256", 00:20:28.353 "sha384", 00:20:28.353 "sha512" 00:20:28.353 ], 00:20:28.353 "dhchap_dhgroups": [ 00:20:28.353 "null", 00:20:28.353 "ffdhe2048", 00:20:28.353 "ffdhe3072", 00:20:28.353 "ffdhe4096", 00:20:28.353 "ffdhe6144", 00:20:28.353 "ffdhe8192" 00:20:28.353 ] 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "bdev_nvme_set_hotplug", 00:20:28.353 "params": { 00:20:28.353 "period_us": 100000, 00:20:28.353 "enable": false 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "bdev_malloc_create", 00:20:28.353 "params": { 00:20:28.353 "name": "malloc0", 00:20:28.353 "num_blocks": 8192, 00:20:28.353 "block_size": 4096, 00:20:28.353 "physical_block_size": 4096, 00:20:28.353 "uuid": "66c4d92f-8553-43a9-9210-7d56e72dbe99", 00:20:28.353 "optimal_io_boundary": 0 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "bdev_wait_for_examine" 00:20:28.353 } 00:20:28.353 ] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "nbd", 00:20:28.353 "config": [] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "scheduler", 00:20:28.353 "config": [ 00:20:28.353 { 00:20:28.353 "method": "framework_set_scheduler", 00:20:28.353 "params": { 00:20:28.353 "name": "static" 00:20:28.353 } 00:20:28.353 } 00:20:28.353 ] 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "subsystem": "nvmf", 00:20:28.353 "config": [ 00:20:28.353 { 00:20:28.353 "method": "nvmf_set_config", 00:20:28.353 "params": { 00:20:28.353 "discovery_filter": "match_any", 00:20:28.353 "admin_cmd_passthru": { 00:20:28.353 "identify_ctrlr": false 00:20:28.353 } 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "nvmf_set_max_subsystems", 00:20:28.353 "params": { 00:20:28.353 "max_subsystems": 1024 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "nvmf_set_crdt", 00:20:28.353 "params": { 00:20:28.353 "crdt1": 0, 00:20:28.353 "crdt2": 0, 00:20:28.353 "crdt3": 0 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "nvmf_create_transport", 00:20:28.353 "params": { 00:20:28.353 "trtype": "TCP", 00:20:28.353 "max_queue_depth": 128, 00:20:28.353 "max_io_qpairs_per_ctrlr": 127, 00:20:28.353 "in_capsule_data_size": 4096, 00:20:28.353 "max_io_size": 131072, 00:20:28.353 "io_unit_size": 131072, 00:20:28.353 "max_aq_depth": 128, 00:20:28.353 "num_shared_buffers": 511, 00:20:28.353 "buf_cache_size": 4294967295, 00:20:28.353 "dif_insert_or_strip": false, 00:20:28.353 "zcopy": false, 00:20:28.353 "c2h_success": false, 00:20:28.353 "sock_priority": 0, 00:20:28.353 "abort_timeout_sec": 1, 00:20:28.353 "ack_timeout": 0, 00:20:28.353 "data_wr_pool_size": 0 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "nvmf_create_subsystem", 00:20:28.353 "params": { 00:20:28.353 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:28.353 "allow_any_host": false, 00:20:28.353 "serial_number": "00000000000000000000", 00:20:28.353 "model_number": "SPDK bdev Controller", 00:20:28.353 "max_namespaces": 32, 00:20:28.353 "min_cntlid": 1, 00:20:28.353 "max_cntlid": 65519, 00:20:28.353 "ana_reporting": false 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "nvmf_subsystem_add_host", 00:20:28.353 "params": { 00:20:28.353 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:28.353 "host": "nqn.2016-06.io.spdk:host1", 00:20:28.353 "psk": "key0" 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "nvmf_subsystem_add_ns", 00:20:28.353 "params": { 00:20:28.353 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:28.353 "namespace": { 00:20:28.353 "nsid": 1, 00:20:28.353 "bdev_name": "malloc0", 00:20:28.353 "nguid": "66C4D92F855343A992107D56E72DBE99", 00:20:28.353 "uuid": "66c4d92f-8553-43a9-9210-7d56e72dbe99", 00:20:28.353 "no_auto_visible": false 00:20:28.353 } 00:20:28.353 } 00:20:28.353 }, 00:20:28.353 { 00:20:28.353 "method": "nvmf_subsystem_add_listener", 00:20:28.353 "params": { 00:20:28.353 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:28.353 "listen_address": { 00:20:28.353 "trtype": "TCP", 00:20:28.353 "adrfam": "IPv4", 00:20:28.353 "traddr": "10.0.0.2", 00:20:28.353 "trsvcid": "4420" 00:20:28.353 }, 00:20:28.353 "secure_channel": true 00:20:28.353 } 00:20:28.353 } 00:20:28.353 ] 00:20:28.354 } 00:20:28.354 ] 00:20:28.354 }' 00:20:28.354 05:05:07 -- target/tls.sh@264 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:28.614 05:05:07 -- target/tls.sh@264 -- # bperfcfg='{ 00:20:28.614 "subsystems": [ 00:20:28.614 { 00:20:28.614 "subsystem": "keyring", 00:20:28.614 "config": [ 00:20:28.614 { 00:20:28.614 "method": "keyring_file_add_key", 00:20:28.614 "params": { 00:20:28.614 "name": "key0", 00:20:28.614 "path": "/tmp/tmp.nafEgLW9h1" 00:20:28.614 } 00:20:28.614 } 00:20:28.614 ] 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "subsystem": "iobuf", 00:20:28.614 "config": [ 00:20:28.614 { 00:20:28.614 "method": "iobuf_set_options", 00:20:28.614 "params": { 00:20:28.614 "small_pool_count": 8192, 00:20:28.614 "large_pool_count": 1024, 00:20:28.614 "small_bufsize": 8192, 00:20:28.614 "large_bufsize": 135168 00:20:28.614 } 00:20:28.614 } 00:20:28.614 ] 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "subsystem": "sock", 00:20:28.614 "config": [ 00:20:28.614 { 00:20:28.614 "method": "sock_impl_set_options", 00:20:28.614 "params": { 00:20:28.614 "impl_name": "posix", 00:20:28.614 "recv_buf_size": 2097152, 00:20:28.614 "send_buf_size": 2097152, 00:20:28.614 "enable_recv_pipe": true, 00:20:28.614 "enable_quickack": false, 00:20:28.614 "enable_placement_id": 0, 00:20:28.614 "enable_zerocopy_send_server": true, 00:20:28.614 "enable_zerocopy_send_client": false, 00:20:28.614 "zerocopy_threshold": 0, 00:20:28.614 "tls_version": 0, 00:20:28.614 "enable_ktls": false 00:20:28.614 } 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "method": "sock_impl_set_options", 00:20:28.614 "params": { 00:20:28.614 "impl_name": "ssl", 00:20:28.614 "recv_buf_size": 4096, 00:20:28.614 "send_buf_size": 4096, 00:20:28.614 "enable_recv_pipe": true, 00:20:28.614 "enable_quickack": false, 00:20:28.614 "enable_placement_id": 0, 00:20:28.614 "enable_zerocopy_send_server": true, 00:20:28.614 "enable_zerocopy_send_client": false, 00:20:28.614 "zerocopy_threshold": 0, 00:20:28.614 "tls_version": 0, 00:20:28.614 "enable_ktls": false 00:20:28.614 } 00:20:28.614 } 00:20:28.614 ] 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "subsystem": "vmd", 00:20:28.614 "config": [] 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "subsystem": "accel", 00:20:28.614 "config": [ 00:20:28.614 { 00:20:28.614 "method": "accel_set_options", 00:20:28.614 "params": { 00:20:28.614 "small_cache_size": 128, 00:20:28.614 "large_cache_size": 16, 00:20:28.614 "task_count": 2048, 00:20:28.614 "sequence_count": 2048, 00:20:28.614 "buf_count": 2048 00:20:28.614 } 00:20:28.614 } 00:20:28.614 ] 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "subsystem": "bdev", 00:20:28.614 "config": [ 00:20:28.614 { 00:20:28.614 "method": "bdev_set_options", 00:20:28.614 "params": { 00:20:28.614 "bdev_io_pool_size": 65535, 00:20:28.614 "bdev_io_cache_size": 256, 00:20:28.614 "bdev_auto_examine": true, 00:20:28.614 "iobuf_small_cache_size": 128, 00:20:28.614 "iobuf_large_cache_size": 16 00:20:28.614 } 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "method": "bdev_raid_set_options", 00:20:28.614 "params": { 00:20:28.614 "process_window_size_kb": 1024 00:20:28.614 } 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "method": "bdev_iscsi_set_options", 00:20:28.614 "params": { 00:20:28.614 "timeout_sec": 30 00:20:28.614 } 00:20:28.614 }, 00:20:28.614 { 00:20:28.614 "method": "bdev_nvme_set_options", 00:20:28.614 "params": { 00:20:28.614 "action_on_timeout": "none", 00:20:28.614 "timeout_us": 0, 00:20:28.614 "timeout_admin_us": 0, 00:20:28.614 "keep_alive_timeout_ms": 10000, 00:20:28.614 "arbitration_burst": 0, 00:20:28.614 "low_priority_weight": 0, 00:20:28.614 "medium_priority_weight": 0, 00:20:28.614 "high_priority_weight": 0, 00:20:28.614 "nvme_adminq_poll_period_us": 10000, 00:20:28.614 "nvme_ioq_poll_period_us": 0, 00:20:28.614 "io_queue_requests": 512, 00:20:28.614 "delay_cmd_submit": true, 00:20:28.614 "transport_retry_count": 4, 00:20:28.614 "bdev_retry_count": 3, 00:20:28.614 "transport_ack_timeout": 0, 00:20:28.614 "ctrlr_loss_timeout_sec": 0, 00:20:28.614 "reconnect_delay_sec": 0, 00:20:28.614 "fast_io_fail_timeout_sec": 0, 00:20:28.614 "disable_auto_failback": false, 00:20:28.614 "generate_uuids": false, 00:20:28.614 "transport_tos": 0, 00:20:28.614 "nvme_error_stat": false, 00:20:28.614 "rdma_srq_size": 0, 00:20:28.614 "io_path_stat": false, 00:20:28.614 "allow_accel_sequence": false, 00:20:28.614 "rdma_max_cq_size": 0, 00:20:28.614 "rdma_cm_event_timeout_ms": 0, 00:20:28.614 "dhchap_digests": [ 00:20:28.614 "sha256", 00:20:28.614 "sha384", 00:20:28.614 "sha512" 00:20:28.614 ], 00:20:28.614 "dhchap_dhgroups": [ 00:20:28.614 "null", 00:20:28.614 "ffdhe2048", 00:20:28.614 "ffdhe3072", 00:20:28.614 "ffdhe4096", 00:20:28.614 "ffdhe6144", 00:20:28.614 "ffdhe8192" 00:20:28.614 ] 00:20:28.614 } 00:20:28.615 }, 00:20:28.615 { 00:20:28.615 "method": "bdev_nvme_attach_controller", 00:20:28.615 "params": { 00:20:28.615 "name": "nvme0", 00:20:28.615 "trtype": "TCP", 00:20:28.615 "adrfam": "IPv4", 00:20:28.615 "traddr": "10.0.0.2", 00:20:28.615 "trsvcid": "4420", 00:20:28.615 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:28.615 "prchk_reftag": false, 00:20:28.615 "prchk_guard": false, 00:20:28.615 "ctrlr_loss_timeout_sec": 0, 00:20:28.615 "reconnect_delay_sec": 0, 00:20:28.615 "fast_io_fail_timeout_sec": 0, 00:20:28.615 "psk": "key0", 00:20:28.615 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:28.615 "hdgst": false, 00:20:28.615 "ddgst": false 00:20:28.615 } 00:20:28.615 }, 00:20:28.615 { 00:20:28.615 "method": "bdev_nvme_set_hotplug", 00:20:28.615 "params": { 00:20:28.615 "period_us": 100000, 00:20:28.615 "enable": false 00:20:28.615 } 00:20:28.615 }, 00:20:28.615 { 00:20:28.615 "method": "bdev_enable_histogram", 00:20:28.615 "params": { 00:20:28.615 "name": "nvme0n1", 00:20:28.615 "enable": true 00:20:28.615 } 00:20:28.615 }, 00:20:28.615 { 00:20:28.615 "method": "bdev_wait_for_examine" 00:20:28.615 } 00:20:28.615 ] 00:20:28.615 }, 00:20:28.615 { 00:20:28.615 "subsystem": "nbd", 00:20:28.615 "config": [] 00:20:28.615 } 00:20:28.615 ] 00:20:28.615 }' 00:20:28.615 05:05:07 -- target/tls.sh@266 -- # killprocess 2420735 00:20:28.615 05:05:07 -- common/autotest_common.sh@936 -- # '[' -z 2420735 ']' 00:20:28.615 05:05:07 -- common/autotest_common.sh@940 -- # kill -0 2420735 00:20:28.615 05:05:07 -- common/autotest_common.sh@941 -- # uname 00:20:28.615 05:05:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:28.615 05:05:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2420735 00:20:28.615 05:05:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:28.615 05:05:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:28.615 05:05:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2420735' 00:20:28.615 killing process with pid 2420735 00:20:28.615 05:05:07 -- common/autotest_common.sh@955 -- # kill 2420735 00:20:28.615 Received shutdown signal, test time was about 1.000000 seconds 00:20:28.615 00:20:28.615 Latency(us) 00:20:28.615 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.615 =================================================================================================================== 00:20:28.615 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:28.615 05:05:07 -- common/autotest_common.sh@960 -- # wait 2420735 00:20:28.875 05:05:07 -- target/tls.sh@267 -- # killprocess 2420710 00:20:28.875 05:05:07 -- common/autotest_common.sh@936 -- # '[' -z 2420710 ']' 00:20:28.875 05:05:07 -- common/autotest_common.sh@940 -- # kill -0 2420710 00:20:28.875 05:05:07 -- common/autotest_common.sh@941 -- # uname 00:20:28.875 05:05:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:28.875 05:05:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2420710 00:20:28.875 05:05:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:28.875 05:05:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:28.875 05:05:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2420710' 00:20:28.875 killing process with pid 2420710 00:20:28.875 05:05:07 -- common/autotest_common.sh@955 -- # kill 2420710 00:20:28.875 05:05:07 -- common/autotest_common.sh@960 -- # wait 2420710 00:20:29.134 05:05:08 -- target/tls.sh@269 -- # nvmfappstart -c /dev/fd/62 00:20:29.134 05:05:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:29.134 05:05:08 -- target/tls.sh@269 -- # echo '{ 00:20:29.134 "subsystems": [ 00:20:29.134 { 00:20:29.134 "subsystem": "keyring", 00:20:29.134 "config": [ 00:20:29.134 { 00:20:29.134 "method": "keyring_file_add_key", 00:20:29.134 "params": { 00:20:29.134 "name": "key0", 00:20:29.134 "path": "/tmp/tmp.nafEgLW9h1" 00:20:29.134 } 00:20:29.134 } 00:20:29.134 ] 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "subsystem": "iobuf", 00:20:29.134 "config": [ 00:20:29.134 { 00:20:29.134 "method": "iobuf_set_options", 00:20:29.134 "params": { 00:20:29.134 "small_pool_count": 8192, 00:20:29.134 "large_pool_count": 1024, 00:20:29.134 "small_bufsize": 8192, 00:20:29.134 "large_bufsize": 135168 00:20:29.134 } 00:20:29.134 } 00:20:29.134 ] 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "subsystem": "sock", 00:20:29.134 "config": [ 00:20:29.134 { 00:20:29.134 "method": "sock_impl_set_options", 00:20:29.134 "params": { 00:20:29.134 "impl_name": "posix", 00:20:29.134 "recv_buf_size": 2097152, 00:20:29.134 "send_buf_size": 2097152, 00:20:29.134 "enable_recv_pipe": true, 00:20:29.134 "enable_quickack": false, 00:20:29.134 "enable_placement_id": 0, 00:20:29.134 "enable_zerocopy_send_server": true, 00:20:29.134 "enable_zerocopy_send_client": false, 00:20:29.134 "zerocopy_threshold": 0, 00:20:29.134 "tls_version": 0, 00:20:29.134 "enable_ktls": false 00:20:29.134 } 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "method": "sock_impl_set_options", 00:20:29.134 "params": { 00:20:29.134 "impl_name": "ssl", 00:20:29.134 "recv_buf_size": 4096, 00:20:29.134 "send_buf_size": 4096, 00:20:29.134 "enable_recv_pipe": true, 00:20:29.134 "enable_quickack": false, 00:20:29.134 "enable_placement_id": 0, 00:20:29.134 "enable_zerocopy_send_server": true, 00:20:29.134 "enable_zerocopy_send_client": false, 00:20:29.134 "zerocopy_threshold": 0, 00:20:29.134 "tls_version": 0, 00:20:29.134 "enable_ktls": false 00:20:29.134 } 00:20:29.134 } 00:20:29.134 ] 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "subsystem": "vmd", 00:20:29.134 "config": [] 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "subsystem": "accel", 00:20:29.134 "config": [ 00:20:29.134 { 00:20:29.134 "method": "accel_set_options", 00:20:29.134 "params": { 00:20:29.134 "small_cache_size": 128, 00:20:29.134 "large_cache_size": 16, 00:20:29.134 "task_count": 2048, 00:20:29.134 "sequence_count": 2048, 00:20:29.134 "buf_count": 2048 00:20:29.134 } 00:20:29.134 } 00:20:29.134 ] 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "subsystem": "bdev", 00:20:29.134 "config": [ 00:20:29.134 { 00:20:29.134 "method": "bdev_set_options", 00:20:29.134 "params": { 00:20:29.134 "bdev_io_pool_size": 65535, 00:20:29.134 "bdev_io_cache_size": 256, 00:20:29.134 "bdev_auto_examine": true, 00:20:29.134 "iobuf_small_cache_size": 128, 00:20:29.134 "iobuf_large_cache_size": 16 00:20:29.134 } 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "method": "bdev_raid_set_options", 00:20:29.134 "params": { 00:20:29.134 "process_window_size_kb": 1024 00:20:29.134 } 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "method": "bdev_iscsi_set_options", 00:20:29.134 "params": { 00:20:29.134 "timeout_sec": 30 00:20:29.134 } 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "method": "bdev_nvme_set_options", 00:20:29.134 "params": { 00:20:29.134 "action_on_timeout": "none", 00:20:29.134 "timeout_us": 0, 00:20:29.134 "timeout_admin_us": 0, 00:20:29.134 "keep_alive_timeout_ms": 10000, 00:20:29.134 "arbitration_burst": 0, 00:20:29.134 "low_priority_weight": 0, 00:20:29.134 "medium_priority_weight": 0, 00:20:29.134 "high_priority_weight": 0, 00:20:29.134 "nvme_adminq_poll_period_us": 10000, 00:20:29.134 "nvme_ioq_poll_period_us": 0, 00:20:29.134 "io_queue_requests": 0, 00:20:29.134 "delay_cmd_submit": true, 00:20:29.134 "transport_retry_count": 4, 00:20:29.134 "bdev_retry_count": 3, 00:20:29.134 "transport_ack_timeout": 0, 00:20:29.134 "ctrlr_loss_timeout_sec": 0, 00:20:29.134 "reconnect_delay_sec": 0, 00:20:29.134 "fast_io_fail_timeout_sec": 0, 00:20:29.134 "disable_auto_failback": false, 00:20:29.134 "generate_uuids": false, 00:20:29.134 "transport_tos": 0, 00:20:29.134 "nvme_error_stat": false, 00:20:29.134 "rdma_srq_size": 0, 00:20:29.134 "io_path_stat": false, 00:20:29.134 "allow_accel_sequence": false, 00:20:29.134 "rdma_max_cq_size": 0, 00:20:29.134 "rdma_cm_event_timeout_ms": 0, 00:20:29.134 "dhchap_digests": [ 00:20:29.134 "sha256", 00:20:29.134 "sha384", 00:20:29.134 "sha512" 00:20:29.134 ], 00:20:29.134 "dhchap_dhgroups": [ 00:20:29.134 "null", 00:20:29.134 "ffdhe2048", 00:20:29.134 "ffdhe3072", 00:20:29.134 "ffdhe4096", 00:20:29.134 "ffdhe6144", 00:20:29.134 "ffdhe8192" 00:20:29.134 ] 00:20:29.134 } 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "method": "bdev_nvme_set_hotplug", 00:20:29.134 "params": { 00:20:29.134 "period_us": 100000, 00:20:29.134 "enable": false 00:20:29.134 } 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "method": "bdev_malloc_create", 00:20:29.134 "params": { 00:20:29.134 "name": "malloc0", 00:20:29.134 "num_blocks": 8192, 00:20:29.134 "block_size": 4096, 00:20:29.134 "physical_block_size": 4096, 00:20:29.134 "uuid": "66c4d92f-8553-43a9-9210-7d56e72dbe99", 00:20:29.134 "optimal_io_boundary": 0 00:20:29.134 } 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "method": "bdev_wait_for_examine" 00:20:29.134 } 00:20:29.134 ] 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "subsystem": "nbd", 00:20:29.134 "config": [] 00:20:29.134 }, 00:20:29.134 { 00:20:29.134 "subsystem": "scheduler", 00:20:29.134 "config": [ 00:20:29.134 { 00:20:29.134 "method": "framework_set_scheduler", 00:20:29.134 "params": { 00:20:29.134 "name": "static" 00:20:29.134 } 00:20:29.134 } 00:20:29.134 ] 00:20:29.134 }, 00:20:29.134 { 00:20:29.135 "subsystem": "nvmf", 00:20:29.135 "config": [ 00:20:29.135 { 00:20:29.135 "method": "nvmf_set_config", 00:20:29.135 "params": { 00:20:29.135 "discovery_filter": "match_any", 00:20:29.135 "admin_cmd_passthru": { 00:20:29.135 "identify_ctrlr": false 00:20:29.135 } 00:20:29.135 } 00:20:29.135 }, 00:20:29.135 { 00:20:29.135 "method": "nvmf_set_max_subsystems", 00:20:29.135 "params": { 00:20:29.135 "max_subsystems": 1024 00:20:29.135 } 00:20:29.135 }, 00:20:29.135 { 00:20:29.135 "method": "nvmf_set_crdt", 00:20:29.135 "params": { 00:20:29.135 "crdt1": 0, 00:20:29.135 "crdt2": 0, 00:20:29.135 "crdt3": 0 00:20:29.135 } 00:20:29.135 }, 00:20:29.135 { 00:20:29.135 "method": "nvmf_create_transport", 00:20:29.135 "params": { 00:20:29.135 "trtype": "TCP", 00:20:29.135 "max_queue_depth": 128, 00:20:29.135 "max_io_qpairs_per_ctrlr": 127, 00:20:29.135 "in_capsule_data_size": 4096, 00:20:29.135 "max_io_size": 131072, 00:20:29.135 "io_unit_size": 131072, 00:20:29.135 "max_aq_depth": 128, 00:20:29.135 "num_shared_buffers": 511, 00:20:29.135 "buf_cache_size": 4294967295, 00:20:29.135 "dif_insert_or_strip": false, 00:20:29.135 "zcopy": false, 00:20:29.135 "c2h_success": false, 00:20:29.135 "sock_priority": 0, 00:20:29.135 "abort_timeout_sec": 1, 00:20:29.135 "ack_timeout": 0, 00:20:29.135 "data_wr_pool_size": 0 00:20:29.135 } 00:20:29.135 }, 00:20:29.135 { 00:20:29.135 "method": "nvmf_create_subsystem", 00:20:29.135 "params": { 00:20:29.135 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:29.135 "allow_any_host": false, 00:20:29.135 "serial_number": "00000000000000000000", 00:20:29.135 "model_number": "SPDK bdev Controller", 00:20:29.135 "max_namespaces": 32, 00:20:29.135 "min_cntlid": 1, 00:20:29.135 "max_cntlid": 65519, 00:20:29.135 "ana_reporting": false 00:20:29.135 } 00:20:29.135 }, 00:20:29.135 { 00:20:29.135 "method": "nvmf_subsystem_add_host", 00:20:29.135 "params": { 00:20:29.135 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:29.135 "host": "nqn.2016-06.io.spdk:host1", 00:20:29.135 "psk": "key0" 00:20:29.135 } 00:20:29.135 }, 00:20:29.135 { 00:20:29.135 "method": "nvmf_subsystem_add_ns", 00:20:29.135 "params": { 00:20:29.135 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:29.135 "namespace": { 00:20:29.135 "nsid": 1, 00:20:29.135 "bdev_name": "malloc0", 00:20:29.135 "nguid": "66C4D92F855343A992107D56E72DBE99", 00:20:29.135 "uuid": "66c4d92f-8553-43a9-9210-7d56e72dbe99", 00:20:29.135 "no_auto_visible": false 00:20:29.135 } 00:20:29.135 } 00:20:29.135 }, 00:20:29.135 { 00:20:29.135 "method": "nvmf_subsystem_add_listener", 00:20:29.135 "params": { 00:20:29.135 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:29.135 "listen_address": { 00:20:29.135 "trtype": "TCP", 00:20:29.135 "adrfam": "IPv4", 00:20:29.135 "traddr": "10.0.0.2", 00:20:29.135 "trsvcid": "4420" 00:20:29.135 }, 00:20:29.135 "secure_channel": true 00:20:29.135 } 00:20:29.135 } 00:20:29.135 ] 00:20:29.135 } 00:20:29.135 ] 00:20:29.135 }' 00:20:29.135 05:05:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:29.135 05:05:08 -- common/autotest_common.sh@10 -- # set +x 00:20:29.135 05:05:08 -- nvmf/common.sh@470 -- # nvmfpid=2421145 00:20:29.135 05:05:08 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -c /dev/fd/62 00:20:29.135 05:05:08 -- nvmf/common.sh@471 -- # waitforlisten 2421145 00:20:29.135 05:05:08 -- common/autotest_common.sh@817 -- # '[' -z 2421145 ']' 00:20:29.135 05:05:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:29.135 05:05:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:29.135 05:05:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:29.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:29.135 05:05:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:29.135 05:05:08 -- common/autotest_common.sh@10 -- # set +x 00:20:29.135 [2024-04-23 05:05:08.152391] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:29.135 [2024-04-23 05:05:08.152481] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:29.135 EAL: No free 2048 kB hugepages reported on node 1 00:20:29.135 [2024-04-23 05:05:08.190780] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:29.135 [2024-04-23 05:05:08.223710] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:29.393 [2024-04-23 05:05:08.307843] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:29.393 [2024-04-23 05:05:08.307910] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:29.393 [2024-04-23 05:05:08.307936] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:29.393 [2024-04-23 05:05:08.307950] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:29.393 [2024-04-23 05:05:08.307962] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:29.393 [2024-04-23 05:05:08.308054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:29.393 [2024-04-23 05:05:08.544670] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:29.653 [2024-04-23 05:05:08.576663] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:29.653 [2024-04-23 05:05:08.588734] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:30.221 05:05:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:30.221 05:05:09 -- common/autotest_common.sh@850 -- # return 0 00:20:30.221 05:05:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:30.221 05:05:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:30.221 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:20:30.221 05:05:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:30.221 05:05:09 -- target/tls.sh@272 -- # bdevperf_pid=2421298 00:20:30.221 05:05:09 -- target/tls.sh@273 -- # waitforlisten 2421298 /var/tmp/bdevperf.sock 00:20:30.221 05:05:09 -- common/autotest_common.sh@817 -- # '[' -z 2421298 ']' 00:20:30.221 05:05:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:30.221 05:05:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:30.221 05:05:09 -- target/tls.sh@270 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 -c /dev/fd/63 00:20:30.221 05:05:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:30.221 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:30.221 05:05:09 -- target/tls.sh@270 -- # echo '{ 00:20:30.221 "subsystems": [ 00:20:30.221 { 00:20:30.221 "subsystem": "keyring", 00:20:30.221 "config": [ 00:20:30.221 { 00:20:30.221 "method": "keyring_file_add_key", 00:20:30.221 "params": { 00:20:30.221 "name": "key0", 00:20:30.221 "path": "/tmp/tmp.nafEgLW9h1" 00:20:30.221 } 00:20:30.221 } 00:20:30.221 ] 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "subsystem": "iobuf", 00:20:30.221 "config": [ 00:20:30.221 { 00:20:30.221 "method": "iobuf_set_options", 00:20:30.221 "params": { 00:20:30.221 "small_pool_count": 8192, 00:20:30.221 "large_pool_count": 1024, 00:20:30.221 "small_bufsize": 8192, 00:20:30.221 "large_bufsize": 135168 00:20:30.221 } 00:20:30.221 } 00:20:30.221 ] 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "subsystem": "sock", 00:20:30.221 "config": [ 00:20:30.221 { 00:20:30.221 "method": "sock_impl_set_options", 00:20:30.221 "params": { 00:20:30.221 "impl_name": "posix", 00:20:30.221 "recv_buf_size": 2097152, 00:20:30.221 "send_buf_size": 2097152, 00:20:30.221 "enable_recv_pipe": true, 00:20:30.221 "enable_quickack": false, 00:20:30.221 "enable_placement_id": 0, 00:20:30.221 "enable_zerocopy_send_server": true, 00:20:30.221 "enable_zerocopy_send_client": false, 00:20:30.221 "zerocopy_threshold": 0, 00:20:30.221 "tls_version": 0, 00:20:30.221 "enable_ktls": false 00:20:30.221 } 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "method": "sock_impl_set_options", 00:20:30.221 "params": { 00:20:30.221 "impl_name": "ssl", 00:20:30.221 "recv_buf_size": 4096, 00:20:30.221 "send_buf_size": 4096, 00:20:30.221 "enable_recv_pipe": true, 00:20:30.221 "enable_quickack": false, 00:20:30.221 "enable_placement_id": 0, 00:20:30.221 "enable_zerocopy_send_server": true, 00:20:30.221 "enable_zerocopy_send_client": false, 00:20:30.221 "zerocopy_threshold": 0, 00:20:30.221 "tls_version": 0, 00:20:30.221 "enable_ktls": false 00:20:30.221 } 00:20:30.221 } 00:20:30.221 ] 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "subsystem": "vmd", 00:20:30.221 "config": [] 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "subsystem": "accel", 00:20:30.221 "config": [ 00:20:30.221 { 00:20:30.221 "method": "accel_set_options", 00:20:30.221 "params": { 00:20:30.221 "small_cache_size": 128, 00:20:30.221 "large_cache_size": 16, 00:20:30.221 "task_count": 2048, 00:20:30.221 "sequence_count": 2048, 00:20:30.221 "buf_count": 2048 00:20:30.221 } 00:20:30.221 } 00:20:30.221 ] 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "subsystem": "bdev", 00:20:30.221 "config": [ 00:20:30.221 { 00:20:30.221 "method": "bdev_set_options", 00:20:30.221 "params": { 00:20:30.221 "bdev_io_pool_size": 65535, 00:20:30.221 "bdev_io_cache_size": 256, 00:20:30.221 "bdev_auto_examine": true, 00:20:30.221 "iobuf_small_cache_size": 128, 00:20:30.221 "iobuf_large_cache_size": 16 00:20:30.221 } 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "method": "bdev_raid_set_options", 00:20:30.221 "params": { 00:20:30.221 "process_window_size_kb": 1024 00:20:30.221 } 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "method": "bdev_iscsi_set_options", 00:20:30.221 "params": { 00:20:30.221 "timeout_sec": 30 00:20:30.221 } 00:20:30.221 }, 00:20:30.221 { 00:20:30.221 "method": "bdev_nvme_set_options", 00:20:30.221 "params": { 00:20:30.221 "action_on_timeout": "none", 00:20:30.221 "timeout_us": 0, 00:20:30.221 "timeout_admin_us": 0, 00:20:30.221 "keep_alive_timeout_ms": 10000, 00:20:30.221 "arbitration_burst": 0, 00:20:30.221 "low_priority_weight": 0, 00:20:30.221 "medium_priority_weight": 0, 00:20:30.221 "high_priority_weight": 0, 00:20:30.222 "nvme_adminq_poll_period_us": 10000, 00:20:30.222 "nvme_ioq_poll_period_us": 0, 00:20:30.222 "io_queue_requests": 512, 00:20:30.222 "delay_cmd_submit": true, 00:20:30.222 "transport_retry_count": 4, 00:20:30.222 "bdev_retry_count": 3, 00:20:30.222 "transport_ack_timeout": 0, 00:20:30.222 "ctrlr_loss_timeout_sec": 0, 00:20:30.222 "reconnect_delay_sec": 0, 00:20:30.222 "fast_io_fail_timeout_sec": 0, 00:20:30.222 "disable_auto_failback": false, 00:20:30.222 "generate_uuids": false, 00:20:30.222 "transport_tos": 0, 00:20:30.222 "nvme_error_stat": false, 00:20:30.222 "rdma_srq_size": 0, 00:20:30.222 "io_path_stat": false, 00:20:30.222 "allow_accel_sequence": false, 00:20:30.222 "rdma_max_cq_size": 0, 00:20:30.222 "rdma_cm_event_timeout_ms": 0, 00:20:30.222 "dhchap_digests": [ 00:20:30.222 "sha256", 00:20:30.222 "sha384", 00:20:30.222 "sha512" 00:20:30.222 ], 00:20:30.222 "dhchap_dhgroups": [ 00:20:30.222 "null", 00:20:30.222 "ffdhe2048", 00:20:30.222 "ffdhe3072", 00:20:30.222 "ffdhe4096", 00:20:30.222 "ffdhe6144", 00:20:30.222 "ffdhe8192" 00:20:30.222 ] 00:20:30.222 } 00:20:30.222 }, 00:20:30.222 { 00:20:30.222 "method": "bdev_nvme_attach_controller", 00:20:30.222 "params": { 00:20:30.222 "name": "nvme0", 00:20:30.222 "trtype": "TCP", 00:20:30.222 "adrfam": "IPv4", 00:20:30.222 "traddr": "10.0.0.2", 00:20:30.222 "trsvcid": "4420", 00:20:30.222 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.222 "prchk_reftag": false, 00:20:30.222 "prchk_guard": false, 00:20:30.222 "ctrlr_loss_timeout_sec": 0, 00:20:30.222 "reconnect_delay_sec": 0, 00:20:30.222 "fast_io_fail_timeout_sec": 0, 00:20:30.222 "psk": "key0", 00:20:30.222 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:30.222 "hdgst": false, 00:20:30.222 "ddgst": false 00:20:30.222 } 00:20:30.222 }, 00:20:30.222 { 00:20:30.222 "method": "bdev_nvme_set_hotplug", 00:20:30.222 "params": { 00:20:30.222 "period_us": 100000, 00:20:30.222 "enable": false 00:20:30.222 } 00:20:30.222 }, 00:20:30.222 { 00:20:30.222 "method": "bdev_enable_histogram", 00:20:30.222 "params": { 00:20:30.222 "name": "nvme0n1", 00:20:30.222 "enable": true 00:20:30.222 } 00:20:30.222 }, 00:20:30.222 { 00:20:30.222 "method": "bdev_wait_for_examine" 00:20:30.222 } 00:20:30.222 ] 00:20:30.222 }, 00:20:30.222 { 00:20:30.222 "subsystem": "nbd", 00:20:30.222 "config": [] 00:20:30.222 } 00:20:30.222 ] 00:20:30.222 }' 00:20:30.222 05:05:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:30.222 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:20:30.222 [2024-04-23 05:05:09.202343] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:30.222 [2024-04-23 05:05:09.202428] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2421298 ] 00:20:30.222 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.222 [2024-04-23 05:05:09.234491] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:30.222 [2024-04-23 05:05:09.261837] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.222 [2024-04-23 05:05:09.345147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:30.481 [2024-04-23 05:05:09.519535] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:31.049 05:05:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:31.049 05:05:10 -- common/autotest_common.sh@850 -- # return 0 00:20:31.049 05:05:10 -- target/tls.sh@275 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:20:31.049 05:05:10 -- target/tls.sh@275 -- # jq -r '.[].name' 00:20:31.307 05:05:10 -- target/tls.sh@275 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:31.307 05:05:10 -- target/tls.sh@276 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:31.567 Running I/O for 1 seconds... 00:20:32.505 00:20:32.505 Latency(us) 00:20:32.505 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.505 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:20:32.505 Verification LBA range: start 0x0 length 0x2000 00:20:32.505 nvme0n1 : 1.02 3325.40 12.99 0.00 0.00 38060.58 9806.13 38447.79 00:20:32.505 =================================================================================================================== 00:20:32.505 Total : 3325.40 12.99 0.00 0.00 38060.58 9806.13 38447.79 00:20:32.505 0 00:20:32.505 05:05:11 -- target/tls.sh@278 -- # trap - SIGINT SIGTERM EXIT 00:20:32.505 05:05:11 -- target/tls.sh@279 -- # cleanup 00:20:32.505 05:05:11 -- target/tls.sh@15 -- # process_shm --id 0 00:20:32.505 05:05:11 -- common/autotest_common.sh@794 -- # type=--id 00:20:32.505 05:05:11 -- common/autotest_common.sh@795 -- # id=0 00:20:32.505 05:05:11 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:20:32.505 05:05:11 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:32.505 05:05:11 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:20:32.505 05:05:11 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:20:32.505 05:05:11 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:20:32.505 05:05:11 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:32.505 nvmf_trace.0 00:20:32.505 05:05:11 -- common/autotest_common.sh@809 -- # return 0 00:20:32.505 05:05:11 -- target/tls.sh@16 -- # killprocess 2421298 00:20:32.505 05:05:11 -- common/autotest_common.sh@936 -- # '[' -z 2421298 ']' 00:20:32.505 05:05:11 -- common/autotest_common.sh@940 -- # kill -0 2421298 00:20:32.505 05:05:11 -- common/autotest_common.sh@941 -- # uname 00:20:32.505 05:05:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:32.505 05:05:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2421298 00:20:32.764 05:05:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:32.764 05:05:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:32.764 05:05:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2421298' 00:20:32.764 killing process with pid 2421298 00:20:32.764 05:05:11 -- common/autotest_common.sh@955 -- # kill 2421298 00:20:32.764 Received shutdown signal, test time was about 1.000000 seconds 00:20:32.764 00:20:32.764 Latency(us) 00:20:32.764 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.764 =================================================================================================================== 00:20:32.764 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:32.764 05:05:11 -- common/autotest_common.sh@960 -- # wait 2421298 00:20:32.764 05:05:11 -- target/tls.sh@17 -- # nvmftestfini 00:20:32.764 05:05:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:32.764 05:05:11 -- nvmf/common.sh@117 -- # sync 00:20:32.764 05:05:11 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:20:32.764 05:05:11 -- nvmf/common.sh@120 -- # set +e 00:20:32.764 05:05:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:32.764 05:05:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:20:32.764 rmmod nvme_tcp 00:20:33.023 rmmod nvme_fabrics 00:20:33.023 rmmod nvme_keyring 00:20:33.023 05:05:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:33.023 05:05:11 -- nvmf/common.sh@124 -- # set -e 00:20:33.023 05:05:11 -- nvmf/common.sh@125 -- # return 0 00:20:33.023 05:05:11 -- nvmf/common.sh@478 -- # '[' -n 2421145 ']' 00:20:33.023 05:05:11 -- nvmf/common.sh@479 -- # killprocess 2421145 00:20:33.023 05:05:11 -- common/autotest_common.sh@936 -- # '[' -z 2421145 ']' 00:20:33.023 05:05:11 -- common/autotest_common.sh@940 -- # kill -0 2421145 00:20:33.023 05:05:11 -- common/autotest_common.sh@941 -- # uname 00:20:33.023 05:05:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:33.023 05:05:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2421145 00:20:33.023 05:05:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:33.023 05:05:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:33.023 05:05:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2421145' 00:20:33.023 killing process with pid 2421145 00:20:33.023 05:05:11 -- common/autotest_common.sh@955 -- # kill 2421145 00:20:33.023 05:05:11 -- common/autotest_common.sh@960 -- # wait 2421145 00:20:33.284 05:05:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:33.284 05:05:12 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:20:33.284 05:05:12 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:20:33.284 05:05:12 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:33.284 05:05:12 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:20:33.284 05:05:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:33.284 05:05:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:33.284 05:05:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:35.189 05:05:14 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:20:35.189 05:05:14 -- target/tls.sh@18 -- # rm -f /tmp/tmp.pNonMghSiZ /tmp/tmp.Z29ePglaXD /tmp/tmp.nafEgLW9h1 00:20:35.189 00:20:35.189 real 1m18.775s 00:20:35.189 user 2m8.367s 00:20:35.189 sys 0m25.283s 00:20:35.189 05:05:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:35.189 05:05:14 -- common/autotest_common.sh@10 -- # set +x 00:20:35.189 ************************************ 00:20:35.189 END TEST nvmf_tls 00:20:35.189 ************************************ 00:20:35.189 05:05:14 -- nvmf/nvmf.sh@61 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:35.189 05:05:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:35.189 05:05:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:35.189 05:05:14 -- common/autotest_common.sh@10 -- # set +x 00:20:35.448 ************************************ 00:20:35.448 START TEST nvmf_fips 00:20:35.448 ************************************ 00:20:35.448 05:05:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:35.448 * Looking for test storage... 00:20:35.448 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:20:35.448 05:05:14 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:35.448 05:05:14 -- nvmf/common.sh@7 -- # uname -s 00:20:35.448 05:05:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:35.448 05:05:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:35.448 05:05:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:35.448 05:05:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:35.448 05:05:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:35.448 05:05:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:35.448 05:05:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:35.448 05:05:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:35.448 05:05:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:35.448 05:05:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:35.448 05:05:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:35.448 05:05:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:35.448 05:05:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:35.448 05:05:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:35.448 05:05:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:35.448 05:05:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:35.448 05:05:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:35.448 05:05:14 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:35.448 05:05:14 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:35.448 05:05:14 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:35.448 05:05:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.448 05:05:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.448 05:05:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.448 05:05:14 -- paths/export.sh@5 -- # export PATH 00:20:35.448 05:05:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.448 05:05:14 -- nvmf/common.sh@47 -- # : 0 00:20:35.448 05:05:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:35.448 05:05:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:35.448 05:05:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:35.448 05:05:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:35.448 05:05:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:35.448 05:05:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:35.448 05:05:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:35.448 05:05:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:35.448 05:05:14 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:35.448 05:05:14 -- fips/fips.sh@89 -- # check_openssl_version 00:20:35.448 05:05:14 -- fips/fips.sh@83 -- # local target=3.0.0 00:20:35.448 05:05:14 -- fips/fips.sh@85 -- # openssl version 00:20:35.448 05:05:14 -- fips/fips.sh@85 -- # awk '{print $2}' 00:20:35.448 05:05:14 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:20:35.448 05:05:14 -- scripts/common.sh@373 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:20:35.448 05:05:14 -- scripts/common.sh@330 -- # local ver1 ver1_l 00:20:35.448 05:05:14 -- scripts/common.sh@331 -- # local ver2 ver2_l 00:20:35.448 05:05:14 -- scripts/common.sh@333 -- # IFS=.-: 00:20:35.448 05:05:14 -- scripts/common.sh@333 -- # read -ra ver1 00:20:35.448 05:05:14 -- scripts/common.sh@334 -- # IFS=.-: 00:20:35.448 05:05:14 -- scripts/common.sh@334 -- # read -ra ver2 00:20:35.448 05:05:14 -- scripts/common.sh@335 -- # local 'op=>=' 00:20:35.448 05:05:14 -- scripts/common.sh@337 -- # ver1_l=3 00:20:35.448 05:05:14 -- scripts/common.sh@338 -- # ver2_l=3 00:20:35.448 05:05:14 -- scripts/common.sh@340 -- # local lt=0 gt=0 eq=0 v 00:20:35.448 05:05:14 -- scripts/common.sh@341 -- # case "$op" in 00:20:35.448 05:05:14 -- scripts/common.sh@345 -- # : 1 00:20:35.448 05:05:14 -- scripts/common.sh@361 -- # (( v = 0 )) 00:20:35.448 05:05:14 -- scripts/common.sh@361 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:35.448 05:05:14 -- scripts/common.sh@362 -- # decimal 3 00:20:35.448 05:05:14 -- scripts/common.sh@350 -- # local d=3 00:20:35.448 05:05:14 -- scripts/common.sh@351 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:35.448 05:05:14 -- scripts/common.sh@352 -- # echo 3 00:20:35.449 05:05:14 -- scripts/common.sh@362 -- # ver1[v]=3 00:20:35.449 05:05:14 -- scripts/common.sh@363 -- # decimal 3 00:20:35.449 05:05:14 -- scripts/common.sh@350 -- # local d=3 00:20:35.449 05:05:14 -- scripts/common.sh@351 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:35.449 05:05:14 -- scripts/common.sh@352 -- # echo 3 00:20:35.449 05:05:14 -- scripts/common.sh@363 -- # ver2[v]=3 00:20:35.449 05:05:14 -- scripts/common.sh@364 -- # (( ver1[v] > ver2[v] )) 00:20:35.449 05:05:14 -- scripts/common.sh@365 -- # (( ver1[v] < ver2[v] )) 00:20:35.449 05:05:14 -- scripts/common.sh@361 -- # (( v++ )) 00:20:35.449 05:05:14 -- scripts/common.sh@361 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:35.449 05:05:14 -- scripts/common.sh@362 -- # decimal 0 00:20:35.449 05:05:14 -- scripts/common.sh@350 -- # local d=0 00:20:35.449 05:05:14 -- scripts/common.sh@351 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:35.449 05:05:14 -- scripts/common.sh@352 -- # echo 0 00:20:35.449 05:05:14 -- scripts/common.sh@362 -- # ver1[v]=0 00:20:35.449 05:05:14 -- scripts/common.sh@363 -- # decimal 0 00:20:35.449 05:05:14 -- scripts/common.sh@350 -- # local d=0 00:20:35.449 05:05:14 -- scripts/common.sh@351 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:35.449 05:05:14 -- scripts/common.sh@352 -- # echo 0 00:20:35.449 05:05:14 -- scripts/common.sh@363 -- # ver2[v]=0 00:20:35.449 05:05:14 -- scripts/common.sh@364 -- # (( ver1[v] > ver2[v] )) 00:20:35.449 05:05:14 -- scripts/common.sh@365 -- # (( ver1[v] < ver2[v] )) 00:20:35.449 05:05:14 -- scripts/common.sh@361 -- # (( v++ )) 00:20:35.449 05:05:14 -- scripts/common.sh@361 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:35.449 05:05:14 -- scripts/common.sh@362 -- # decimal 9 00:20:35.449 05:05:14 -- scripts/common.sh@350 -- # local d=9 00:20:35.449 05:05:14 -- scripts/common.sh@351 -- # [[ 9 =~ ^[0-9]+$ ]] 00:20:35.449 05:05:14 -- scripts/common.sh@352 -- # echo 9 00:20:35.449 05:05:14 -- scripts/common.sh@362 -- # ver1[v]=9 00:20:35.449 05:05:14 -- scripts/common.sh@363 -- # decimal 0 00:20:35.449 05:05:14 -- scripts/common.sh@350 -- # local d=0 00:20:35.449 05:05:14 -- scripts/common.sh@351 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:35.449 05:05:14 -- scripts/common.sh@352 -- # echo 0 00:20:35.449 05:05:14 -- scripts/common.sh@363 -- # ver2[v]=0 00:20:35.449 05:05:14 -- scripts/common.sh@364 -- # (( ver1[v] > ver2[v] )) 00:20:35.449 05:05:14 -- scripts/common.sh@364 -- # return 0 00:20:35.449 05:05:14 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:20:35.449 05:05:14 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:20:35.449 05:05:14 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:20:35.449 05:05:14 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:20:35.449 05:05:14 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:20:35.449 05:05:14 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:20:35.449 05:05:14 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:20:35.449 05:05:14 -- fips/fips.sh@113 -- # build_openssl_config 00:20:35.449 05:05:14 -- fips/fips.sh@37 -- # cat 00:20:35.449 05:05:14 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:20:35.449 05:05:14 -- fips/fips.sh@58 -- # cat - 00:20:35.449 05:05:14 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:20:35.449 05:05:14 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:20:35.449 05:05:14 -- fips/fips.sh@116 -- # mapfile -t providers 00:20:35.449 05:05:14 -- fips/fips.sh@116 -- # openssl list -providers 00:20:35.449 05:05:14 -- fips/fips.sh@116 -- # grep name 00:20:35.449 05:05:14 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:20:35.449 05:05:14 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:20:35.449 05:05:14 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:20:35.449 05:05:14 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:20:35.449 05:05:14 -- fips/fips.sh@127 -- # : 00:20:35.449 05:05:14 -- common/autotest_common.sh@638 -- # local es=0 00:20:35.449 05:05:14 -- common/autotest_common.sh@640 -- # valid_exec_arg openssl md5 /dev/fd/62 00:20:35.449 05:05:14 -- common/autotest_common.sh@626 -- # local arg=openssl 00:20:35.449 05:05:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:35.449 05:05:14 -- common/autotest_common.sh@630 -- # type -t openssl 00:20:35.449 05:05:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:35.449 05:05:14 -- common/autotest_common.sh@632 -- # type -P openssl 00:20:35.449 05:05:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:35.449 05:05:14 -- common/autotest_common.sh@632 -- # arg=/usr/bin/openssl 00:20:35.449 05:05:14 -- common/autotest_common.sh@632 -- # [[ -x /usr/bin/openssl ]] 00:20:35.449 05:05:14 -- common/autotest_common.sh@641 -- # openssl md5 /dev/fd/62 00:20:35.449 Error setting digest 00:20:35.449 00329BEEED7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:20:35.449 00329BEEED7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:20:35.449 05:05:14 -- common/autotest_common.sh@641 -- # es=1 00:20:35.449 05:05:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:20:35.449 05:05:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:20:35.449 05:05:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:20:35.449 05:05:14 -- fips/fips.sh@130 -- # nvmftestinit 00:20:35.449 05:05:14 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:20:35.449 05:05:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:35.449 05:05:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:35.449 05:05:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:35.449 05:05:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:35.449 05:05:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:35.449 05:05:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:35.449 05:05:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:35.449 05:05:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:35.449 05:05:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:35.449 05:05:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:35.449 05:05:14 -- common/autotest_common.sh@10 -- # set +x 00:20:37.981 05:05:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:37.981 05:05:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:37.981 05:05:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:37.981 05:05:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:37.981 05:05:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:37.981 05:05:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:37.981 05:05:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:37.981 05:05:16 -- nvmf/common.sh@295 -- # net_devs=() 00:20:37.981 05:05:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:37.981 05:05:16 -- nvmf/common.sh@296 -- # e810=() 00:20:37.981 05:05:16 -- nvmf/common.sh@296 -- # local -ga e810 00:20:37.981 05:05:16 -- nvmf/common.sh@297 -- # x722=() 00:20:37.981 05:05:16 -- nvmf/common.sh@297 -- # local -ga x722 00:20:37.981 05:05:16 -- nvmf/common.sh@298 -- # mlx=() 00:20:37.981 05:05:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:37.981 05:05:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:37.981 05:05:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:37.981 05:05:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:37.981 05:05:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:37.981 05:05:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:37.981 05:05:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:37.981 05:05:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:37.981 05:05:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:37.982 05:05:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:37.982 05:05:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:37.982 05:05:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:37.982 05:05:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:37.982 05:05:16 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:20:37.982 05:05:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:37.982 05:05:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:37.982 05:05:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:37.982 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:37.982 05:05:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:37.982 05:05:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:37.982 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:37.982 05:05:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:37.982 05:05:16 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:37.982 05:05:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:37.982 05:05:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:37.982 05:05:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:37.982 05:05:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:37.982 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:37.982 05:05:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:37.982 05:05:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:37.982 05:05:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:37.982 05:05:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:37.982 05:05:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:37.982 05:05:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:37.982 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:37.982 05:05:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:37.982 05:05:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:37.982 05:05:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:37.982 05:05:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:20:37.982 05:05:16 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:37.982 05:05:16 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:37.982 05:05:16 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:37.982 05:05:16 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:20:37.982 05:05:16 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:37.982 05:05:16 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:37.982 05:05:16 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:20:37.982 05:05:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:37.982 05:05:16 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:37.982 05:05:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:20:37.982 05:05:16 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:20:37.982 05:05:16 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:20:37.982 05:05:16 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:37.982 05:05:16 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:37.982 05:05:16 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:37.982 05:05:16 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:20:37.982 05:05:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:37.982 05:05:16 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:37.982 05:05:16 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:37.982 05:05:16 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:20:37.982 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:37.982 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:20:37.982 00:20:37.982 --- 10.0.0.2 ping statistics --- 00:20:37.982 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:37.982 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:20:37.982 05:05:16 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:37.982 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:37.982 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:20:37.982 00:20:37.982 --- 10.0.0.1 ping statistics --- 00:20:37.982 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:37.982 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:20:37.982 05:05:16 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:37.982 05:05:16 -- nvmf/common.sh@411 -- # return 0 00:20:37.982 05:05:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:37.982 05:05:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:37.982 05:05:16 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:20:37.982 05:05:16 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:37.982 05:05:16 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:20:37.982 05:05:16 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:20:37.982 05:05:16 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:20:37.982 05:05:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:37.982 05:05:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:37.982 05:05:16 -- common/autotest_common.sh@10 -- # set +x 00:20:37.982 05:05:16 -- nvmf/common.sh@470 -- # nvmfpid=2423660 00:20:37.982 05:05:16 -- nvmf/common.sh@471 -- # waitforlisten 2423660 00:20:37.982 05:05:16 -- common/autotest_common.sh@817 -- # '[' -z 2423660 ']' 00:20:37.982 05:05:16 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:37.982 05:05:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:37.982 05:05:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:37.982 05:05:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:37.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:37.982 05:05:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:37.982 05:05:16 -- common/autotest_common.sh@10 -- # set +x 00:20:37.982 [2024-04-23 05:05:16.831875] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:37.982 [2024-04-23 05:05:16.831956] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:37.982 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.982 [2024-04-23 05:05:16.876102] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:37.982 [2024-04-23 05:05:16.903083] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:37.982 [2024-04-23 05:05:16.990403] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:37.982 [2024-04-23 05:05:16.990471] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:37.982 [2024-04-23 05:05:16.990487] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:37.982 [2024-04-23 05:05:16.990501] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:37.982 [2024-04-23 05:05:16.990513] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:37.982 [2024-04-23 05:05:16.990569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:38.920 05:05:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:38.920 05:05:17 -- common/autotest_common.sh@850 -- # return 0 00:20:38.920 05:05:17 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:38.920 05:05:17 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:38.920 05:05:17 -- common/autotest_common.sh@10 -- # set +x 00:20:38.920 05:05:17 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:38.920 05:05:17 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:20:38.920 05:05:17 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:38.920 05:05:17 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:38.920 05:05:17 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:38.920 05:05:17 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:38.920 05:05:17 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:38.920 05:05:17 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:38.920 05:05:17 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:38.920 [2024-04-23 05:05:18.081737] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:39.179 [2024-04-23 05:05:18.097716] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:39.179 [2024-04-23 05:05:18.098008] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:39.179 [2024-04-23 05:05:18.130445] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:20:39.179 malloc0 00:20:39.179 05:05:18 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:39.179 05:05:18 -- fips/fips.sh@147 -- # bdevperf_pid=2423823 00:20:39.179 05:05:18 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:39.179 05:05:18 -- fips/fips.sh@148 -- # waitforlisten 2423823 /var/tmp/bdevperf.sock 00:20:39.179 05:05:18 -- common/autotest_common.sh@817 -- # '[' -z 2423823 ']' 00:20:39.179 05:05:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:39.179 05:05:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:39.179 05:05:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:39.179 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:39.179 05:05:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:39.179 05:05:18 -- common/autotest_common.sh@10 -- # set +x 00:20:39.179 [2024-04-23 05:05:18.221154] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:20:39.179 [2024-04-23 05:05:18.221244] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2423823 ] 00:20:39.179 EAL: No free 2048 kB hugepages reported on node 1 00:20:39.179 [2024-04-23 05:05:18.253307] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:20:39.179 [2024-04-23 05:05:18.280023] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:39.437 [2024-04-23 05:05:18.361238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:39.437 05:05:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:39.437 05:05:18 -- common/autotest_common.sh@850 -- # return 0 00:20:39.437 05:05:18 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:39.723 [2024-04-23 05:05:18.740283] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:39.723 [2024-04-23 05:05:18.740404] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:20:39.723 TLSTESTn1 00:20:39.723 05:05:18 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:39.981 Running I/O for 10 seconds... 00:20:49.958 00:20:49.958 Latency(us) 00:20:49.958 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.958 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:49.958 Verification LBA range: start 0x0 length 0x2000 00:20:49.958 TLSTESTn1 : 10.03 3102.13 12.12 0.00 0.00 41180.64 7718.68 58642.58 00:20:49.958 =================================================================================================================== 00:20:49.958 Total : 3102.13 12.12 0.00 0.00 41180.64 7718.68 58642.58 00:20:49.958 0 00:20:49.958 05:05:29 -- fips/fips.sh@1 -- # cleanup 00:20:49.958 05:05:29 -- fips/fips.sh@15 -- # process_shm --id 0 00:20:49.958 05:05:29 -- common/autotest_common.sh@794 -- # type=--id 00:20:49.958 05:05:29 -- common/autotest_common.sh@795 -- # id=0 00:20:49.958 05:05:29 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:20:49.958 05:05:29 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:49.958 05:05:29 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:20:49.958 05:05:29 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:20:49.958 05:05:29 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:20:49.958 05:05:29 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:49.958 nvmf_trace.0 00:20:49.958 05:05:29 -- common/autotest_common.sh@809 -- # return 0 00:20:49.958 05:05:29 -- fips/fips.sh@16 -- # killprocess 2423823 00:20:49.958 05:05:29 -- common/autotest_common.sh@936 -- # '[' -z 2423823 ']' 00:20:49.958 05:05:29 -- common/autotest_common.sh@940 -- # kill -0 2423823 00:20:49.958 05:05:29 -- common/autotest_common.sh@941 -- # uname 00:20:49.958 05:05:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:49.958 05:05:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2423823 00:20:49.958 05:05:29 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:49.958 05:05:29 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:49.958 05:05:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2423823' 00:20:49.958 killing process with pid 2423823 00:20:49.958 05:05:29 -- common/autotest_common.sh@955 -- # kill 2423823 00:20:49.958 Received shutdown signal, test time was about 10.000000 seconds 00:20:49.958 00:20:49.958 Latency(us) 00:20:49.958 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.958 =================================================================================================================== 00:20:49.958 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:49.958 [2024-04-23 05:05:29.088019] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:20:49.958 05:05:29 -- common/autotest_common.sh@960 -- # wait 2423823 00:20:50.216 05:05:29 -- fips/fips.sh@17 -- # nvmftestfini 00:20:50.216 05:05:29 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:50.216 05:05:29 -- nvmf/common.sh@117 -- # sync 00:20:50.216 05:05:29 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:20:50.216 05:05:29 -- nvmf/common.sh@120 -- # set +e 00:20:50.216 05:05:29 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:50.216 05:05:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:20:50.216 rmmod nvme_tcp 00:20:50.216 rmmod nvme_fabrics 00:20:50.216 rmmod nvme_keyring 00:20:50.216 05:05:29 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:50.216 05:05:29 -- nvmf/common.sh@124 -- # set -e 00:20:50.216 05:05:29 -- nvmf/common.sh@125 -- # return 0 00:20:50.216 05:05:29 -- nvmf/common.sh@478 -- # '[' -n 2423660 ']' 00:20:50.216 05:05:29 -- nvmf/common.sh@479 -- # killprocess 2423660 00:20:50.216 05:05:29 -- common/autotest_common.sh@936 -- # '[' -z 2423660 ']' 00:20:50.216 05:05:29 -- common/autotest_common.sh@940 -- # kill -0 2423660 00:20:50.216 05:05:29 -- common/autotest_common.sh@941 -- # uname 00:20:50.216 05:05:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.216 05:05:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2423660 00:20:50.216 05:05:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:50.217 05:05:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:50.217 05:05:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2423660' 00:20:50.217 killing process with pid 2423660 00:20:50.217 05:05:29 -- common/autotest_common.sh@955 -- # kill 2423660 00:20:50.217 [2024-04-23 05:05:29.369896] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:20:50.217 05:05:29 -- common/autotest_common.sh@960 -- # wait 2423660 00:20:50.476 05:05:29 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:50.476 05:05:29 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:20:50.476 05:05:29 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:20:50.476 05:05:29 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:50.476 05:05:29 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:20:50.476 05:05:29 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:50.476 05:05:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:50.476 05:05:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:53.015 05:05:31 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:20:53.015 05:05:31 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:53.015 00:20:53.015 real 0m17.264s 00:20:53.015 user 0m21.789s 00:20:53.015 sys 0m5.812s 00:20:53.015 05:05:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:53.015 05:05:31 -- common/autotest_common.sh@10 -- # set +x 00:20:53.015 ************************************ 00:20:53.015 END TEST nvmf_fips 00:20:53.015 ************************************ 00:20:53.015 05:05:31 -- nvmf/nvmf.sh@64 -- # '[' 1 -eq 1 ']' 00:20:53.015 05:05:31 -- nvmf/nvmf.sh@65 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:20:53.015 05:05:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:53.015 05:05:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:53.015 05:05:31 -- common/autotest_common.sh@10 -- # set +x 00:20:53.015 ************************************ 00:20:53.015 START TEST nvmf_fuzz 00:20:53.015 ************************************ 00:20:53.015 05:05:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:20:53.015 * Looking for test storage... 00:20:53.015 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:53.015 05:05:31 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:53.015 05:05:31 -- nvmf/common.sh@7 -- # uname -s 00:20:53.015 05:05:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:53.015 05:05:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:53.015 05:05:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:53.015 05:05:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:53.015 05:05:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:53.015 05:05:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:53.015 05:05:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:53.015 05:05:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:53.015 05:05:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:53.015 05:05:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:53.015 05:05:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:53.015 05:05:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:53.015 05:05:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:53.015 05:05:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:53.015 05:05:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:53.015 05:05:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:53.015 05:05:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:53.015 05:05:31 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:53.015 05:05:31 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:53.015 05:05:31 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:53.015 05:05:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.015 05:05:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.015 05:05:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.015 05:05:31 -- paths/export.sh@5 -- # export PATH 00:20:53.015 05:05:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.015 05:05:31 -- nvmf/common.sh@47 -- # : 0 00:20:53.015 05:05:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:53.015 05:05:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:53.015 05:05:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:53.015 05:05:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:53.015 05:05:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:53.015 05:05:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:53.015 05:05:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:53.015 05:05:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:53.015 05:05:31 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:20:53.015 05:05:31 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:20:53.015 05:05:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:53.015 05:05:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:53.015 05:05:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:53.015 05:05:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:53.015 05:05:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:53.015 05:05:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:53.015 05:05:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:53.015 05:05:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:53.015 05:05:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:53.015 05:05:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:53.015 05:05:31 -- common/autotest_common.sh@10 -- # set +x 00:20:54.921 05:05:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:54.921 05:05:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:54.921 05:05:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:54.921 05:05:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:54.921 05:05:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:54.921 05:05:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:54.921 05:05:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:54.921 05:05:33 -- nvmf/common.sh@295 -- # net_devs=() 00:20:54.921 05:05:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:54.921 05:05:33 -- nvmf/common.sh@296 -- # e810=() 00:20:54.921 05:05:33 -- nvmf/common.sh@296 -- # local -ga e810 00:20:54.921 05:05:33 -- nvmf/common.sh@297 -- # x722=() 00:20:54.921 05:05:33 -- nvmf/common.sh@297 -- # local -ga x722 00:20:54.921 05:05:33 -- nvmf/common.sh@298 -- # mlx=() 00:20:54.921 05:05:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:54.921 05:05:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:54.921 05:05:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:54.921 05:05:33 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:20:54.921 05:05:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:54.921 05:05:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:54.921 05:05:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:54.921 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:54.921 05:05:33 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:54.921 05:05:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:54.921 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:54.921 05:05:33 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:54.921 05:05:33 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:54.921 05:05:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:54.921 05:05:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:54.921 05:05:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:54.921 05:05:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:54.921 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:54.921 05:05:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:54.921 05:05:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:54.921 05:05:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:54.921 05:05:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:54.921 05:05:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:54.921 05:05:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:54.921 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:54.921 05:05:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:54.921 05:05:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:54.921 05:05:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:54.921 05:05:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:20:54.921 05:05:33 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:54.921 05:05:33 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:54.921 05:05:33 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:54.921 05:05:33 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:20:54.921 05:05:33 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:54.921 05:05:33 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:54.921 05:05:33 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:20:54.921 05:05:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:54.921 05:05:33 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:54.921 05:05:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:20:54.921 05:05:33 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:20:54.921 05:05:33 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:20:54.921 05:05:33 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:54.921 05:05:33 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:54.921 05:05:33 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:54.921 05:05:33 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:20:54.921 05:05:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:54.921 05:05:33 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:54.921 05:05:33 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:54.921 05:05:33 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:20:54.921 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:54.921 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:20:54.921 00:20:54.921 --- 10.0.0.2 ping statistics --- 00:20:54.921 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:54.921 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:20:54.921 05:05:33 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:54.921 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:54.921 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:20:54.921 00:20:54.921 --- 10.0.0.1 ping statistics --- 00:20:54.921 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:54.921 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:20:54.921 05:05:33 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:54.921 05:05:33 -- nvmf/common.sh@411 -- # return 0 00:20:54.921 05:05:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:54.921 05:05:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:54.921 05:05:33 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:20:54.921 05:05:33 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:54.921 05:05:33 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:20:54.921 05:05:33 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:20:54.921 05:05:33 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2427070 00:20:54.921 05:05:33 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:20:54.921 05:05:33 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:54.921 05:05:33 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2427070 00:20:54.921 05:05:33 -- common/autotest_common.sh@817 -- # '[' -z 2427070 ']' 00:20:54.921 05:05:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:54.921 05:05:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:54.921 05:05:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:54.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:54.921 05:05:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:54.921 05:05:33 -- common/autotest_common.sh@10 -- # set +x 00:20:55.182 05:05:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:55.182 05:05:34 -- common/autotest_common.sh@850 -- # return 0 00:20:55.182 05:05:34 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:55.182 05:05:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:55.182 05:05:34 -- common/autotest_common.sh@10 -- # set +x 00:20:55.182 05:05:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:55.182 05:05:34 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:20:55.182 05:05:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:55.182 05:05:34 -- common/autotest_common.sh@10 -- # set +x 00:20:55.182 Malloc0 00:20:55.182 05:05:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:55.182 05:05:34 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:55.182 05:05:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:55.182 05:05:34 -- common/autotest_common.sh@10 -- # set +x 00:20:55.182 05:05:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:55.182 05:05:34 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:55.182 05:05:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:55.182 05:05:34 -- common/autotest_common.sh@10 -- # set +x 00:20:55.182 05:05:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:55.182 05:05:34 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:55.182 05:05:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:55.182 05:05:34 -- common/autotest_common.sh@10 -- # set +x 00:20:55.182 05:05:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:55.182 05:05:34 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:20:55.182 05:05:34 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:27.264 Fuzzing completed. Shutting down the fuzz application 00:21:27.264 00:21:27.264 Dumping successful admin opcodes: 00:21:27.264 8, 9, 10, 24, 00:21:27.264 Dumping successful io opcodes: 00:21:27.264 0, 9, 00:21:27.264 NS: 0x200003aeff00 I/O qp, Total commands completed: 466010, total successful commands: 2693, random_seed: 832230592 00:21:27.264 NS: 0x200003aeff00 admin qp, Total commands completed: 56608, total successful commands: 449, random_seed: 52069120 00:21:27.264 05:06:04 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:27.264 Fuzzing completed. Shutting down the fuzz application 00:21:27.264 00:21:27.264 Dumping successful admin opcodes: 00:21:27.264 24, 00:21:27.264 Dumping successful io opcodes: 00:21:27.264 00:21:27.264 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3188532411 00:21:27.264 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3188654415 00:21:27.264 05:06:06 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:27.264 05:06:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:27.264 05:06:06 -- common/autotest_common.sh@10 -- # set +x 00:21:27.264 05:06:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:27.264 05:06:06 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:27.264 05:06:06 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:27.264 05:06:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:27.264 05:06:06 -- nvmf/common.sh@117 -- # sync 00:21:27.264 05:06:06 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:21:27.264 05:06:06 -- nvmf/common.sh@120 -- # set +e 00:21:27.264 05:06:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:27.264 05:06:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:21:27.264 rmmod nvme_tcp 00:21:27.264 rmmod nvme_fabrics 00:21:27.264 rmmod nvme_keyring 00:21:27.264 05:06:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:27.264 05:06:06 -- nvmf/common.sh@124 -- # set -e 00:21:27.264 05:06:06 -- nvmf/common.sh@125 -- # return 0 00:21:27.264 05:06:06 -- nvmf/common.sh@478 -- # '[' -n 2427070 ']' 00:21:27.264 05:06:06 -- nvmf/common.sh@479 -- # killprocess 2427070 00:21:27.264 05:06:06 -- common/autotest_common.sh@936 -- # '[' -z 2427070 ']' 00:21:27.264 05:06:06 -- common/autotest_common.sh@940 -- # kill -0 2427070 00:21:27.264 05:06:06 -- common/autotest_common.sh@941 -- # uname 00:21:27.264 05:06:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:27.264 05:06:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2427070 00:21:27.264 05:06:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:27.264 05:06:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:27.264 05:06:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2427070' 00:21:27.264 killing process with pid 2427070 00:21:27.264 05:06:06 -- common/autotest_common.sh@955 -- # kill 2427070 00:21:27.264 05:06:06 -- common/autotest_common.sh@960 -- # wait 2427070 00:21:27.523 05:06:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:27.523 05:06:06 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:21:27.523 05:06:06 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:21:27.523 05:06:06 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:27.523 05:06:06 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:21:27.523 05:06:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:27.523 05:06:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:27.523 05:06:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:29.431 05:06:08 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:21:29.431 05:06:08 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:29.431 00:21:29.431 real 0m36.737s 00:21:29.431 user 0m50.666s 00:21:29.431 sys 0m14.818s 00:21:29.431 05:06:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:29.431 05:06:08 -- common/autotest_common.sh@10 -- # set +x 00:21:29.431 ************************************ 00:21:29.431 END TEST nvmf_fuzz 00:21:29.431 ************************************ 00:21:29.431 05:06:08 -- nvmf/nvmf.sh@66 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:29.431 05:06:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:29.431 05:06:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:29.431 05:06:08 -- common/autotest_common.sh@10 -- # set +x 00:21:29.690 ************************************ 00:21:29.690 START TEST nvmf_multiconnection 00:21:29.690 ************************************ 00:21:29.690 05:06:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:29.690 * Looking for test storage... 00:21:29.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:29.690 05:06:08 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:29.690 05:06:08 -- nvmf/common.sh@7 -- # uname -s 00:21:29.690 05:06:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:29.690 05:06:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:29.690 05:06:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:29.690 05:06:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:29.690 05:06:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:29.690 05:06:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:29.690 05:06:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:29.690 05:06:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:29.690 05:06:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:29.690 05:06:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:29.690 05:06:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:29.690 05:06:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:29.690 05:06:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:29.690 05:06:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:29.690 05:06:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:29.690 05:06:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:29.690 05:06:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:29.690 05:06:08 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:29.690 05:06:08 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:29.690 05:06:08 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:29.690 05:06:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.690 05:06:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.691 05:06:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.691 05:06:08 -- paths/export.sh@5 -- # export PATH 00:21:29.691 05:06:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.691 05:06:08 -- nvmf/common.sh@47 -- # : 0 00:21:29.691 05:06:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:29.691 05:06:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:29.691 05:06:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:29.691 05:06:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:29.691 05:06:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:29.691 05:06:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:29.691 05:06:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:29.691 05:06:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:29.691 05:06:08 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:29.691 05:06:08 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:29.691 05:06:08 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:29.691 05:06:08 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:29.691 05:06:08 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:21:29.691 05:06:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:29.691 05:06:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:29.691 05:06:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:29.691 05:06:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:29.691 05:06:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:29.691 05:06:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:29.691 05:06:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:29.691 05:06:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:29.691 05:06:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:29.691 05:06:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:29.691 05:06:08 -- common/autotest_common.sh@10 -- # set +x 00:21:31.595 05:06:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:31.595 05:06:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:31.595 05:06:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:31.595 05:06:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:31.595 05:06:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:31.595 05:06:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:31.595 05:06:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:31.595 05:06:10 -- nvmf/common.sh@295 -- # net_devs=() 00:21:31.595 05:06:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:31.595 05:06:10 -- nvmf/common.sh@296 -- # e810=() 00:21:31.595 05:06:10 -- nvmf/common.sh@296 -- # local -ga e810 00:21:31.595 05:06:10 -- nvmf/common.sh@297 -- # x722=() 00:21:31.595 05:06:10 -- nvmf/common.sh@297 -- # local -ga x722 00:21:31.595 05:06:10 -- nvmf/common.sh@298 -- # mlx=() 00:21:31.595 05:06:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:31.595 05:06:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:31.595 05:06:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:31.595 05:06:10 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:21:31.595 05:06:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:31.595 05:06:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:31.595 05:06:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:31.595 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:31.595 05:06:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:31.595 05:06:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:31.595 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:31.595 05:06:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:31.595 05:06:10 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:31.595 05:06:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.595 05:06:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:31.595 05:06:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.595 05:06:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:31.595 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:31.595 05:06:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.595 05:06:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:31.595 05:06:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.595 05:06:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:31.595 05:06:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.595 05:06:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:31.595 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:31.595 05:06:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.595 05:06:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:31.595 05:06:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:31.595 05:06:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:21:31.595 05:06:10 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:31.595 05:06:10 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:31.595 05:06:10 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:31.595 05:06:10 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:21:31.595 05:06:10 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:31.595 05:06:10 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:31.595 05:06:10 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:21:31.595 05:06:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:31.595 05:06:10 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:31.595 05:06:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:21:31.595 05:06:10 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:21:31.595 05:06:10 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:21:31.595 05:06:10 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:31.595 05:06:10 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:31.595 05:06:10 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:31.595 05:06:10 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:21:31.595 05:06:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:31.595 05:06:10 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:31.595 05:06:10 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:31.595 05:06:10 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:21:31.595 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:31.595 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:21:31.595 00:21:31.595 --- 10.0.0.2 ping statistics --- 00:21:31.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:31.595 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:21:31.595 05:06:10 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:31.595 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:31.595 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:21:31.595 00:21:31.595 --- 10.0.0.1 ping statistics --- 00:21:31.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:31.595 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:21:31.595 05:06:10 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:31.595 05:06:10 -- nvmf/common.sh@411 -- # return 0 00:21:31.595 05:06:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:31.595 05:06:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:31.595 05:06:10 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:21:31.595 05:06:10 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:31.596 05:06:10 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:21:31.596 05:06:10 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:21:31.596 05:06:10 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:21:31.596 05:06:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:31.596 05:06:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:31.596 05:06:10 -- common/autotest_common.sh@10 -- # set +x 00:21:31.596 05:06:10 -- nvmf/common.sh@470 -- # nvmfpid=2433309 00:21:31.596 05:06:10 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:31.596 05:06:10 -- nvmf/common.sh@471 -- # waitforlisten 2433309 00:21:31.596 05:06:10 -- common/autotest_common.sh@817 -- # '[' -z 2433309 ']' 00:21:31.596 05:06:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:31.596 05:06:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:31.596 05:06:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:31.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:31.596 05:06:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:31.596 05:06:10 -- common/autotest_common.sh@10 -- # set +x 00:21:31.855 [2024-04-23 05:06:10.795863] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:21:31.855 [2024-04-23 05:06:10.795951] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:31.855 EAL: No free 2048 kB hugepages reported on node 1 00:21:31.855 [2024-04-23 05:06:10.835363] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:21:31.855 [2024-04-23 05:06:10.867630] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:31.855 [2024-04-23 05:06:10.958611] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:31.855 [2024-04-23 05:06:10.958670] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:31.855 [2024-04-23 05:06:10.958695] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:31.855 [2024-04-23 05:06:10.958708] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:31.855 [2024-04-23 05:06:10.958719] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:31.855 [2024-04-23 05:06:10.958778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:31.855 [2024-04-23 05:06:10.958834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:31.855 [2024-04-23 05:06:10.958872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:31.855 [2024-04-23 05:06:10.958875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:32.114 05:06:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:32.115 05:06:11 -- common/autotest_common.sh@850 -- # return 0 00:21:32.115 05:06:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:32.115 05:06:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:32.115 05:06:11 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 [2024-04-23 05:06:11.120368] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:32.115 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.115 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 Malloc1 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 [2024-04-23 05:06:11.176272] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.115 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 Malloc2 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.115 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 Malloc3 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.115 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.115 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.115 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:32.115 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.115 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 Malloc4 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.375 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 Malloc5 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.375 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 Malloc6 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.375 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 Malloc7 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.375 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 Malloc8 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.375 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.375 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.375 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:32.375 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.375 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.635 Malloc9 00:21:32.635 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.635 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:32.635 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.635 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.635 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.635 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:32.635 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.635 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.635 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.635 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:32.635 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.635 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.635 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.635 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.635 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:32.635 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.635 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.635 Malloc10 00:21:32.635 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.635 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:32.635 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.635 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.635 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.635 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:32.635 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.635 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.635 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.635 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:32.635 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.636 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.636 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.636 05:06:11 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.636 05:06:11 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:32.636 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.636 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.636 Malloc11 00:21:32.636 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.636 05:06:11 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:21:32.636 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.636 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.636 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.636 05:06:11 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:21:32.636 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.636 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.636 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.636 05:06:11 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:21:32.636 05:06:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:32.636 05:06:11 -- common/autotest_common.sh@10 -- # set +x 00:21:32.636 05:06:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:32.636 05:06:11 -- target/multiconnection.sh@28 -- # seq 1 11 00:21:32.636 05:06:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:32.636 05:06:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:33.210 05:06:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:21:33.210 05:06:12 -- common/autotest_common.sh@1184 -- # local i=0 00:21:33.210 05:06:12 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:33.210 05:06:12 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:33.210 05:06:12 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:35.751 05:06:14 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:35.751 05:06:14 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:35.751 05:06:14 -- common/autotest_common.sh@1193 -- # grep -c SPDK1 00:21:35.751 05:06:14 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:35.751 05:06:14 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:35.751 05:06:14 -- common/autotest_common.sh@1194 -- # return 0 00:21:35.751 05:06:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:35.751 05:06:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:21:36.009 05:06:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:21:36.009 05:06:14 -- common/autotest_common.sh@1184 -- # local i=0 00:21:36.009 05:06:14 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:36.009 05:06:14 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:36.009 05:06:14 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:37.913 05:06:16 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:37.913 05:06:16 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:37.913 05:06:16 -- common/autotest_common.sh@1193 -- # grep -c SPDK2 00:21:37.913 05:06:16 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:37.913 05:06:16 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:37.913 05:06:16 -- common/autotest_common.sh@1194 -- # return 0 00:21:37.913 05:06:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:37.913 05:06:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:21:38.846 05:06:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:21:38.846 05:06:17 -- common/autotest_common.sh@1184 -- # local i=0 00:21:38.846 05:06:17 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:38.846 05:06:17 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:38.846 05:06:17 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:40.751 05:06:19 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:40.751 05:06:19 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:40.751 05:06:19 -- common/autotest_common.sh@1193 -- # grep -c SPDK3 00:21:40.751 05:06:19 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:40.751 05:06:19 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:40.751 05:06:19 -- common/autotest_common.sh@1194 -- # return 0 00:21:40.751 05:06:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:40.751 05:06:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:21:41.319 05:06:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:21:41.319 05:06:20 -- common/autotest_common.sh@1184 -- # local i=0 00:21:41.319 05:06:20 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:41.319 05:06:20 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:41.319 05:06:20 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:43.224 05:06:22 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:43.224 05:06:22 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:43.224 05:06:22 -- common/autotest_common.sh@1193 -- # grep -c SPDK4 00:21:43.224 05:06:22 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:43.224 05:06:22 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:43.224 05:06:22 -- common/autotest_common.sh@1194 -- # return 0 00:21:43.224 05:06:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:43.224 05:06:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:21:44.160 05:06:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:21:44.160 05:06:23 -- common/autotest_common.sh@1184 -- # local i=0 00:21:44.160 05:06:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:44.161 05:06:23 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:44.161 05:06:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:46.066 05:06:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:46.066 05:06:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:46.066 05:06:25 -- common/autotest_common.sh@1193 -- # grep -c SPDK5 00:21:46.066 05:06:25 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:46.066 05:06:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:46.066 05:06:25 -- common/autotest_common.sh@1194 -- # return 0 00:21:46.066 05:06:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:46.066 05:06:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:21:46.635 05:06:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:21:46.635 05:06:25 -- common/autotest_common.sh@1184 -- # local i=0 00:21:46.635 05:06:25 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:46.635 05:06:25 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:46.635 05:06:25 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:49.172 05:06:27 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:49.172 05:06:27 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:49.172 05:06:27 -- common/autotest_common.sh@1193 -- # grep -c SPDK6 00:21:49.172 05:06:27 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:49.172 05:06:27 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:49.172 05:06:27 -- common/autotest_common.sh@1194 -- # return 0 00:21:49.172 05:06:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:49.172 05:06:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:21:49.431 05:06:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:21:49.431 05:06:28 -- common/autotest_common.sh@1184 -- # local i=0 00:21:49.431 05:06:28 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:49.431 05:06:28 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:49.431 05:06:28 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:51.338 05:06:30 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:51.338 05:06:30 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:51.338 05:06:30 -- common/autotest_common.sh@1193 -- # grep -c SPDK7 00:21:51.338 05:06:30 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:51.338 05:06:30 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:51.338 05:06:30 -- common/autotest_common.sh@1194 -- # return 0 00:21:51.338 05:06:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.338 05:06:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:21:52.275 05:06:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:21:52.275 05:06:31 -- common/autotest_common.sh@1184 -- # local i=0 00:21:52.275 05:06:31 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:52.275 05:06:31 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:52.275 05:06:31 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:54.176 05:06:33 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:54.176 05:06:33 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:54.176 05:06:33 -- common/autotest_common.sh@1193 -- # grep -c SPDK8 00:21:54.176 05:06:33 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:54.176 05:06:33 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:54.176 05:06:33 -- common/autotest_common.sh@1194 -- # return 0 00:21:54.176 05:06:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:54.176 05:06:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:21:55.111 05:06:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:21:55.111 05:06:34 -- common/autotest_common.sh@1184 -- # local i=0 00:21:55.111 05:06:34 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:55.111 05:06:34 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:55.111 05:06:34 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:57.078 05:06:36 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:57.078 05:06:36 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:57.078 05:06:36 -- common/autotest_common.sh@1193 -- # grep -c SPDK9 00:21:57.078 05:06:36 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:57.078 05:06:36 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:57.078 05:06:36 -- common/autotest_common.sh@1194 -- # return 0 00:21:57.078 05:06:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.078 05:06:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:21:58.015 05:06:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:21:58.015 05:06:36 -- common/autotest_common.sh@1184 -- # local i=0 00:21:58.015 05:06:36 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:58.015 05:06:36 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:58.015 05:06:36 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:59.920 05:06:38 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:59.920 05:06:38 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:59.920 05:06:38 -- common/autotest_common.sh@1193 -- # grep -c SPDK10 00:21:59.920 05:06:38 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:59.920 05:06:38 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:59.920 05:06:38 -- common/autotest_common.sh@1194 -- # return 0 00:21:59.920 05:06:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.920 05:06:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:00.852 05:06:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:00.852 05:06:39 -- common/autotest_common.sh@1184 -- # local i=0 00:22:00.852 05:06:39 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:22:00.852 05:06:39 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:22:00.852 05:06:39 -- common/autotest_common.sh@1191 -- # sleep 2 00:22:02.758 05:06:41 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:22:02.758 05:06:41 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:22:02.758 05:06:41 -- common/autotest_common.sh@1193 -- # grep -c SPDK11 00:22:02.758 05:06:41 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:22:02.758 05:06:41 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:22:02.758 05:06:41 -- common/autotest_common.sh@1194 -- # return 0 00:22:02.758 05:06:41 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:02.758 [global] 00:22:02.758 thread=1 00:22:02.758 invalidate=1 00:22:02.758 rw=read 00:22:02.758 time_based=1 00:22:02.758 runtime=10 00:22:02.758 ioengine=libaio 00:22:02.758 direct=1 00:22:02.758 bs=262144 00:22:02.758 iodepth=64 00:22:02.758 norandommap=1 00:22:02.758 numjobs=1 00:22:02.758 00:22:02.758 [job0] 00:22:02.758 filename=/dev/nvme0n1 00:22:02.758 [job1] 00:22:02.758 filename=/dev/nvme10n1 00:22:02.758 [job2] 00:22:02.758 filename=/dev/nvme1n1 00:22:02.758 [job3] 00:22:02.758 filename=/dev/nvme2n1 00:22:02.758 [job4] 00:22:02.758 filename=/dev/nvme3n1 00:22:02.758 [job5] 00:22:02.758 filename=/dev/nvme4n1 00:22:02.758 [job6] 00:22:02.758 filename=/dev/nvme5n1 00:22:02.758 [job7] 00:22:02.758 filename=/dev/nvme6n1 00:22:02.758 [job8] 00:22:02.758 filename=/dev/nvme7n1 00:22:02.758 [job9] 00:22:02.758 filename=/dev/nvme8n1 00:22:02.758 [job10] 00:22:02.758 filename=/dev/nvme9n1 00:22:02.758 Could not set queue depth (nvme0n1) 00:22:02.758 Could not set queue depth (nvme10n1) 00:22:02.758 Could not set queue depth (nvme1n1) 00:22:02.758 Could not set queue depth (nvme2n1) 00:22:02.758 Could not set queue depth (nvme3n1) 00:22:02.758 Could not set queue depth (nvme4n1) 00:22:02.758 Could not set queue depth (nvme5n1) 00:22:02.758 Could not set queue depth (nvme6n1) 00:22:02.758 Could not set queue depth (nvme7n1) 00:22:02.758 Could not set queue depth (nvme8n1) 00:22:02.758 Could not set queue depth (nvme9n1) 00:22:03.016 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:03.016 fio-3.35 00:22:03.016 Starting 11 threads 00:22:15.223 00:22:15.223 job0: (groupid=0, jobs=1): err= 0: pid=2437560: Tue Apr 23 05:06:52 2024 00:22:15.223 read: IOPS=596, BW=149MiB/s (156MB/s)(1507MiB/10107msec) 00:22:15.223 slat (usec): min=9, max=96045, avg=1228.90, stdev=4711.71 00:22:15.223 clat (usec): min=1051, max=327527, avg=105961.64, stdev=49786.27 00:22:15.223 lat (usec): min=1071, max=327544, avg=107190.53, stdev=50523.36 00:22:15.223 clat percentiles (msec): 00:22:15.223 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 34], 20.00th=[ 68], 00:22:15.223 | 30.00th=[ 86], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 121], 00:22:15.223 | 70.00th=[ 134], 80.00th=[ 146], 90.00th=[ 161], 95.00th=[ 180], 00:22:15.223 | 99.00th=[ 236], 99.50th=[ 313], 99.90th=[ 321], 99.95th=[ 321], 00:22:15.223 | 99.99th=[ 330] 00:22:15.223 bw ( KiB/s): min=87552, max=230912, per=8.09%, avg=152719.35, stdev=44564.62, samples=20 00:22:15.223 iops : min= 342, max= 902, avg=596.55, stdev=174.08, samples=20 00:22:15.223 lat (msec) : 2=0.20%, 4=0.63%, 10=2.52%, 20=4.21%, 50=6.67% 00:22:15.223 lat (msec) : 100=28.71%, 250=56.13%, 500=0.93% 00:22:15.223 cpu : usr=0.34%, sys=1.99%, ctx=1227, majf=0, minf=4097 00:22:15.223 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:15.223 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.223 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.223 issued rwts: total=6029,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.223 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.223 job1: (groupid=0, jobs=1): err= 0: pid=2437567: Tue Apr 23 05:06:52 2024 00:22:15.223 read: IOPS=634, BW=159MiB/s (166MB/s)(1603MiB/10110msec) 00:22:15.223 slat (usec): min=10, max=97357, avg=1057.06, stdev=4111.33 00:22:15.223 clat (msec): min=2, max=229, avg=99.73, stdev=49.85 00:22:15.223 lat (msec): min=2, max=242, avg=100.79, stdev=50.53 00:22:15.223 clat percentiles (msec): 00:22:15.223 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 22], 20.00th=[ 57], 00:22:15.223 | 30.00th=[ 80], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 113], 00:22:15.224 | 70.00th=[ 129], 80.00th=[ 144], 90.00th=[ 161], 95.00th=[ 180], 00:22:15.224 | 99.00th=[ 205], 99.50th=[ 209], 99.90th=[ 224], 99.95th=[ 226], 00:22:15.224 | 99.99th=[ 230] 00:22:15.224 bw ( KiB/s): min=87552, max=304128, per=8.61%, avg=162534.40, stdev=62589.22, samples=20 00:22:15.224 iops : min= 342, max= 1188, avg=634.90, stdev=244.49, samples=20 00:22:15.224 lat (msec) : 4=1.12%, 10=4.37%, 20=4.13%, 50=8.61%, 100=29.66% 00:22:15.224 lat (msec) : 250=52.11% 00:22:15.224 cpu : usr=0.39%, sys=2.03%, ctx=1551, majf=0, minf=4097 00:22:15.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:15.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.224 issued rwts: total=6413,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.224 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.224 job2: (groupid=0, jobs=1): err= 0: pid=2437568: Tue Apr 23 05:06:52 2024 00:22:15.224 read: IOPS=848, BW=212MiB/s (222MB/s)(2138MiB/10080msec) 00:22:15.224 slat (usec): min=12, max=112040, avg=1132.18, stdev=3803.83 00:22:15.224 clat (msec): min=3, max=236, avg=74.23, stdev=43.36 00:22:15.224 lat (msec): min=3, max=292, avg=75.36, stdev=44.03 00:22:15.224 clat percentiles (msec): 00:22:15.224 | 1.00th=[ 16], 5.00th=[ 29], 10.00th=[ 30], 20.00th=[ 32], 00:22:15.224 | 30.00th=[ 37], 40.00th=[ 51], 50.00th=[ 69], 60.00th=[ 83], 00:22:15.224 | 70.00th=[ 92], 80.00th=[ 111], 90.00th=[ 144], 95.00th=[ 159], 00:22:15.224 | 99.00th=[ 182], 99.50th=[ 190], 99.90th=[ 209], 99.95th=[ 215], 00:22:15.224 | 99.99th=[ 236] 00:22:15.224 bw ( KiB/s): min=101376, max=472064, per=11.51%, avg=217318.40, stdev=113508.82, samples=20 00:22:15.224 iops : min= 396, max= 1844, avg=848.90, stdev=443.39, samples=20 00:22:15.224 lat (msec) : 4=0.02%, 10=0.40%, 20=0.76%, 50=38.89%, 100=34.76% 00:22:15.224 lat (msec) : 250=25.16% 00:22:15.224 cpu : usr=0.65%, sys=3.01%, ctx=1589, majf=0, minf=4097 00:22:15.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:15.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.224 issued rwts: total=8552,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.224 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.224 job3: (groupid=0, jobs=1): err= 0: pid=2437569: Tue Apr 23 05:06:52 2024 00:22:15.224 read: IOPS=788, BW=197MiB/s (207MB/s)(1992MiB/10107msec) 00:22:15.224 slat (usec): min=9, max=122231, avg=884.80, stdev=3855.00 00:22:15.224 clat (usec): min=806, max=398270, avg=80241.79, stdev=48583.54 00:22:15.224 lat (usec): min=828, max=431936, avg=81126.59, stdev=49084.03 00:22:15.224 clat percentiles (msec): 00:22:15.224 | 1.00th=[ 3], 5.00th=[ 15], 10.00th=[ 28], 20.00th=[ 34], 00:22:15.224 | 30.00th=[ 46], 40.00th=[ 61], 50.00th=[ 74], 60.00th=[ 89], 00:22:15.224 | 70.00th=[ 103], 80.00th=[ 123], 90.00th=[ 153], 95.00th=[ 165], 00:22:15.224 | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 288], 99.95th=[ 309], 00:22:15.224 | 99.99th=[ 397] 00:22:15.224 bw ( KiB/s): min=108544, max=477696, per=10.72%, avg=202316.80, stdev=93918.94, samples=20 00:22:15.224 iops : min= 424, max= 1866, avg=790.30, stdev=366.87, samples=20 00:22:15.224 lat (usec) : 1000=0.03% 00:22:15.224 lat (msec) : 2=0.29%, 4=1.36%, 10=1.31%, 20=3.49%, 50=26.04% 00:22:15.224 lat (msec) : 100=35.54%, 250=31.66%, 500=0.30% 00:22:15.224 cpu : usr=0.47%, sys=2.34%, ctx=1680, majf=0, minf=3721 00:22:15.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:15.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.224 issued rwts: total=7966,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.224 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.224 job4: (groupid=0, jobs=1): err= 0: pid=2437570: Tue Apr 23 05:06:52 2024 00:22:15.224 read: IOPS=571, BW=143MiB/s (150MB/s)(1445MiB/10110msec) 00:22:15.224 slat (usec): min=11, max=63761, avg=1396.62, stdev=4514.49 00:22:15.224 clat (msec): min=2, max=329, avg=110.42, stdev=42.95 00:22:15.224 lat (msec): min=2, max=329, avg=111.81, stdev=43.64 00:22:15.224 clat percentiles (msec): 00:22:15.224 | 1.00th=[ 23], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 77], 00:22:15.224 | 30.00th=[ 83], 40.00th=[ 90], 50.00th=[ 103], 60.00th=[ 115], 00:22:15.224 | 70.00th=[ 133], 80.00th=[ 148], 90.00th=[ 167], 95.00th=[ 182], 00:22:15.224 | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 296], 99.95th=[ 317], 00:22:15.224 | 99.99th=[ 330] 00:22:15.224 bw ( KiB/s): min=96768, max=206336, per=7.75%, avg=146380.80, stdev=37230.79, samples=20 00:22:15.224 iops : min= 378, max= 806, avg=571.80, stdev=145.43, samples=20 00:22:15.224 lat (msec) : 4=0.02%, 10=0.21%, 20=0.48%, 50=3.67%, 100=44.08% 00:22:15.224 lat (msec) : 250=50.77%, 500=0.78% 00:22:15.224 cpu : usr=0.36%, sys=2.22%, ctx=1320, majf=0, minf=4097 00:22:15.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:15.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.224 issued rwts: total=5781,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.224 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.224 job5: (groupid=0, jobs=1): err= 0: pid=2437571: Tue Apr 23 05:06:52 2024 00:22:15.224 read: IOPS=656, BW=164MiB/s (172MB/s)(1659MiB/10103msec) 00:22:15.224 slat (usec): min=10, max=81404, avg=1272.77, stdev=4160.16 00:22:15.224 clat (usec): min=1654, max=241384, avg=96061.22, stdev=36904.85 00:22:15.224 lat (usec): min=1666, max=250549, avg=97333.99, stdev=37351.95 00:22:15.224 clat percentiles (msec): 00:22:15.224 | 1.00th=[ 9], 5.00th=[ 39], 10.00th=[ 59], 20.00th=[ 71], 00:22:15.224 | 30.00th=[ 78], 40.00th=[ 84], 50.00th=[ 90], 60.00th=[ 97], 00:22:15.224 | 70.00th=[ 109], 80.00th=[ 123], 90.00th=[ 150], 95.00th=[ 169], 00:22:15.224 | 99.00th=[ 201], 99.50th=[ 203], 99.90th=[ 222], 99.95th=[ 222], 00:22:15.224 | 99.99th=[ 243] 00:22:15.224 bw ( KiB/s): min=97792, max=256512, per=8.91%, avg=168278.55, stdev=40602.35, samples=20 00:22:15.224 iops : min= 382, max= 1002, avg=657.30, stdev=158.61, samples=20 00:22:15.224 lat (msec) : 2=0.03%, 4=0.42%, 10=1.01%, 20=0.56%, 50=4.41% 00:22:15.224 lat (msec) : 100=56.03%, 250=37.53% 00:22:15.224 cpu : usr=0.41%, sys=2.35%, ctx=1356, majf=0, minf=4097 00:22:15.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:15.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.224 issued rwts: total=6637,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.224 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.224 job6: (groupid=0, jobs=1): err= 0: pid=2437572: Tue Apr 23 05:06:52 2024 00:22:15.224 read: IOPS=632, BW=158MiB/s (166MB/s)(1588MiB/10039msec) 00:22:15.224 slat (usec): min=10, max=126758, avg=1245.68, stdev=4758.40 00:22:15.224 clat (usec): min=1913, max=329936, avg=99834.63, stdev=47330.08 00:22:15.224 lat (usec): min=1930, max=329959, avg=101080.31, stdev=47880.19 00:22:15.224 clat percentiles (msec): 00:22:15.224 | 1.00th=[ 6], 5.00th=[ 30], 10.00th=[ 51], 20.00th=[ 65], 00:22:15.224 | 30.00th=[ 74], 40.00th=[ 85], 50.00th=[ 94], 60.00th=[ 104], 00:22:15.224 | 70.00th=[ 114], 80.00th=[ 130], 90.00th=[ 167], 95.00th=[ 190], 00:22:15.224 | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 309], 99.95th=[ 321], 00:22:15.224 | 99.99th=[ 330] 00:22:15.224 bw ( KiB/s): min=89088, max=248832, per=8.53%, avg=160972.80, stdev=44182.27, samples=20 00:22:15.224 iops : min= 348, max= 972, avg=628.80, stdev=172.59, samples=20 00:22:15.224 lat (msec) : 2=0.03%, 4=0.83%, 10=0.30%, 20=1.83%, 50=7.05% 00:22:15.224 lat (msec) : 100=46.47%, 250=42.50%, 500=0.99% 00:22:15.224 cpu : usr=0.43%, sys=2.07%, ctx=1314, majf=0, minf=4097 00:22:15.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:15.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.224 issued rwts: total=6351,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.224 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.224 job7: (groupid=0, jobs=1): err= 0: pid=2437573: Tue Apr 23 05:06:52 2024 00:22:15.224 read: IOPS=700, BW=175MiB/s (184MB/s)(1755MiB/10018msec) 00:22:15.224 slat (usec): min=10, max=127108, avg=1199.24, stdev=4174.66 00:22:15.224 clat (usec): min=1771, max=231241, avg=90081.14, stdev=50862.67 00:22:15.224 lat (usec): min=1790, max=302490, avg=91280.38, stdev=51604.46 00:22:15.224 clat percentiles (msec): 00:22:15.224 | 1.00th=[ 7], 5.00th=[ 19], 10.00th=[ 33], 20.00th=[ 36], 00:22:15.224 | 30.00th=[ 43], 40.00th=[ 74], 50.00th=[ 90], 60.00th=[ 102], 00:22:15.224 | 70.00th=[ 122], 80.00th=[ 138], 90.00th=[ 159], 95.00th=[ 178], 00:22:15.224 | 99.00th=[ 205], 99.50th=[ 207], 99.90th=[ 226], 99.95th=[ 228], 00:22:15.224 | 99.99th=[ 232] 00:22:15.224 bw ( KiB/s): min=82432, max=449024, per=9.43%, avg=178048.00, stdev=98521.85, samples=20 00:22:15.224 iops : min= 322, max= 1754, avg=695.50, stdev=384.85, samples=20 00:22:15.224 lat (msec) : 2=0.01%, 4=0.68%, 10=0.94%, 20=4.19%, 50=25.58% 00:22:15.224 lat (msec) : 100=27.17%, 250=41.42% 00:22:15.224 cpu : usr=0.42%, sys=2.37%, ctx=1514, majf=0, minf=4097 00:22:15.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:15.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.224 issued rwts: total=7018,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.224 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.224 job8: (groupid=0, jobs=1): err= 0: pid=2437574: Tue Apr 23 05:06:52 2024 00:22:15.224 read: IOPS=614, BW=154MiB/s (161MB/s)(1548MiB/10076msec) 00:22:15.224 slat (usec): min=10, max=214055, avg=1229.35, stdev=5417.77 00:22:15.224 clat (usec): min=1018, max=384603, avg=102836.29, stdev=56921.13 00:22:15.224 lat (usec): min=1044, max=384632, avg=104065.65, stdev=57729.55 00:22:15.224 clat percentiles (msec): 00:22:15.224 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 32], 20.00th=[ 42], 00:22:15.224 | 30.00th=[ 64], 40.00th=[ 91], 50.00th=[ 104], 60.00th=[ 125], 00:22:15.224 | 70.00th=[ 140], 80.00th=[ 153], 90.00th=[ 167], 95.00th=[ 192], 00:22:15.224 | 99.00th=[ 259], 99.50th=[ 296], 99.90th=[ 338], 99.95th=[ 338], 00:22:15.224 | 99.99th=[ 384] 00:22:15.224 bw ( KiB/s): min=87552, max=367104, per=8.31%, avg=156876.80, stdev=62620.28, samples=20 00:22:15.225 iops : min= 342, max= 1434, avg=612.80, stdev=244.61, samples=20 00:22:15.225 lat (msec) : 2=0.31%, 4=0.63%, 10=2.49%, 20=3.10%, 50=17.82% 00:22:15.225 lat (msec) : 100=22.94%, 250=51.67%, 500=1.05% 00:22:15.225 cpu : usr=0.40%, sys=2.02%, ctx=1342, majf=0, minf=4097 00:22:15.225 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:15.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.225 issued rwts: total=6191,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.225 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.225 job9: (groupid=0, jobs=1): err= 0: pid=2437575: Tue Apr 23 05:06:52 2024 00:22:15.225 read: IOPS=681, BW=170MiB/s (179MB/s)(1716MiB/10078msec) 00:22:15.225 slat (usec): min=9, max=43395, avg=761.00, stdev=3195.97 00:22:15.225 clat (usec): min=818, max=342176, avg=93105.78, stdev=51727.51 00:22:15.225 lat (usec): min=842, max=342192, avg=93866.78, stdev=52257.71 00:22:15.225 clat percentiles (msec): 00:22:15.225 | 1.00th=[ 5], 5.00th=[ 10], 10.00th=[ 21], 20.00th=[ 45], 00:22:15.225 | 30.00th=[ 63], 40.00th=[ 80], 50.00th=[ 95], 60.00th=[ 107], 00:22:15.225 | 70.00th=[ 122], 80.00th=[ 140], 90.00th=[ 161], 95.00th=[ 180], 00:22:15.225 | 99.00th=[ 205], 99.50th=[ 211], 99.90th=[ 330], 99.95th=[ 330], 00:22:15.225 | 99.99th=[ 342] 00:22:15.225 bw ( KiB/s): min=86528, max=290304, per=9.22%, avg=174131.20, stdev=55614.19, samples=20 00:22:15.225 iops : min= 338, max= 1134, avg=680.20, stdev=217.24, samples=20 00:22:15.225 lat (usec) : 1000=0.04% 00:22:15.225 lat (msec) : 2=0.22%, 4=0.64%, 10=4.21%, 20=4.79%, 50=12.61% 00:22:15.225 lat (msec) : 100=31.81%, 250=45.52%, 500=0.15% 00:22:15.225 cpu : usr=0.32%, sys=2.29%, ctx=1725, majf=0, minf=4097 00:22:15.225 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:15.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.225 issued rwts: total=6865,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.225 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.225 job10: (groupid=0, jobs=1): err= 0: pid=2437576: Tue Apr 23 05:06:52 2024 00:22:15.225 read: IOPS=669, BW=167MiB/s (176MB/s)(1688MiB/10078msec) 00:22:15.225 slat (usec): min=10, max=80990, avg=1354.92, stdev=4262.81 00:22:15.225 clat (msec): min=5, max=312, avg=94.12, stdev=44.79 00:22:15.225 lat (msec): min=5, max=350, avg=95.47, stdev=45.49 00:22:15.225 clat percentiles (msec): 00:22:15.225 | 1.00th=[ 26], 5.00th=[ 33], 10.00th=[ 46], 20.00th=[ 54], 00:22:15.225 | 30.00th=[ 63], 40.00th=[ 73], 50.00th=[ 87], 60.00th=[ 101], 00:22:15.225 | 70.00th=[ 116], 80.00th=[ 136], 90.00th=[ 159], 95.00th=[ 169], 00:22:15.225 | 99.00th=[ 220], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 313], 00:22:15.225 | 99.99th=[ 313] 00:22:15.225 bw ( KiB/s): min=89088, max=367616, per=9.07%, avg=171187.20, stdev=72623.55, samples=20 00:22:15.225 iops : min= 348, max= 1436, avg=668.70, stdev=283.69, samples=20 00:22:15.225 lat (msec) : 10=0.10%, 20=0.49%, 50=13.64%, 100=45.26%, 250=39.90% 00:22:15.225 lat (msec) : 500=0.61% 00:22:15.225 cpu : usr=0.36%, sys=2.35%, ctx=1314, majf=0, minf=4097 00:22:15.225 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:15.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:15.225 issued rwts: total=6750,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.225 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:15.225 00:22:15.225 Run status group 0 (all jobs): 00:22:15.225 READ: bw=1844MiB/s (1933MB/s), 143MiB/s-212MiB/s (150MB/s-222MB/s), io=18.2GiB (19.5GB), run=10018-10110msec 00:22:15.225 00:22:15.225 Disk stats (read/write): 00:22:15.225 nvme0n1: ios=11860/0, merge=0/0, ticks=1239182/0, in_queue=1239182, util=97.23% 00:22:15.225 nvme10n1: ios=12696/0, merge=0/0, ticks=1241735/0, in_queue=1241735, util=97.48% 00:22:15.225 nvme1n1: ios=16908/0, merge=0/0, ticks=1230517/0, in_queue=1230517, util=97.74% 00:22:15.225 nvme2n1: ios=15729/0, merge=0/0, ticks=1233324/0, in_queue=1233324, util=97.89% 00:22:15.225 nvme3n1: ios=11396/0, merge=0/0, ticks=1238680/0, in_queue=1238680, util=97.95% 00:22:15.225 nvme4n1: ios=13081/0, merge=0/0, ticks=1233998/0, in_queue=1233998, util=98.27% 00:22:15.225 nvme5n1: ios=12488/0, merge=0/0, ticks=1241353/0, in_queue=1241353, util=98.44% 00:22:15.225 nvme6n1: ios=13690/0, merge=0/0, ticks=1241567/0, in_queue=1241567, util=98.54% 00:22:15.225 nvme7n1: ios=12208/0, merge=0/0, ticks=1237300/0, in_queue=1237300, util=98.94% 00:22:15.225 nvme8n1: ios=13514/0, merge=0/0, ticks=1245363/0, in_queue=1245363, util=99.11% 00:22:15.225 nvme9n1: ios=13315/0, merge=0/0, ticks=1236024/0, in_queue=1236024, util=99.23% 00:22:15.225 05:06:52 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:15.225 [global] 00:22:15.225 thread=1 00:22:15.225 invalidate=1 00:22:15.225 rw=randwrite 00:22:15.225 time_based=1 00:22:15.225 runtime=10 00:22:15.225 ioengine=libaio 00:22:15.225 direct=1 00:22:15.225 bs=262144 00:22:15.225 iodepth=64 00:22:15.225 norandommap=1 00:22:15.225 numjobs=1 00:22:15.225 00:22:15.225 [job0] 00:22:15.225 filename=/dev/nvme0n1 00:22:15.225 [job1] 00:22:15.225 filename=/dev/nvme10n1 00:22:15.225 [job2] 00:22:15.225 filename=/dev/nvme1n1 00:22:15.225 [job3] 00:22:15.225 filename=/dev/nvme2n1 00:22:15.225 [job4] 00:22:15.225 filename=/dev/nvme3n1 00:22:15.225 [job5] 00:22:15.225 filename=/dev/nvme4n1 00:22:15.225 [job6] 00:22:15.225 filename=/dev/nvme5n1 00:22:15.225 [job7] 00:22:15.225 filename=/dev/nvme6n1 00:22:15.225 [job8] 00:22:15.225 filename=/dev/nvme7n1 00:22:15.225 [job9] 00:22:15.225 filename=/dev/nvme8n1 00:22:15.225 [job10] 00:22:15.225 filename=/dev/nvme9n1 00:22:15.225 Could not set queue depth (nvme0n1) 00:22:15.225 Could not set queue depth (nvme10n1) 00:22:15.225 Could not set queue depth (nvme1n1) 00:22:15.225 Could not set queue depth (nvme2n1) 00:22:15.225 Could not set queue depth (nvme3n1) 00:22:15.225 Could not set queue depth (nvme4n1) 00:22:15.225 Could not set queue depth (nvme5n1) 00:22:15.225 Could not set queue depth (nvme6n1) 00:22:15.225 Could not set queue depth (nvme7n1) 00:22:15.225 Could not set queue depth (nvme8n1) 00:22:15.225 Could not set queue depth (nvme9n1) 00:22:15.225 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:15.225 fio-3.35 00:22:15.225 Starting 11 threads 00:22:25.199 00:22:25.199 job0: (groupid=0, jobs=1): err= 0: pid=2438595: Tue Apr 23 05:07:03 2024 00:22:25.199 write: IOPS=535, BW=134MiB/s (140MB/s)(1361MiB/10168msec); 0 zone resets 00:22:25.199 slat (usec): min=18, max=151325, avg=1124.89, stdev=4465.22 00:22:25.199 clat (msec): min=3, max=468, avg=118.29, stdev=81.40 00:22:25.199 lat (msec): min=3, max=468, avg=119.41, stdev=82.14 00:22:25.199 clat percentiles (msec): 00:22:25.199 | 1.00th=[ 7], 5.00th=[ 23], 10.00th=[ 35], 20.00th=[ 51], 00:22:25.199 | 30.00th=[ 65], 40.00th=[ 70], 50.00th=[ 90], 60.00th=[ 126], 00:22:25.199 | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 279], 00:22:25.199 | 99.00th=[ 342], 99.50th=[ 363], 99.90th=[ 460], 99.95th=[ 468], 00:22:25.199 | 99.99th=[ 468] 00:22:25.200 bw ( KiB/s): min=69120, max=266752, per=10.00%, avg=137779.20, stdev=62407.19, samples=20 00:22:25.200 iops : min= 270, max= 1042, avg=538.20, stdev=243.78, samples=20 00:22:25.200 lat (msec) : 4=0.02%, 10=2.22%, 20=2.09%, 50=14.84%, 100=34.23% 00:22:25.200 lat (msec) : 250=38.11%, 500=8.48% 00:22:25.200 cpu : usr=1.56%, sys=1.90%, ctx=3282, majf=0, minf=1 00:22:25.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:25.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.200 issued rwts: total=0,5445,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.200 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.200 job1: (groupid=0, jobs=1): err= 0: pid=2438607: Tue Apr 23 05:07:03 2024 00:22:25.200 write: IOPS=397, BW=99.3MiB/s (104MB/s)(1000MiB/10068msec); 0 zone resets 00:22:25.200 slat (usec): min=20, max=96641, avg=1936.75, stdev=5431.84 00:22:25.200 clat (usec): min=1230, max=362052, avg=158994.36, stdev=83103.53 00:22:25.200 lat (usec): min=1268, max=362102, avg=160931.12, stdev=84282.23 00:22:25.200 clat percentiles (msec): 00:22:25.200 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 32], 20.00th=[ 85], 00:22:25.200 | 30.00th=[ 111], 40.00th=[ 146], 50.00th=[ 167], 60.00th=[ 182], 00:22:25.200 | 70.00th=[ 201], 80.00th=[ 228], 90.00th=[ 271], 95.00th=[ 309], 00:22:25.200 | 99.00th=[ 330], 99.50th=[ 334], 99.90th=[ 355], 99.95th=[ 359], 00:22:25.200 | 99.99th=[ 363] 00:22:25.200 bw ( KiB/s): min=51200, max=172544, per=7.32%, avg=100800.60, stdev=29966.76, samples=20 00:22:25.200 iops : min= 200, max= 674, avg=393.75, stdev=117.06, samples=20 00:22:25.200 lat (msec) : 2=0.15%, 4=0.45%, 10=1.82%, 20=4.32%, 50=6.32% 00:22:25.200 lat (msec) : 100=10.90%, 250=62.68%, 500=13.35% 00:22:25.200 cpu : usr=1.39%, sys=1.23%, ctx=2042, majf=0, minf=1 00:22:25.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:22:25.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.200 issued rwts: total=0,4001,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.200 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.200 job2: (groupid=0, jobs=1): err= 0: pid=2438610: Tue Apr 23 05:07:03 2024 00:22:25.200 write: IOPS=506, BW=127MiB/s (133MB/s)(1278MiB/10086msec); 0 zone resets 00:22:25.200 slat (usec): min=17, max=107331, avg=1329.82, stdev=4747.12 00:22:25.200 clat (usec): min=1128, max=439307, avg=124847.11, stdev=97614.74 00:22:25.200 lat (usec): min=1162, max=452735, avg=126176.94, stdev=98856.42 00:22:25.200 clat percentiles (msec): 00:22:25.200 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 20], 20.00th=[ 41], 00:22:25.200 | 30.00th=[ 47], 40.00th=[ 63], 50.00th=[ 106], 60.00th=[ 144], 00:22:25.200 | 70.00th=[ 178], 80.00th=[ 203], 90.00th=[ 255], 95.00th=[ 326], 00:22:25.200 | 99.00th=[ 393], 99.50th=[ 414], 99.90th=[ 430], 99.95th=[ 439], 00:22:25.200 | 99.99th=[ 439] 00:22:25.200 bw ( KiB/s): min=43008, max=263680, per=9.38%, avg=129280.00, stdev=70690.46, samples=20 00:22:25.200 iops : min= 168, max= 1030, avg=505.00, stdev=276.13, samples=20 00:22:25.200 lat (msec) : 2=0.33%, 4=1.15%, 10=3.56%, 20=5.22%, 50=24.53% 00:22:25.200 lat (msec) : 100=13.59%, 250=41.03%, 500=10.58% 00:22:25.200 cpu : usr=1.67%, sys=1.77%, ctx=3169, majf=0, minf=1 00:22:25.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:25.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.200 issued rwts: total=0,5113,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.200 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.200 job3: (groupid=0, jobs=1): err= 0: pid=2438611: Tue Apr 23 05:07:03 2024 00:22:25.200 write: IOPS=440, BW=110MiB/s (115MB/s)(1119MiB/10167msec); 0 zone resets 00:22:25.200 slat (usec): min=27, max=69487, avg=1442.33, stdev=4468.43 00:22:25.200 clat (msec): min=3, max=437, avg=143.89, stdev=86.17 00:22:25.200 lat (msec): min=3, max=437, avg=145.33, stdev=87.25 00:22:25.200 clat percentiles (msec): 00:22:25.200 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 46], 20.00th=[ 62], 00:22:25.200 | 30.00th=[ 89], 40.00th=[ 108], 50.00th=[ 134], 60.00th=[ 159], 00:22:25.200 | 70.00th=[ 178], 80.00th=[ 213], 90.00th=[ 275], 95.00th=[ 317], 00:22:25.200 | 99.00th=[ 355], 99.50th=[ 363], 99.90th=[ 401], 99.95th=[ 414], 00:22:25.200 | 99.99th=[ 439] 00:22:25.200 bw ( KiB/s): min=45056, max=265728, per=8.20%, avg=112947.20, stdev=55380.12, samples=20 00:22:25.200 iops : min= 176, max= 1038, avg=441.20, stdev=216.33, samples=20 00:22:25.200 lat (msec) : 4=0.04%, 10=1.01%, 20=3.11%, 50=8.67%, 100=24.34% 00:22:25.200 lat (msec) : 250=49.83%, 500=13.01% 00:22:25.200 cpu : usr=1.67%, sys=1.59%, ctx=2694, majf=0, minf=1 00:22:25.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:25.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.200 issued rwts: total=0,4475,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.200 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.200 job4: (groupid=0, jobs=1): err= 0: pid=2438612: Tue Apr 23 05:07:03 2024 00:22:25.200 write: IOPS=483, BW=121MiB/s (127MB/s)(1230MiB/10164msec); 0 zone resets 00:22:25.200 slat (usec): min=14, max=105455, avg=1272.46, stdev=4381.17 00:22:25.200 clat (usec): min=1482, max=536043, avg=130900.37, stdev=89527.36 00:22:25.200 lat (usec): min=1521, max=536107, avg=132172.83, stdev=90582.63 00:22:25.200 clat percentiles (msec): 00:22:25.200 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 27], 20.00th=[ 50], 00:22:25.200 | 30.00th=[ 77], 40.00th=[ 94], 50.00th=[ 114], 60.00th=[ 144], 00:22:25.200 | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 275], 95.00th=[ 313], 00:22:25.200 | 99.00th=[ 363], 99.50th=[ 388], 99.90th=[ 523], 99.95th=[ 523], 00:22:25.200 | 99.99th=[ 535] 00:22:25.200 bw ( KiB/s): min=51200, max=321536, per=9.02%, avg=124289.25, stdev=62622.60, samples=20 00:22:25.200 iops : min= 200, max= 1256, avg=485.45, stdev=244.61, samples=20 00:22:25.200 lat (msec) : 2=0.14%, 4=0.91%, 10=2.11%, 20=4.25%, 50=12.73% 00:22:25.200 lat (msec) : 100=22.42%, 250=44.72%, 500=12.58%, 750=0.12% 00:22:25.200 cpu : usr=1.59%, sys=1.65%, ctx=3258, majf=0, minf=1 00:22:25.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:25.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.200 issued rwts: total=0,4919,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.200 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.200 job5: (groupid=0, jobs=1): err= 0: pid=2438614: Tue Apr 23 05:07:03 2024 00:22:25.200 write: IOPS=647, BW=162MiB/s (170MB/s)(1630MiB/10071msec); 0 zone resets 00:22:25.200 slat (usec): min=21, max=221703, avg=1122.05, stdev=3995.93 00:22:25.200 clat (usec): min=1863, max=454050, avg=97676.15, stdev=69188.17 00:22:25.200 lat (usec): min=1907, max=491945, avg=98798.20, stdev=69899.60 00:22:25.200 clat percentiles (msec): 00:22:25.200 | 1.00th=[ 7], 5.00th=[ 25], 10.00th=[ 41], 20.00th=[ 48], 00:22:25.200 | 30.00th=[ 50], 40.00th=[ 55], 50.00th=[ 73], 60.00th=[ 94], 00:22:25.200 | 70.00th=[ 118], 80.00th=[ 155], 90.00th=[ 194], 95.00th=[ 230], 00:22:25.200 | 99.00th=[ 330], 99.50th=[ 388], 99.90th=[ 443], 99.95th=[ 447], 00:22:25.200 | 99.99th=[ 456] 00:22:25.200 bw ( KiB/s): min=59392, max=342016, per=12.00%, avg=165324.80, stdev=75043.96, samples=20 00:22:25.200 iops : min= 232, max= 1336, avg=645.80, stdev=293.14, samples=20 00:22:25.200 lat (msec) : 2=0.02%, 4=0.15%, 10=1.98%, 20=2.18%, 50=27.65% 00:22:25.200 lat (msec) : 100=30.41%, 250=34.17%, 500=3.45% 00:22:25.200 cpu : usr=2.10%, sys=2.36%, ctx=3218, majf=0, minf=1 00:22:25.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:25.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.200 issued rwts: total=0,6521,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.200 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.200 job6: (groupid=0, jobs=1): err= 0: pid=2438616: Tue Apr 23 05:07:03 2024 00:22:25.200 write: IOPS=397, BW=99.4MiB/s (104MB/s)(1011MiB/10170msec); 0 zone resets 00:22:25.200 slat (usec): min=26, max=107714, avg=1896.54, stdev=5237.59 00:22:25.200 clat (msec): min=2, max=478, avg=158.86, stdev=82.79 00:22:25.200 lat (msec): min=3, max=478, avg=160.76, stdev=83.94 00:22:25.200 clat percentiles (msec): 00:22:25.200 | 1.00th=[ 11], 5.00th=[ 27], 10.00th=[ 48], 20.00th=[ 90], 00:22:25.200 | 30.00th=[ 113], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 169], 00:22:25.200 | 70.00th=[ 186], 80.00th=[ 222], 90.00th=[ 284], 95.00th=[ 317], 00:22:25.200 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 447], 99.95th=[ 451], 00:22:25.200 | 99.99th=[ 481] 00:22:25.200 bw ( KiB/s): min=47104, max=156672, per=7.40%, avg=101913.60, stdev=33739.07, samples=20 00:22:25.200 iops : min= 184, max= 612, avg=398.10, stdev=131.79, samples=20 00:22:25.200 lat (msec) : 4=0.07%, 10=0.96%, 20=2.45%, 50=6.97%, 100=13.25% 00:22:25.200 lat (msec) : 250=60.52%, 500=15.77% 00:22:25.200 cpu : usr=1.36%, sys=1.53%, ctx=2146, majf=0, minf=1 00:22:25.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:22:25.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.200 issued rwts: total=0,4045,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.200 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.200 job7: (groupid=0, jobs=1): err= 0: pid=2438617: Tue Apr 23 05:07:03 2024 00:22:25.200 write: IOPS=497, BW=124MiB/s (131MB/s)(1258MiB/10108msec); 0 zone resets 00:22:25.200 slat (usec): min=26, max=37096, avg=1637.11, stdev=4074.87 00:22:25.200 clat (msec): min=5, max=328, avg=126.82, stdev=76.18 00:22:25.200 lat (msec): min=5, max=328, avg=128.46, stdev=77.32 00:22:25.200 clat percentiles (msec): 00:22:25.200 | 1.00th=[ 12], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 54], 00:22:25.200 | 30.00th=[ 81], 40.00th=[ 94], 50.00th=[ 112], 60.00th=[ 131], 00:22:25.200 | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 253], 95.00th=[ 292], 00:22:25.200 | 99.00th=[ 317], 99.50th=[ 321], 99.90th=[ 326], 99.95th=[ 330], 00:22:25.200 | 99.99th=[ 330] 00:22:25.200 bw ( KiB/s): min=51200, max=334336, per=9.23%, avg=127219.45, stdev=66990.17, samples=20 00:22:25.200 iops : min= 200, max= 1306, avg=496.95, stdev=261.68, samples=20 00:22:25.200 lat (msec) : 10=0.60%, 20=1.57%, 50=15.82%, 100=25.52%, 250=46.30% 00:22:25.200 lat (msec) : 500=10.19% 00:22:25.200 cpu : usr=1.46%, sys=1.94%, ctx=2238, majf=0, minf=1 00:22:25.201 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:22:25.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.201 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.201 issued rwts: total=0,5032,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.201 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.201 job8: (groupid=0, jobs=1): err= 0: pid=2438618: Tue Apr 23 05:07:03 2024 00:22:25.201 write: IOPS=501, BW=125MiB/s (132MB/s)(1265MiB/10082msec); 0 zone resets 00:22:25.201 slat (usec): min=20, max=82761, avg=1309.31, stdev=4049.68 00:22:25.201 clat (usec): min=982, max=421919, avg=126184.46, stdev=87703.22 00:22:25.201 lat (usec): min=1054, max=421985, avg=127493.77, stdev=88693.14 00:22:25.201 clat percentiles (msec): 00:22:25.201 | 1.00th=[ 5], 5.00th=[ 21], 10.00th=[ 40], 20.00th=[ 52], 00:22:25.201 | 30.00th=[ 70], 40.00th=[ 85], 50.00th=[ 100], 60.00th=[ 121], 00:22:25.201 | 70.00th=[ 163], 80.00th=[ 192], 90.00th=[ 251], 95.00th=[ 321], 00:22:25.201 | 99.00th=[ 376], 99.50th=[ 405], 99.90th=[ 418], 99.95th=[ 422], 00:22:25.201 | 99.99th=[ 422] 00:22:25.201 bw ( KiB/s): min=47104, max=254464, per=9.28%, avg=127882.80, stdev=58583.20, samples=20 00:22:25.201 iops : min= 184, max= 994, avg=499.50, stdev=228.83, samples=20 00:22:25.201 lat (usec) : 1000=0.02% 00:22:25.201 lat (msec) : 2=0.32%, 4=0.55%, 10=1.76%, 20=2.10%, 50=13.66% 00:22:25.201 lat (msec) : 100=32.02%, 250=39.57%, 500=10.00% 00:22:25.201 cpu : usr=1.65%, sys=1.89%, ctx=2835, majf=0, minf=1 00:22:25.201 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:25.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.201 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.201 issued rwts: total=0,5059,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.201 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.201 job9: (groupid=0, jobs=1): err= 0: pid=2438619: Tue Apr 23 05:07:03 2024 00:22:25.201 write: IOPS=529, BW=132MiB/s (139MB/s)(1338MiB/10107msec); 0 zone resets 00:22:25.201 slat (usec): min=17, max=71247, avg=1266.62, stdev=4187.29 00:22:25.201 clat (usec): min=1056, max=424692, avg=119592.13, stdev=90458.36 00:22:25.201 lat (usec): min=1125, max=424745, avg=120858.75, stdev=91684.83 00:22:25.201 clat percentiles (msec): 00:22:25.201 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 31], 20.00th=[ 46], 00:22:25.201 | 30.00th=[ 50], 40.00th=[ 69], 50.00th=[ 91], 60.00th=[ 121], 00:22:25.201 | 70.00th=[ 150], 80.00th=[ 201], 90.00th=[ 259], 95.00th=[ 309], 00:22:25.201 | 99.00th=[ 363], 99.50th=[ 368], 99.90th=[ 380], 99.95th=[ 380], 00:22:25.201 | 99.99th=[ 426] 00:22:25.201 bw ( KiB/s): min=45056, max=315392, per=9.83%, avg=135360.40, stdev=73964.56, samples=20 00:22:25.201 iops : min= 176, max= 1232, avg=528.75, stdev=288.92, samples=20 00:22:25.201 lat (msec) : 2=0.34%, 4=0.50%, 10=2.84%, 20=2.47%, 50=24.19% 00:22:25.201 lat (msec) : 100=21.76%, 250=37.08%, 500=10.82% 00:22:25.201 cpu : usr=1.68%, sys=1.88%, ctx=3126, majf=0, minf=1 00:22:25.201 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:25.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.201 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.201 issued rwts: total=0,5350,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.201 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.201 job10: (groupid=0, jobs=1): err= 0: pid=2438620: Tue Apr 23 05:07:03 2024 00:22:25.201 write: IOPS=472, BW=118MiB/s (124MB/s)(1193MiB/10103msec); 0 zone resets 00:22:25.201 slat (usec): min=25, max=91181, avg=1503.73, stdev=4424.80 00:22:25.201 clat (msec): min=3, max=379, avg=134.00, stdev=89.65 00:22:25.201 lat (msec): min=3, max=383, avg=135.50, stdev=90.82 00:22:25.201 clat percentiles (msec): 00:22:25.201 | 1.00th=[ 7], 5.00th=[ 16], 10.00th=[ 26], 20.00th=[ 46], 00:22:25.201 | 30.00th=[ 75], 40.00th=[ 99], 50.00th=[ 124], 60.00th=[ 140], 00:22:25.201 | 70.00th=[ 171], 80.00th=[ 218], 90.00th=[ 275], 95.00th=[ 309], 00:22:25.201 | 99.00th=[ 351], 99.50th=[ 363], 99.90th=[ 376], 99.95th=[ 380], 00:22:25.201 | 99.99th=[ 380] 00:22:25.201 bw ( KiB/s): min=51200, max=259584, per=8.75%, avg=120499.20, stdev=56580.61, samples=20 00:22:25.201 iops : min= 200, max= 1014, avg=470.70, stdev=221.02, samples=20 00:22:25.201 lat (msec) : 4=0.13%, 10=2.54%, 20=5.30%, 50=13.44%, 100=19.29% 00:22:25.201 lat (msec) : 250=45.07%, 500=14.23% 00:22:25.201 cpu : usr=1.47%, sys=2.00%, ctx=2835, majf=0, minf=1 00:22:25.201 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:25.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:25.201 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:25.201 issued rwts: total=0,4770,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:25.201 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:25.201 00:22:25.201 Run status group 0 (all jobs): 00:22:25.201 WRITE: bw=1345MiB/s (1411MB/s), 99.3MiB/s-162MiB/s (104MB/s-170MB/s), io=13.4GiB (14.3GB), run=10068-10170msec 00:22:25.201 00:22:25.201 Disk stats (read/write): 00:22:25.201 nvme0n1: ios=50/10884, merge=0/0, ticks=3318/1237605, in_queue=1240923, util=99.87% 00:22:25.201 nvme10n1: ios=48/7740, merge=0/0, ticks=1785/1201565, in_queue=1203350, util=100.00% 00:22:25.201 nvme1n1: ios=37/9992, merge=0/0, ticks=395/1222501, in_queue=1222896, util=100.00% 00:22:25.201 nvme2n1: ios=0/8947, merge=0/0, ticks=0/1251240, in_queue=1251240, util=97.77% 00:22:25.201 nvme3n1: ios=44/9837, merge=0/0, ticks=294/1252061, in_queue=1252355, util=100.00% 00:22:25.201 nvme4n1: ios=0/12792, merge=0/0, ticks=0/1218941, in_queue=1218941, util=98.15% 00:22:25.201 nvme5n1: ios=45/8081, merge=0/0, ticks=3393/1243640, in_queue=1247033, util=100.00% 00:22:25.201 nvme6n1: ios=41/9847, merge=0/0, ticks=743/1212470, in_queue=1213213, util=100.00% 00:22:25.201 nvme7n1: ios=0/9831, merge=0/0, ticks=0/1221956, in_queue=1221956, util=98.73% 00:22:25.201 nvme8n1: ios=0/10484, merge=0/0, ticks=0/1219666, in_queue=1219666, util=98.96% 00:22:25.201 nvme9n1: ios=0/9332, merge=0/0, ticks=0/1217955, in_queue=1217955, util=99.10% 00:22:25.201 05:07:03 -- target/multiconnection.sh@36 -- # sync 00:22:25.201 05:07:03 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:25.201 05:07:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.201 05:07:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:25.201 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:25.201 05:07:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:25.201 05:07:03 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.201 05:07:03 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.201 05:07:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:22:25.201 05:07:03 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.201 05:07:03 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK1 00:22:25.201 05:07:03 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.201 05:07:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:25.201 05:07:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.201 05:07:03 -- common/autotest_common.sh@10 -- # set +x 00:22:25.201 05:07:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.201 05:07:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.201 05:07:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:25.201 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:25.201 05:07:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:25.201 05:07:03 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.201 05:07:03 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.201 05:07:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:22:25.201 05:07:03 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.201 05:07:03 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK2 00:22:25.201 05:07:03 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.201 05:07:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:25.201 05:07:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.201 05:07:03 -- common/autotest_common.sh@10 -- # set +x 00:22:25.201 05:07:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.201 05:07:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.201 05:07:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:25.201 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:25.201 05:07:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:25.201 05:07:03 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.201 05:07:03 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.201 05:07:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:22:25.201 05:07:03 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.201 05:07:03 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK3 00:22:25.201 05:07:03 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.201 05:07:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:25.201 05:07:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.201 05:07:03 -- common/autotest_common.sh@10 -- # set +x 00:22:25.201 05:07:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.201 05:07:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.201 05:07:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:25.201 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:25.201 05:07:04 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:25.201 05:07:04 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.201 05:07:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.201 05:07:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:22:25.201 05:07:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.201 05:07:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK4 00:22:25.201 05:07:04 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.201 05:07:04 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:25.201 05:07:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.201 05:07:04 -- common/autotest_common.sh@10 -- # set +x 00:22:25.201 05:07:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.201 05:07:04 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.201 05:07:04 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:25.460 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:25.460 05:07:04 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:25.460 05:07:04 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.460 05:07:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.460 05:07:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:22:25.460 05:07:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.460 05:07:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK5 00:22:25.460 05:07:04 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.460 05:07:04 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:25.460 05:07:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.460 05:07:04 -- common/autotest_common.sh@10 -- # set +x 00:22:25.460 05:07:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.460 05:07:04 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.460 05:07:04 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:25.460 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:25.460 05:07:04 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:25.460 05:07:04 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.460 05:07:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.460 05:07:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:22:25.460 05:07:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.460 05:07:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK6 00:22:25.460 05:07:04 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.460 05:07:04 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:25.460 05:07:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.460 05:07:04 -- common/autotest_common.sh@10 -- # set +x 00:22:25.719 05:07:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.719 05:07:04 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.719 05:07:04 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:25.719 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:25.719 05:07:04 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:25.719 05:07:04 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.719 05:07:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.719 05:07:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:22:25.719 05:07:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.719 05:07:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK7 00:22:25.719 05:07:04 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.719 05:07:04 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:25.719 05:07:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.719 05:07:04 -- common/autotest_common.sh@10 -- # set +x 00:22:25.719 05:07:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.719 05:07:04 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.719 05:07:04 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:25.977 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:25.977 05:07:04 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:25.977 05:07:04 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.977 05:07:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.977 05:07:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:22:25.977 05:07:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.977 05:07:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK8 00:22:25.977 05:07:04 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.977 05:07:04 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:25.977 05:07:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.977 05:07:04 -- common/autotest_common.sh@10 -- # set +x 00:22:25.977 05:07:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.977 05:07:04 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.977 05:07:04 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:25.977 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:25.977 05:07:05 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:25.977 05:07:05 -- common/autotest_common.sh@1205 -- # local i=0 00:22:25.977 05:07:05 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:25.977 05:07:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:22:25.977 05:07:05 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:25.977 05:07:05 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK9 00:22:25.977 05:07:05 -- common/autotest_common.sh@1217 -- # return 0 00:22:25.977 05:07:05 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:25.977 05:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.977 05:07:05 -- common/autotest_common.sh@10 -- # set +x 00:22:25.977 05:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:25.977 05:07:05 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.977 05:07:05 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:26.235 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:26.235 05:07:05 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:26.235 05:07:05 -- common/autotest_common.sh@1205 -- # local i=0 00:22:26.235 05:07:05 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:26.235 05:07:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:22:26.235 05:07:05 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:26.235 05:07:05 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK10 00:22:26.235 05:07:05 -- common/autotest_common.sh@1217 -- # return 0 00:22:26.235 05:07:05 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:26.235 05:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:26.235 05:07:05 -- common/autotest_common.sh@10 -- # set +x 00:22:26.235 05:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:26.235 05:07:05 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.235 05:07:05 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:26.235 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:26.235 05:07:05 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:26.235 05:07:05 -- common/autotest_common.sh@1205 -- # local i=0 00:22:26.235 05:07:05 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:26.235 05:07:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:22:26.235 05:07:05 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:26.235 05:07:05 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK11 00:22:26.235 05:07:05 -- common/autotest_common.sh@1217 -- # return 0 00:22:26.235 05:07:05 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:26.235 05:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:26.235 05:07:05 -- common/autotest_common.sh@10 -- # set +x 00:22:26.235 05:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:26.235 05:07:05 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:26.235 05:07:05 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:26.235 05:07:05 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:26.235 05:07:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:26.235 05:07:05 -- nvmf/common.sh@117 -- # sync 00:22:26.235 05:07:05 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:22:26.235 05:07:05 -- nvmf/common.sh@120 -- # set +e 00:22:26.235 05:07:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:26.235 05:07:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:22:26.235 rmmod nvme_tcp 00:22:26.235 rmmod nvme_fabrics 00:22:26.235 rmmod nvme_keyring 00:22:26.494 05:07:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:26.494 05:07:05 -- nvmf/common.sh@124 -- # set -e 00:22:26.494 05:07:05 -- nvmf/common.sh@125 -- # return 0 00:22:26.494 05:07:05 -- nvmf/common.sh@478 -- # '[' -n 2433309 ']' 00:22:26.494 05:07:05 -- nvmf/common.sh@479 -- # killprocess 2433309 00:22:26.494 05:07:05 -- common/autotest_common.sh@936 -- # '[' -z 2433309 ']' 00:22:26.494 05:07:05 -- common/autotest_common.sh@940 -- # kill -0 2433309 00:22:26.494 05:07:05 -- common/autotest_common.sh@941 -- # uname 00:22:26.494 05:07:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:26.494 05:07:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2433309 00:22:26.494 05:07:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:26.494 05:07:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:26.494 05:07:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2433309' 00:22:26.494 killing process with pid 2433309 00:22:26.494 05:07:05 -- common/autotest_common.sh@955 -- # kill 2433309 00:22:26.494 05:07:05 -- common/autotest_common.sh@960 -- # wait 2433309 00:22:27.065 05:07:05 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:27.065 05:07:05 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:22:27.065 05:07:05 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:22:27.065 05:07:05 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:27.065 05:07:05 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:22:27.065 05:07:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:27.065 05:07:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:27.065 05:07:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:28.968 05:07:08 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:22:28.968 00:22:28.968 real 0m59.405s 00:22:28.968 user 3m14.868s 00:22:28.968 sys 0m25.766s 00:22:28.968 05:07:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:28.968 05:07:08 -- common/autotest_common.sh@10 -- # set +x 00:22:28.968 ************************************ 00:22:28.968 END TEST nvmf_multiconnection 00:22:28.968 ************************************ 00:22:28.968 05:07:08 -- nvmf/nvmf.sh@67 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:28.968 05:07:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:28.968 05:07:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:28.968 05:07:08 -- common/autotest_common.sh@10 -- # set +x 00:22:29.227 ************************************ 00:22:29.227 START TEST nvmf_initiator_timeout 00:22:29.227 ************************************ 00:22:29.227 05:07:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:29.227 * Looking for test storage... 00:22:29.227 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:29.227 05:07:08 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:29.227 05:07:08 -- nvmf/common.sh@7 -- # uname -s 00:22:29.227 05:07:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:29.227 05:07:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:29.227 05:07:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:29.227 05:07:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:29.227 05:07:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:29.227 05:07:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:29.227 05:07:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:29.227 05:07:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:29.227 05:07:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:29.227 05:07:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:29.227 05:07:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:29.227 05:07:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:29.227 05:07:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:29.227 05:07:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:29.227 05:07:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:29.227 05:07:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:29.227 05:07:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:29.227 05:07:08 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:29.227 05:07:08 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:29.227 05:07:08 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:29.227 05:07:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.227 05:07:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.227 05:07:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.227 05:07:08 -- paths/export.sh@5 -- # export PATH 00:22:29.227 05:07:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.227 05:07:08 -- nvmf/common.sh@47 -- # : 0 00:22:29.227 05:07:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:29.227 05:07:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:29.227 05:07:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:29.227 05:07:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:29.227 05:07:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:29.227 05:07:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:29.227 05:07:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:29.227 05:07:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:29.227 05:07:08 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:29.227 05:07:08 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:29.227 05:07:08 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:29.227 05:07:08 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:22:29.227 05:07:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:29.228 05:07:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:29.228 05:07:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:29.228 05:07:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:29.228 05:07:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.228 05:07:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.228 05:07:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.228 05:07:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:29.228 05:07:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:29.228 05:07:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:29.228 05:07:08 -- common/autotest_common.sh@10 -- # set +x 00:22:31.161 05:07:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:31.162 05:07:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:31.162 05:07:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:31.162 05:07:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:31.162 05:07:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:31.162 05:07:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:31.162 05:07:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:31.162 05:07:10 -- nvmf/common.sh@295 -- # net_devs=() 00:22:31.162 05:07:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:31.162 05:07:10 -- nvmf/common.sh@296 -- # e810=() 00:22:31.162 05:07:10 -- nvmf/common.sh@296 -- # local -ga e810 00:22:31.162 05:07:10 -- nvmf/common.sh@297 -- # x722=() 00:22:31.162 05:07:10 -- nvmf/common.sh@297 -- # local -ga x722 00:22:31.162 05:07:10 -- nvmf/common.sh@298 -- # mlx=() 00:22:31.162 05:07:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:31.162 05:07:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:31.162 05:07:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:31.162 05:07:10 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:22:31.162 05:07:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:31.162 05:07:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:31.162 05:07:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:31.162 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:31.162 05:07:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:31.162 05:07:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:31.162 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:31.162 05:07:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:31.162 05:07:10 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:31.162 05:07:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:31.162 05:07:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:31.162 05:07:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:31.162 05:07:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:31.162 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:31.162 05:07:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:31.162 05:07:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:31.162 05:07:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:31.162 05:07:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:31.162 05:07:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:31.162 05:07:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:31.162 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:31.162 05:07:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:31.162 05:07:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:31.162 05:07:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:31.162 05:07:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:22:31.162 05:07:10 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:31.162 05:07:10 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:31.162 05:07:10 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:31.162 05:07:10 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:22:31.162 05:07:10 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:31.162 05:07:10 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:31.162 05:07:10 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:22:31.162 05:07:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:31.162 05:07:10 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:31.162 05:07:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:22:31.162 05:07:10 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:22:31.162 05:07:10 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:22:31.162 05:07:10 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:31.162 05:07:10 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:31.162 05:07:10 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:31.162 05:07:10 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:22:31.162 05:07:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:31.162 05:07:10 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:31.162 05:07:10 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:31.162 05:07:10 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:22:31.162 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:31.162 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.149 ms 00:22:31.162 00:22:31.162 --- 10.0.0.2 ping statistics --- 00:22:31.162 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:31.162 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:22:31.162 05:07:10 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:31.162 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:31.162 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.138 ms 00:22:31.162 00:22:31.162 --- 10.0.0.1 ping statistics --- 00:22:31.162 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:31.162 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:22:31.162 05:07:10 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:31.162 05:07:10 -- nvmf/common.sh@411 -- # return 0 00:22:31.162 05:07:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:31.162 05:07:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:31.162 05:07:10 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:22:31.162 05:07:10 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:31.162 05:07:10 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:22:31.162 05:07:10 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:22:31.162 05:07:10 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:22:31.162 05:07:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:31.162 05:07:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:31.162 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.162 05:07:10 -- nvmf/common.sh@470 -- # nvmfpid=2441958 00:22:31.162 05:07:10 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:31.162 05:07:10 -- nvmf/common.sh@471 -- # waitforlisten 2441958 00:22:31.162 05:07:10 -- common/autotest_common.sh@817 -- # '[' -z 2441958 ']' 00:22:31.162 05:07:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:31.162 05:07:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:31.162 05:07:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:31.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:31.162 05:07:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:31.162 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.162 [2024-04-23 05:07:10.268589] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:22:31.162 [2024-04-23 05:07:10.268662] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:31.162 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.162 [2024-04-23 05:07:10.306574] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:22:31.421 [2024-04-23 05:07:10.334136] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:31.421 [2024-04-23 05:07:10.419677] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:31.421 [2024-04-23 05:07:10.419740] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:31.421 [2024-04-23 05:07:10.419754] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:31.421 [2024-04-23 05:07:10.419765] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:31.421 [2024-04-23 05:07:10.419774] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:31.421 [2024-04-23 05:07:10.419846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:31.421 [2024-04-23 05:07:10.419928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:31.421 [2024-04-23 05:07:10.419996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:31.421 [2024-04-23 05:07:10.419999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:31.421 05:07:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:31.421 05:07:10 -- common/autotest_common.sh@850 -- # return 0 00:22:31.421 05:07:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:31.421 05:07:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:31.421 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.421 05:07:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:31.421 05:07:10 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:31.421 05:07:10 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:31.421 05:07:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:31.421 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.681 Malloc0 00:22:31.681 05:07:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:31.681 05:07:10 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:22:31.681 05:07:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:31.681 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.681 Delay0 00:22:31.681 05:07:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:31.681 05:07:10 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:31.681 05:07:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:31.681 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.681 [2024-04-23 05:07:10.603102] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:31.681 05:07:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:31.681 05:07:10 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:22:31.681 05:07:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:31.681 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.681 05:07:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:31.681 05:07:10 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:22:31.681 05:07:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:31.681 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.681 05:07:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:31.681 05:07:10 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:31.681 05:07:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:31.681 05:07:10 -- common/autotest_common.sh@10 -- # set +x 00:22:31.681 [2024-04-23 05:07:10.631405] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:31.681 05:07:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:31.681 05:07:10 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:32.252 05:07:11 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:22:32.252 05:07:11 -- common/autotest_common.sh@1184 -- # local i=0 00:22:32.252 05:07:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:22:32.252 05:07:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:22:32.252 05:07:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:22:34.156 05:07:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:22:34.156 05:07:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:22:34.156 05:07:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:22:34.156 05:07:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:22:34.156 05:07:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:22:34.156 05:07:13 -- common/autotest_common.sh@1194 -- # return 0 00:22:34.156 05:07:13 -- target/initiator_timeout.sh@35 -- # fio_pid=2442378 00:22:34.156 05:07:13 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:22:34.156 05:07:13 -- target/initiator_timeout.sh@37 -- # sleep 3 00:22:34.156 [global] 00:22:34.156 thread=1 00:22:34.156 invalidate=1 00:22:34.156 rw=write 00:22:34.156 time_based=1 00:22:34.156 runtime=60 00:22:34.156 ioengine=libaio 00:22:34.156 direct=1 00:22:34.156 bs=4096 00:22:34.156 iodepth=1 00:22:34.156 norandommap=0 00:22:34.156 numjobs=1 00:22:34.156 00:22:34.156 verify_dump=1 00:22:34.156 verify_backlog=512 00:22:34.156 verify_state_save=0 00:22:34.156 do_verify=1 00:22:34.156 verify=crc32c-intel 00:22:34.156 [job0] 00:22:34.156 filename=/dev/nvme0n1 00:22:34.156 Could not set queue depth (nvme0n1) 00:22:34.414 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:22:34.414 fio-3.35 00:22:34.414 Starting 1 thread 00:22:37.706 05:07:16 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:22:37.706 05:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:37.706 05:07:16 -- common/autotest_common.sh@10 -- # set +x 00:22:37.706 true 00:22:37.706 05:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:37.706 05:07:16 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:22:37.706 05:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:37.706 05:07:16 -- common/autotest_common.sh@10 -- # set +x 00:22:37.706 true 00:22:37.706 05:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:37.706 05:07:16 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:22:37.706 05:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:37.706 05:07:16 -- common/autotest_common.sh@10 -- # set +x 00:22:37.706 true 00:22:37.706 05:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:37.706 05:07:16 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:22:37.706 05:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:37.706 05:07:16 -- common/autotest_common.sh@10 -- # set +x 00:22:37.706 true 00:22:37.706 05:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:37.706 05:07:16 -- target/initiator_timeout.sh@45 -- # sleep 3 00:22:40.239 05:07:19 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:22:40.239 05:07:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:40.239 05:07:19 -- common/autotest_common.sh@10 -- # set +x 00:22:40.239 true 00:22:40.239 05:07:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:40.239 05:07:19 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:22:40.239 05:07:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:40.239 05:07:19 -- common/autotest_common.sh@10 -- # set +x 00:22:40.239 true 00:22:40.239 05:07:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:40.239 05:07:19 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:22:40.239 05:07:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:40.239 05:07:19 -- common/autotest_common.sh@10 -- # set +x 00:22:40.239 true 00:22:40.239 05:07:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:40.239 05:07:19 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:22:40.239 05:07:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:40.239 05:07:19 -- common/autotest_common.sh@10 -- # set +x 00:22:40.239 true 00:22:40.239 05:07:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:40.239 05:07:19 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:22:40.239 05:07:19 -- target/initiator_timeout.sh@54 -- # wait 2442378 00:23:36.481 00:23:36.481 job0: (groupid=0, jobs=1): err= 0: pid=2442457: Tue Apr 23 05:08:13 2024 00:23:36.481 read: IOPS=103, BW=413KiB/s (423kB/s)(24.2MiB/60037msec) 00:23:36.481 slat (usec): min=4, max=8834, avg=21.57, stdev=112.55 00:23:36.481 clat (usec): min=268, max=40900k, avg=9364.49, stdev=519694.18 00:23:36.481 lat (usec): min=275, max=40900k, avg=9386.06, stdev=519694.14 00:23:36.481 clat percentiles (usec): 00:23:36.481 | 1.00th=[ 289], 5.00th=[ 310], 10.00th=[ 322], 00:23:36.481 | 20.00th=[ 343], 30.00th=[ 363], 40.00th=[ 379], 00:23:36.481 | 50.00th=[ 392], 60.00th=[ 404], 70.00th=[ 420], 00:23:36.481 | 80.00th=[ 437], 90.00th=[ 482], 95.00th=[ 41157], 00:23:36.481 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:23:36.481 | 99.95th=[ 42206], 99.99th=[17112761] 00:23:36.481 write: IOPS=110, BW=443KiB/s (454kB/s)(26.0MiB/60037msec); 0 zone resets 00:23:36.481 slat (nsec): min=5986, max=84401, avg=19163.77, stdev=11396.68 00:23:36.481 clat (usec): min=184, max=479, avg=254.33, stdev=54.24 00:23:36.481 lat (usec): min=191, max=513, avg=273.50, stdev=61.56 00:23:36.481 clat percentiles (usec): 00:23:36.481 | 1.00th=[ 194], 5.00th=[ 202], 10.00th=[ 206], 20.00th=[ 212], 00:23:36.481 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 235], 60.00th=[ 247], 00:23:36.481 | 70.00th=[ 269], 80.00th=[ 293], 90.00th=[ 334], 95.00th=[ 371], 00:23:36.481 | 99.00th=[ 429], 99.50th=[ 441], 99.90th=[ 457], 99.95th=[ 465], 00:23:36.481 | 99.99th=[ 482] 00:23:36.481 bw ( KiB/s): min= 2776, max= 8192, per=100.00%, avg=5324.80, stdev=1581.48, samples=10 00:23:36.481 iops : min= 694, max= 2048, avg=1331.20, stdev=395.37, samples=10 00:23:36.481 lat (usec) : 250=32.27%, 500=63.29%, 750=1.60% 00:23:36.481 lat (msec) : 2=0.01%, 4=0.02%, 10=0.02%, 50=2.79%, >=2000=0.01% 00:23:36.481 cpu : usr=0.23%, sys=0.44%, ctx=12852, majf=0, minf=2 00:23:36.481 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:36.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:36.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:36.481 issued rwts: total=6195,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:36.481 latency : target=0, window=0, percentile=100.00%, depth=1 00:23:36.481 00:23:36.481 Run status group 0 (all jobs): 00:23:36.481 READ: bw=413KiB/s (423kB/s), 413KiB/s-413KiB/s (423kB/s-423kB/s), io=24.2MiB (25.4MB), run=60037-60037msec 00:23:36.481 WRITE: bw=443KiB/s (454kB/s), 443KiB/s-443KiB/s (454kB/s-454kB/s), io=26.0MiB (27.3MB), run=60037-60037msec 00:23:36.481 00:23:36.481 Disk stats (read/write): 00:23:36.481 nvme0n1: ios=6290/6656, merge=0/0, ticks=18091/1594, in_queue=19685, util=99.63% 00:23:36.481 05:08:13 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:36.481 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:36.481 05:08:13 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:23:36.481 05:08:13 -- common/autotest_common.sh@1205 -- # local i=0 00:23:36.481 05:08:13 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:23:36.481 05:08:13 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:36.481 05:08:13 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:23:36.481 05:08:13 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:36.482 05:08:13 -- common/autotest_common.sh@1217 -- # return 0 00:23:36.482 05:08:13 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:23:36.482 05:08:13 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:23:36.482 nvmf hotplug test: fio successful as expected 00:23:36.482 05:08:13 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:36.482 05:08:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.482 05:08:13 -- common/autotest_common.sh@10 -- # set +x 00:23:36.482 05:08:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.482 05:08:13 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:23:36.482 05:08:13 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:23:36.482 05:08:13 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:23:36.482 05:08:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:36.482 05:08:13 -- nvmf/common.sh@117 -- # sync 00:23:36.482 05:08:13 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:23:36.482 05:08:13 -- nvmf/common.sh@120 -- # set +e 00:23:36.482 05:08:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:36.482 05:08:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:23:36.482 rmmod nvme_tcp 00:23:36.482 rmmod nvme_fabrics 00:23:36.482 rmmod nvme_keyring 00:23:36.482 05:08:13 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:36.482 05:08:13 -- nvmf/common.sh@124 -- # set -e 00:23:36.482 05:08:13 -- nvmf/common.sh@125 -- # return 0 00:23:36.482 05:08:13 -- nvmf/common.sh@478 -- # '[' -n 2441958 ']' 00:23:36.482 05:08:13 -- nvmf/common.sh@479 -- # killprocess 2441958 00:23:36.482 05:08:13 -- common/autotest_common.sh@936 -- # '[' -z 2441958 ']' 00:23:36.482 05:08:13 -- common/autotest_common.sh@940 -- # kill -0 2441958 00:23:36.482 05:08:13 -- common/autotest_common.sh@941 -- # uname 00:23:36.482 05:08:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:36.482 05:08:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2441958 00:23:36.482 05:08:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:36.482 05:08:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:36.482 05:08:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2441958' 00:23:36.482 killing process with pid 2441958 00:23:36.482 05:08:13 -- common/autotest_common.sh@955 -- # kill 2441958 00:23:36.482 05:08:13 -- common/autotest_common.sh@960 -- # wait 2441958 00:23:36.482 05:08:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:36.482 05:08:14 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:23:36.482 05:08:14 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:23:36.482 05:08:14 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:36.482 05:08:14 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:23:36.482 05:08:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:36.482 05:08:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:36.482 05:08:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:37.049 05:08:16 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:23:37.049 00:23:37.049 real 1m7.932s 00:23:37.049 user 4m9.330s 00:23:37.049 sys 0m7.127s 00:23:37.049 05:08:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:37.049 05:08:16 -- common/autotest_common.sh@10 -- # set +x 00:23:37.049 ************************************ 00:23:37.049 END TEST nvmf_initiator_timeout 00:23:37.049 ************************************ 00:23:37.049 05:08:16 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:23:37.049 05:08:16 -- nvmf/nvmf.sh@71 -- # '[' tcp = tcp ']' 00:23:37.049 05:08:16 -- nvmf/nvmf.sh@72 -- # gather_supported_nvmf_pci_devs 00:23:37.049 05:08:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:37.049 05:08:16 -- common/autotest_common.sh@10 -- # set +x 00:23:38.954 05:08:18 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:38.954 05:08:18 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:38.954 05:08:18 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:38.954 05:08:18 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:38.954 05:08:18 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:38.954 05:08:18 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:38.954 05:08:18 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:38.954 05:08:18 -- nvmf/common.sh@295 -- # net_devs=() 00:23:38.954 05:08:18 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:38.954 05:08:18 -- nvmf/common.sh@296 -- # e810=() 00:23:38.955 05:08:18 -- nvmf/common.sh@296 -- # local -ga e810 00:23:38.955 05:08:18 -- nvmf/common.sh@297 -- # x722=() 00:23:38.955 05:08:18 -- nvmf/common.sh@297 -- # local -ga x722 00:23:38.955 05:08:18 -- nvmf/common.sh@298 -- # mlx=() 00:23:38.955 05:08:18 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:38.955 05:08:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:38.955 05:08:18 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:38.955 05:08:18 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:23:38.955 05:08:18 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:38.955 05:08:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:38.955 05:08:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:38.955 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:38.955 05:08:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:38.955 05:08:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:38.955 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:38.955 05:08:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:38.955 05:08:18 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:23:38.955 05:08:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:38.955 05:08:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:38.955 05:08:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:38.955 05:08:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:38.955 05:08:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:38.955 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:38.955 05:08:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:38.955 05:08:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:38.955 05:08:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:38.955 05:08:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:38.955 05:08:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:38.955 05:08:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:38.955 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:38.955 05:08:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:38.955 05:08:18 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:38.955 05:08:18 -- nvmf/nvmf.sh@73 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:38.955 05:08:18 -- nvmf/nvmf.sh@74 -- # (( 2 > 0 )) 00:23:38.955 05:08:18 -- nvmf/nvmf.sh@75 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:38.955 05:08:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:38.955 05:08:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:38.955 05:08:18 -- common/autotest_common.sh@10 -- # set +x 00:23:38.955 ************************************ 00:23:38.955 START TEST nvmf_perf_adq 00:23:38.955 ************************************ 00:23:38.955 05:08:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:39.214 * Looking for test storage... 00:23:39.214 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:39.214 05:08:18 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:39.214 05:08:18 -- nvmf/common.sh@7 -- # uname -s 00:23:39.214 05:08:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:39.214 05:08:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:39.214 05:08:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:39.214 05:08:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:39.214 05:08:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:39.214 05:08:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:39.214 05:08:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:39.214 05:08:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:39.214 05:08:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:39.214 05:08:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:39.214 05:08:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:39.214 05:08:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:39.214 05:08:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:39.214 05:08:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:39.214 05:08:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:39.214 05:08:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:39.214 05:08:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:39.214 05:08:18 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:39.214 05:08:18 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:39.214 05:08:18 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:39.214 05:08:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:39.214 05:08:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:39.214 05:08:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:39.214 05:08:18 -- paths/export.sh@5 -- # export PATH 00:23:39.214 05:08:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:39.214 05:08:18 -- nvmf/common.sh@47 -- # : 0 00:23:39.214 05:08:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:39.214 05:08:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:39.215 05:08:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:39.215 05:08:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:39.215 05:08:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:39.215 05:08:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:39.215 05:08:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:39.215 05:08:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:39.215 05:08:18 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:23:39.215 05:08:18 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:39.215 05:08:18 -- common/autotest_common.sh@10 -- # set +x 00:23:41.121 05:08:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:41.121 05:08:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:41.121 05:08:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:41.121 05:08:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:41.121 05:08:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:41.121 05:08:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:41.121 05:08:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:41.121 05:08:20 -- nvmf/common.sh@295 -- # net_devs=() 00:23:41.121 05:08:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:41.121 05:08:20 -- nvmf/common.sh@296 -- # e810=() 00:23:41.121 05:08:20 -- nvmf/common.sh@296 -- # local -ga e810 00:23:41.121 05:08:20 -- nvmf/common.sh@297 -- # x722=() 00:23:41.121 05:08:20 -- nvmf/common.sh@297 -- # local -ga x722 00:23:41.121 05:08:20 -- nvmf/common.sh@298 -- # mlx=() 00:23:41.121 05:08:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:41.121 05:08:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:41.121 05:08:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:41.121 05:08:20 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:23:41.121 05:08:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:41.121 05:08:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:41.121 05:08:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:41.121 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:41.121 05:08:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:41.121 05:08:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:41.121 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:41.121 05:08:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:41.121 05:08:20 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:23:41.121 05:08:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:41.121 05:08:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:41.121 05:08:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:41.121 05:08:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:41.121 05:08:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:41.121 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:41.121 05:08:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:41.121 05:08:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:41.121 05:08:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:41.121 05:08:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:41.121 05:08:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:41.121 05:08:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:41.121 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:41.121 05:08:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:41.121 05:08:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:41.121 05:08:20 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:41.121 05:08:20 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:23:41.121 05:08:20 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:23:41.121 05:08:20 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:23:41.121 05:08:20 -- target/perf_adq.sh@52 -- # rmmod ice 00:23:41.693 05:08:20 -- target/perf_adq.sh@53 -- # modprobe ice 00:23:43.095 05:08:22 -- target/perf_adq.sh@54 -- # sleep 5 00:23:48.374 05:08:27 -- target/perf_adq.sh@67 -- # nvmftestinit 00:23:48.374 05:08:27 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:23:48.374 05:08:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:48.374 05:08:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:48.374 05:08:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:48.374 05:08:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:48.374 05:08:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:48.374 05:08:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:48.374 05:08:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:48.374 05:08:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:48.374 05:08:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:48.374 05:08:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:48.374 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.374 05:08:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:48.374 05:08:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:48.374 05:08:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:48.374 05:08:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:48.374 05:08:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:48.374 05:08:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:48.374 05:08:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:48.374 05:08:27 -- nvmf/common.sh@295 -- # net_devs=() 00:23:48.374 05:08:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:48.374 05:08:27 -- nvmf/common.sh@296 -- # e810=() 00:23:48.374 05:08:27 -- nvmf/common.sh@296 -- # local -ga e810 00:23:48.374 05:08:27 -- nvmf/common.sh@297 -- # x722=() 00:23:48.374 05:08:27 -- nvmf/common.sh@297 -- # local -ga x722 00:23:48.374 05:08:27 -- nvmf/common.sh@298 -- # mlx=() 00:23:48.374 05:08:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:48.374 05:08:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:48.374 05:08:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:48.375 05:08:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:48.375 05:08:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:48.375 05:08:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:48.375 05:08:27 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:23:48.375 05:08:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:48.375 05:08:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:48.375 05:08:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:48.375 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:48.375 05:08:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:48.375 05:08:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:48.375 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:48.375 05:08:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:48.375 05:08:27 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:48.375 05:08:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:48.375 05:08:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:48.375 05:08:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:48.375 05:08:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:48.375 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:48.375 05:08:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:48.375 05:08:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:48.375 05:08:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:48.375 05:08:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:48.375 05:08:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:48.375 05:08:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:48.375 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:48.375 05:08:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:48.375 05:08:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:48.375 05:08:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:48.375 05:08:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:23:48.375 05:08:27 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:48.375 05:08:27 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:48.375 05:08:27 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:48.375 05:08:27 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:23:48.375 05:08:27 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:48.375 05:08:27 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:48.375 05:08:27 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:23:48.375 05:08:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:48.375 05:08:27 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:48.375 05:08:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:23:48.375 05:08:27 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:23:48.375 05:08:27 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:23:48.375 05:08:27 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:48.375 05:08:27 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:48.375 05:08:27 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:48.375 05:08:27 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:23:48.375 05:08:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:48.375 05:08:27 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:48.375 05:08:27 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:48.375 05:08:27 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:23:48.375 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:48.375 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.192 ms 00:23:48.375 00:23:48.375 --- 10.0.0.2 ping statistics --- 00:23:48.375 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:48.375 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:23:48.375 05:08:27 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:48.375 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:48.375 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:23:48.375 00:23:48.375 --- 10.0.0.1 ping statistics --- 00:23:48.375 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:48.375 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:23:48.375 05:08:27 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:48.375 05:08:27 -- nvmf/common.sh@411 -- # return 0 00:23:48.375 05:08:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:48.375 05:08:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:48.375 05:08:27 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:23:48.375 05:08:27 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:48.375 05:08:27 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:23:48.375 05:08:27 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:23:48.375 05:08:27 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:23:48.375 05:08:27 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:48.375 05:08:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:48.375 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.375 05:08:27 -- nvmf/common.sh@470 -- # nvmfpid=2453980 00:23:48.375 05:08:27 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:23:48.375 05:08:27 -- nvmf/common.sh@471 -- # waitforlisten 2453980 00:23:48.375 05:08:27 -- common/autotest_common.sh@817 -- # '[' -z 2453980 ']' 00:23:48.375 05:08:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:48.375 05:08:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:48.375 05:08:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:48.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:48.375 05:08:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:48.375 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.375 [2024-04-23 05:08:27.336379] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:23:48.375 [2024-04-23 05:08:27.336466] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:48.375 EAL: No free 2048 kB hugepages reported on node 1 00:23:48.375 [2024-04-23 05:08:27.376528] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:23:48.375 [2024-04-23 05:08:27.407111] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:48.375 [2024-04-23 05:08:27.498216] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:48.375 [2024-04-23 05:08:27.498273] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:48.375 [2024-04-23 05:08:27.498302] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:48.375 [2024-04-23 05:08:27.498313] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:48.375 [2024-04-23 05:08:27.498324] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:48.375 [2024-04-23 05:08:27.498396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:48.375 [2024-04-23 05:08:27.498453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:48.375 [2024-04-23 05:08:27.498574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:48.375 [2024-04-23 05:08:27.498579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:48.633 05:08:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:48.633 05:08:27 -- common/autotest_common.sh@850 -- # return 0 00:23:48.633 05:08:27 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:48.633 05:08:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:48.633 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.633 05:08:27 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:48.633 05:08:27 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:23:48.633 05:08:27 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:23:48.633 05:08:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:48.633 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.633 05:08:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:48.633 05:08:27 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:23:48.633 05:08:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:48.633 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.633 05:08:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:48.633 05:08:27 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:23:48.633 05:08:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:48.633 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.633 [2024-04-23 05:08:27.706013] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:48.633 05:08:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:48.633 05:08:27 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:48.633 05:08:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:48.633 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.633 Malloc1 00:23:48.633 05:08:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:48.633 05:08:27 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:48.633 05:08:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:48.634 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.634 05:08:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:48.634 05:08:27 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:48.634 05:08:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:48.634 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.634 05:08:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:48.634 05:08:27 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:48.634 05:08:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:48.634 05:08:27 -- common/autotest_common.sh@10 -- # set +x 00:23:48.634 [2024-04-23 05:08:27.756405] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:48.634 05:08:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:48.634 05:08:27 -- target/perf_adq.sh@73 -- # perfpid=2454002 00:23:48.634 05:08:27 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:23:48.634 05:08:27 -- target/perf_adq.sh@74 -- # sleep 2 00:23:48.634 EAL: No free 2048 kB hugepages reported on node 1 00:23:51.165 05:08:29 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:23:51.165 05:08:29 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:23:51.165 05:08:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:51.165 05:08:29 -- target/perf_adq.sh@76 -- # wc -l 00:23:51.165 05:08:29 -- common/autotest_common.sh@10 -- # set +x 00:23:51.165 05:08:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:51.165 05:08:29 -- target/perf_adq.sh@76 -- # count=4 00:23:51.165 05:08:29 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:23:51.165 05:08:29 -- target/perf_adq.sh@81 -- # wait 2454002 00:23:59.282 Initializing NVMe Controllers 00:23:59.282 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:59.282 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:23:59.282 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:23:59.282 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:23:59.282 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:23:59.282 Initialization complete. Launching workers. 00:23:59.282 ======================================================== 00:23:59.282 Latency(us) 00:23:59.282 Device Information : IOPS MiB/s Average min max 00:23:59.282 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10170.72 39.73 6294.68 2327.24 8737.24 00:23:59.282 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10941.31 42.74 5849.19 3272.10 7354.08 00:23:59.282 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10113.52 39.51 6328.71 2290.26 9459.36 00:23:59.282 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10301.92 40.24 6213.92 3152.20 9402.39 00:23:59.282 ======================================================== 00:23:59.282 Total : 41527.46 162.22 6165.56 2290.26 9459.36 00:23:59.282 00:23:59.282 05:08:37 -- target/perf_adq.sh@82 -- # nvmftestfini 00:23:59.282 05:08:37 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:59.282 05:08:37 -- nvmf/common.sh@117 -- # sync 00:23:59.282 05:08:37 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:23:59.282 05:08:37 -- nvmf/common.sh@120 -- # set +e 00:23:59.282 05:08:37 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:59.282 05:08:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:23:59.282 rmmod nvme_tcp 00:23:59.282 rmmod nvme_fabrics 00:23:59.282 rmmod nvme_keyring 00:23:59.282 05:08:37 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:59.282 05:08:37 -- nvmf/common.sh@124 -- # set -e 00:23:59.282 05:08:37 -- nvmf/common.sh@125 -- # return 0 00:23:59.282 05:08:37 -- nvmf/common.sh@478 -- # '[' -n 2453980 ']' 00:23:59.282 05:08:37 -- nvmf/common.sh@479 -- # killprocess 2453980 00:23:59.282 05:08:37 -- common/autotest_common.sh@936 -- # '[' -z 2453980 ']' 00:23:59.282 05:08:37 -- common/autotest_common.sh@940 -- # kill -0 2453980 00:23:59.282 05:08:37 -- common/autotest_common.sh@941 -- # uname 00:23:59.282 05:08:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:59.282 05:08:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2453980 00:23:59.282 05:08:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:59.282 05:08:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:59.282 05:08:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2453980' 00:23:59.282 killing process with pid 2453980 00:23:59.282 05:08:37 -- common/autotest_common.sh@955 -- # kill 2453980 00:23:59.282 05:08:37 -- common/autotest_common.sh@960 -- # wait 2453980 00:23:59.282 05:08:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:59.282 05:08:38 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:23:59.282 05:08:38 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:23:59.282 05:08:38 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:59.282 05:08:38 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:23:59.282 05:08:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:59.282 05:08:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:59.282 05:08:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:01.191 05:08:40 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:24:01.191 05:08:40 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:01.191 05:08:40 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:01.759 05:08:40 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:03.133 05:08:42 -- target/perf_adq.sh@54 -- # sleep 5 00:24:08.400 05:08:47 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:08.401 05:08:47 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:24:08.401 05:08:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:08.401 05:08:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:08.401 05:08:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:08.401 05:08:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:08.401 05:08:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:08.401 05:08:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:08.401 05:08:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:08.401 05:08:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:08.401 05:08:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:08.401 05:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:08.401 05:08:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:08.401 05:08:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:08.401 05:08:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:08.401 05:08:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:08.401 05:08:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:08.401 05:08:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:08.401 05:08:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:08.401 05:08:47 -- nvmf/common.sh@295 -- # net_devs=() 00:24:08.401 05:08:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:08.401 05:08:47 -- nvmf/common.sh@296 -- # e810=() 00:24:08.401 05:08:47 -- nvmf/common.sh@296 -- # local -ga e810 00:24:08.401 05:08:47 -- nvmf/common.sh@297 -- # x722=() 00:24:08.401 05:08:47 -- nvmf/common.sh@297 -- # local -ga x722 00:24:08.401 05:08:47 -- nvmf/common.sh@298 -- # mlx=() 00:24:08.401 05:08:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:08.401 05:08:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:08.401 05:08:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:08.401 05:08:47 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:08.401 05:08:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:08.401 05:08:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:08.401 05:08:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:08.401 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:08.401 05:08:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:08.401 05:08:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:08.401 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:08.401 05:08:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:08.401 05:08:47 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:08.401 05:08:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.401 05:08:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:08.401 05:08:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.401 05:08:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:08.401 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:08.401 05:08:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.401 05:08:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:08.401 05:08:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.401 05:08:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:08.401 05:08:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.401 05:08:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:08.401 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:08.401 05:08:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.401 05:08:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:08.401 05:08:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:08.401 05:08:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:24:08.401 05:08:47 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:08.401 05:08:47 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:08.401 05:08:47 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:08.401 05:08:47 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:24:08.401 05:08:47 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:08.401 05:08:47 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:08.401 05:08:47 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:24:08.401 05:08:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:08.401 05:08:47 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:08.401 05:08:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:24:08.401 05:08:47 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:24:08.401 05:08:47 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:24:08.401 05:08:47 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:08.401 05:08:47 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:08.401 05:08:47 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:08.401 05:08:47 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:24:08.401 05:08:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:08.401 05:08:47 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:08.401 05:08:47 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:08.401 05:08:47 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:24:08.401 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:08.401 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.136 ms 00:24:08.401 00:24:08.401 --- 10.0.0.2 ping statistics --- 00:24:08.401 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:08.401 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:24:08.401 05:08:47 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:08.401 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:08.401 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:24:08.401 00:24:08.401 --- 10.0.0.1 ping statistics --- 00:24:08.401 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:08.401 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:24:08.401 05:08:47 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:08.401 05:08:47 -- nvmf/common.sh@411 -- # return 0 00:24:08.401 05:08:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:08.401 05:08:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:08.401 05:08:47 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:24:08.401 05:08:47 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:08.401 05:08:47 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:24:08.401 05:08:47 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:24:08.401 05:08:47 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:08.401 05:08:47 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:08.402 05:08:47 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:08.402 05:08:47 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:08.402 net.core.busy_poll = 1 00:24:08.402 05:08:47 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:08.402 net.core.busy_read = 1 00:24:08.402 05:08:47 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:08.402 05:08:47 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:08.402 05:08:47 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:08.402 05:08:47 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:08.402 05:08:47 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:08.660 05:08:47 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:08.660 05:08:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:08.660 05:08:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:08.660 05:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:08.660 05:08:47 -- nvmf/common.sh@470 -- # nvmfpid=2456612 00:24:08.660 05:08:47 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:08.660 05:08:47 -- nvmf/common.sh@471 -- # waitforlisten 2456612 00:24:08.660 05:08:47 -- common/autotest_common.sh@817 -- # '[' -z 2456612 ']' 00:24:08.660 05:08:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:08.660 05:08:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:08.660 05:08:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:08.660 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:08.660 05:08:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:08.660 05:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:08.660 [2024-04-23 05:08:47.634817] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:08.660 [2024-04-23 05:08:47.634906] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:08.660 EAL: No free 2048 kB hugepages reported on node 1 00:24:08.660 [2024-04-23 05:08:47.680277] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:08.660 [2024-04-23 05:08:47.710847] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:08.660 [2024-04-23 05:08:47.801561] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:08.660 [2024-04-23 05:08:47.801614] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:08.660 [2024-04-23 05:08:47.801643] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:08.660 [2024-04-23 05:08:47.801654] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:08.660 [2024-04-23 05:08:47.801664] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:08.660 [2024-04-23 05:08:47.801714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:08.660 [2024-04-23 05:08:47.801777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:08.660 [2024-04-23 05:08:47.801800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:08.660 [2024-04-23 05:08:47.801812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:08.918 05:08:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:08.918 05:08:47 -- common/autotest_common.sh@850 -- # return 0 00:24:08.918 05:08:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:08.918 05:08:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:08.918 05:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 05:08:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:08.918 05:08:47 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:08.918 05:08:47 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:08.918 05:08:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:08.918 05:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 05:08:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:08.918 05:08:47 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:08.918 05:08:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:08.918 05:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 05:08:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:08.918 05:08:47 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:08.918 05:08:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:08.918 05:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 [2024-04-23 05:08:47.997475] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:08.918 05:08:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:08.918 05:08:48 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:08.918 05:08:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:08.918 05:08:48 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 Malloc1 00:24:08.918 05:08:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:08.918 05:08:48 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:08.918 05:08:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:08.918 05:08:48 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 05:08:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:08.918 05:08:48 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:08.918 05:08:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:08.918 05:08:48 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 05:08:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:08.918 05:08:48 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:08.918 05:08:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:08.918 05:08:48 -- common/autotest_common.sh@10 -- # set +x 00:24:08.918 [2024-04-23 05:08:48.050734] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:08.918 05:08:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:08.918 05:08:48 -- target/perf_adq.sh@94 -- # perfpid=2456641 00:24:08.918 05:08:48 -- target/perf_adq.sh@95 -- # sleep 2 00:24:08.918 05:08:48 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:09.176 EAL: No free 2048 kB hugepages reported on node 1 00:24:11.076 05:08:50 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:11.076 05:08:50 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:11.076 05:08:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:11.076 05:08:50 -- target/perf_adq.sh@97 -- # wc -l 00:24:11.076 05:08:50 -- common/autotest_common.sh@10 -- # set +x 00:24:11.076 05:08:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:11.076 05:08:50 -- target/perf_adq.sh@97 -- # count=2 00:24:11.076 05:08:50 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:11.076 05:08:50 -- target/perf_adq.sh@103 -- # wait 2456641 00:24:19.199 Initializing NVMe Controllers 00:24:19.199 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:19.200 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:19.200 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:19.200 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:19.200 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:19.200 Initialization complete. Launching workers. 00:24:19.200 ======================================================== 00:24:19.200 Latency(us) 00:24:19.200 Device Information : IOPS MiB/s Average min max 00:24:19.200 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4974.80 19.43 12866.72 1969.81 61711.34 00:24:19.200 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 13358.30 52.18 4790.61 1644.14 6983.05 00:24:19.200 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4564.90 17.83 14023.12 2158.86 59378.13 00:24:19.200 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4257.80 16.63 15048.70 1937.46 61725.98 00:24:19.200 ======================================================== 00:24:19.200 Total : 27155.79 106.08 9430.48 1644.14 61725.98 00:24:19.200 00:24:19.200 05:08:58 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:19.200 05:08:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:19.200 05:08:58 -- nvmf/common.sh@117 -- # sync 00:24:19.200 05:08:58 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:24:19.200 05:08:58 -- nvmf/common.sh@120 -- # set +e 00:24:19.200 05:08:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:19.200 05:08:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:24:19.200 rmmod nvme_tcp 00:24:19.200 rmmod nvme_fabrics 00:24:19.200 rmmod nvme_keyring 00:24:19.200 05:08:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:19.458 05:08:58 -- nvmf/common.sh@124 -- # set -e 00:24:19.458 05:08:58 -- nvmf/common.sh@125 -- # return 0 00:24:19.458 05:08:58 -- nvmf/common.sh@478 -- # '[' -n 2456612 ']' 00:24:19.458 05:08:58 -- nvmf/common.sh@479 -- # killprocess 2456612 00:24:19.458 05:08:58 -- common/autotest_common.sh@936 -- # '[' -z 2456612 ']' 00:24:19.458 05:08:58 -- common/autotest_common.sh@940 -- # kill -0 2456612 00:24:19.458 05:08:58 -- common/autotest_common.sh@941 -- # uname 00:24:19.458 05:08:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:19.458 05:08:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2456612 00:24:19.458 05:08:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:19.458 05:08:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:19.458 05:08:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2456612' 00:24:19.458 killing process with pid 2456612 00:24:19.458 05:08:58 -- common/autotest_common.sh@955 -- # kill 2456612 00:24:19.458 05:08:58 -- common/autotest_common.sh@960 -- # wait 2456612 00:24:19.717 05:08:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:19.717 05:08:58 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:24:19.717 05:08:58 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:24:19.717 05:08:58 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:19.717 05:08:58 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:24:19.717 05:08:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:19.717 05:08:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:19.717 05:08:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:21.619 05:09:00 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:24:21.619 05:09:00 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:21.619 00:24:21.619 real 0m42.552s 00:24:21.619 user 2m37.921s 00:24:21.619 sys 0m9.789s 00:24:21.619 05:09:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:21.619 05:09:00 -- common/autotest_common.sh@10 -- # set +x 00:24:21.619 ************************************ 00:24:21.619 END TEST nvmf_perf_adq 00:24:21.619 ************************************ 00:24:21.619 05:09:00 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:21.619 05:09:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:21.619 05:09:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:21.619 05:09:00 -- common/autotest_common.sh@10 -- # set +x 00:24:21.878 ************************************ 00:24:21.878 START TEST nvmf_shutdown 00:24:21.878 ************************************ 00:24:21.878 05:09:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:21.878 * Looking for test storage... 00:24:21.878 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:21.878 05:09:00 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:21.878 05:09:00 -- nvmf/common.sh@7 -- # uname -s 00:24:21.878 05:09:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:21.878 05:09:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:21.878 05:09:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:21.878 05:09:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:21.878 05:09:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:21.878 05:09:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:21.878 05:09:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:21.878 05:09:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:21.878 05:09:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:21.878 05:09:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:21.878 05:09:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:21.878 05:09:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:21.878 05:09:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:21.878 05:09:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:21.878 05:09:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:21.878 05:09:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:21.878 05:09:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:21.878 05:09:00 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:21.878 05:09:00 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:21.878 05:09:00 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:21.878 05:09:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.878 05:09:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.878 05:09:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.878 05:09:00 -- paths/export.sh@5 -- # export PATH 00:24:21.878 05:09:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.878 05:09:00 -- nvmf/common.sh@47 -- # : 0 00:24:21.878 05:09:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:21.878 05:09:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:21.878 05:09:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:21.878 05:09:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:21.878 05:09:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:21.878 05:09:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:21.878 05:09:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:21.878 05:09:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:21.878 05:09:00 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:21.878 05:09:00 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:21.878 05:09:00 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:21.878 05:09:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:21.878 05:09:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:21.878 05:09:00 -- common/autotest_common.sh@10 -- # set +x 00:24:21.878 ************************************ 00:24:21.878 START TEST nvmf_shutdown_tc1 00:24:21.878 ************************************ 00:24:21.878 05:09:00 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:24:21.878 05:09:00 -- target/shutdown.sh@74 -- # starttarget 00:24:21.878 05:09:00 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:21.878 05:09:00 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:24:21.878 05:09:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:21.878 05:09:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:21.878 05:09:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:21.878 05:09:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:21.878 05:09:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:21.878 05:09:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:21.878 05:09:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:21.878 05:09:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:21.878 05:09:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:21.878 05:09:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:21.878 05:09:00 -- common/autotest_common.sh@10 -- # set +x 00:24:23.780 05:09:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:23.780 05:09:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:23.780 05:09:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:23.780 05:09:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:23.780 05:09:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:23.780 05:09:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:23.780 05:09:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:23.780 05:09:02 -- nvmf/common.sh@295 -- # net_devs=() 00:24:23.780 05:09:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:23.780 05:09:02 -- nvmf/common.sh@296 -- # e810=() 00:24:23.780 05:09:02 -- nvmf/common.sh@296 -- # local -ga e810 00:24:23.780 05:09:02 -- nvmf/common.sh@297 -- # x722=() 00:24:23.780 05:09:02 -- nvmf/common.sh@297 -- # local -ga x722 00:24:23.780 05:09:02 -- nvmf/common.sh@298 -- # mlx=() 00:24:23.780 05:09:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:23.780 05:09:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:23.780 05:09:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:23.780 05:09:02 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:23.780 05:09:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:23.780 05:09:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:23.780 05:09:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:23.780 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:23.780 05:09:02 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:23.780 05:09:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:23.780 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:23.780 05:09:02 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:23.780 05:09:02 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:23.780 05:09:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.780 05:09:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:23.780 05:09:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.780 05:09:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:23.780 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:23.780 05:09:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.780 05:09:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:23.780 05:09:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.780 05:09:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:23.780 05:09:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.780 05:09:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:23.780 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:23.780 05:09:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.780 05:09:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:23.780 05:09:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:23.780 05:09:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:24:23.780 05:09:02 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:24:23.780 05:09:02 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:23.780 05:09:02 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:23.780 05:09:02 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:23.780 05:09:02 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:24:23.780 05:09:02 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:23.780 05:09:02 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:23.780 05:09:02 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:24:23.780 05:09:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:23.780 05:09:02 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:23.780 05:09:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:24:23.780 05:09:02 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:24:23.780 05:09:02 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:24:23.780 05:09:02 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:24.039 05:09:02 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:24.039 05:09:02 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:24.039 05:09:02 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:24:24.039 05:09:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:24.039 05:09:03 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:24.039 05:09:03 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:24.039 05:09:03 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:24:24.039 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:24.039 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:24:24.039 00:24:24.039 --- 10.0.0.2 ping statistics --- 00:24:24.039 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:24.039 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:24:24.039 05:09:03 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:24.039 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:24.039 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:24:24.039 00:24:24.039 --- 10.0.0.1 ping statistics --- 00:24:24.039 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:24.039 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:24:24.039 05:09:03 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:24.039 05:09:03 -- nvmf/common.sh@411 -- # return 0 00:24:24.039 05:09:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:24.039 05:09:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:24.039 05:09:03 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:24:24.039 05:09:03 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:24:24.039 05:09:03 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:24.039 05:09:03 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:24:24.039 05:09:03 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:24:24.039 05:09:03 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:24.039 05:09:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:24.039 05:09:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:24.039 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.039 05:09:03 -- nvmf/common.sh@470 -- # nvmfpid=2459929 00:24:24.039 05:09:03 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:24.039 05:09:03 -- nvmf/common.sh@471 -- # waitforlisten 2459929 00:24:24.039 05:09:03 -- common/autotest_common.sh@817 -- # '[' -z 2459929 ']' 00:24:24.039 05:09:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:24.039 05:09:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:24.039 05:09:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:24.039 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:24.039 05:09:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:24.039 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.039 [2024-04-23 05:09:03.116698] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:24.039 [2024-04-23 05:09:03.116805] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:24.039 EAL: No free 2048 kB hugepages reported on node 1 00:24:24.039 [2024-04-23 05:09:03.154910] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:24.039 [2024-04-23 05:09:03.181444] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:24.297 [2024-04-23 05:09:03.270369] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:24.297 [2024-04-23 05:09:03.270426] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:24.297 [2024-04-23 05:09:03.270440] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:24.297 [2024-04-23 05:09:03.270451] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:24.297 [2024-04-23 05:09:03.270461] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:24.297 [2024-04-23 05:09:03.270553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:24.297 [2024-04-23 05:09:03.270618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:24.298 [2024-04-23 05:09:03.270667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:24.298 [2024-04-23 05:09:03.270671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:24.298 05:09:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:24.298 05:09:03 -- common/autotest_common.sh@850 -- # return 0 00:24:24.298 05:09:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:24.298 05:09:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:24.298 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.298 05:09:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:24.298 05:09:03 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:24.298 05:09:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:24.298 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.298 [2024-04-23 05:09:03.421299] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:24.298 05:09:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:24.298 05:09:03 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:24.298 05:09:03 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:24.298 05:09:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:24.298 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.298 05:09:03 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:24.298 05:09:03 -- target/shutdown.sh@28 -- # cat 00:24:24.298 05:09:03 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:24.298 05:09:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:24.298 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.556 Malloc1 00:24:24.556 [2024-04-23 05:09:03.500393] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:24.556 Malloc2 00:24:24.556 Malloc3 00:24:24.556 Malloc4 00:24:24.556 Malloc5 00:24:24.556 Malloc6 00:24:24.814 Malloc7 00:24:24.814 Malloc8 00:24:24.814 Malloc9 00:24:24.814 Malloc10 00:24:24.814 05:09:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:24.814 05:09:03 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:24.814 05:09:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:24.814 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.814 05:09:03 -- target/shutdown.sh@78 -- # perfpid=2460108 00:24:24.814 05:09:03 -- target/shutdown.sh@79 -- # waitforlisten 2460108 /var/tmp/bdevperf.sock 00:24:24.814 05:09:03 -- common/autotest_common.sh@817 -- # '[' -z 2460108 ']' 00:24:24.814 05:09:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:24.815 05:09:03 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:24.815 05:09:03 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:24.815 05:09:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:24.815 05:09:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:24.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:24.815 05:09:03 -- nvmf/common.sh@521 -- # config=() 00:24:24.815 05:09:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:24.815 05:09:03 -- nvmf/common.sh@521 -- # local subsystem config 00:24:24.815 05:09:03 -- common/autotest_common.sh@10 -- # set +x 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:24.815 05:09:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:24.815 { 00:24:24.815 "params": { 00:24:24.815 "name": "Nvme$subsystem", 00:24:24.815 "trtype": "$TEST_TRANSPORT", 00:24:24.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.815 "adrfam": "ipv4", 00:24:24.815 "trsvcid": "$NVMF_PORT", 00:24:24.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.815 "hdgst": ${hdgst:-false}, 00:24:24.815 "ddgst": ${ddgst:-false} 00:24:24.815 }, 00:24:24.815 "method": "bdev_nvme_attach_controller" 00:24:24.815 } 00:24:24.815 EOF 00:24:24.815 )") 00:24:24.815 05:09:03 -- nvmf/common.sh@543 -- # cat 00:24:25.074 05:09:03 -- nvmf/common.sh@545 -- # jq . 00:24:25.074 05:09:03 -- nvmf/common.sh@546 -- # IFS=, 00:24:25.074 05:09:03 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme1", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme2", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme3", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme4", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme5", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme6", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme7", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme8", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme9", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 },{ 00:24:25.074 "params": { 00:24:25.074 "name": "Nvme10", 00:24:25.074 "trtype": "tcp", 00:24:25.074 "traddr": "10.0.0.2", 00:24:25.074 "adrfam": "ipv4", 00:24:25.074 "trsvcid": "4420", 00:24:25.074 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:25.074 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:25.074 "hdgst": false, 00:24:25.074 "ddgst": false 00:24:25.074 }, 00:24:25.074 "method": "bdev_nvme_attach_controller" 00:24:25.074 }' 00:24:25.074 [2024-04-23 05:09:03.989354] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:25.074 [2024-04-23 05:09:03.989424] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:25.074 EAL: No free 2048 kB hugepages reported on node 1 00:24:25.074 [2024-04-23 05:09:04.026974] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:25.074 [2024-04-23 05:09:04.056024] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:25.074 [2024-04-23 05:09:04.140334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:26.975 05:09:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:26.975 05:09:05 -- common/autotest_common.sh@850 -- # return 0 00:24:26.975 05:09:05 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:26.975 05:09:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:26.975 05:09:05 -- common/autotest_common.sh@10 -- # set +x 00:24:26.975 05:09:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:26.975 05:09:05 -- target/shutdown.sh@83 -- # kill -9 2460108 00:24:26.975 05:09:05 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:26.975 05:09:05 -- target/shutdown.sh@87 -- # sleep 1 00:24:27.910 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2460108 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:27.910 05:09:06 -- target/shutdown.sh@88 -- # kill -0 2459929 00:24:27.910 05:09:06 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:27.910 05:09:06 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:27.910 05:09:06 -- nvmf/common.sh@521 -- # config=() 00:24:27.910 05:09:06 -- nvmf/common.sh@521 -- # local subsystem config 00:24:27.910 05:09:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:07 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:07 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:07 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.910 "name": "Nvme$subsystem", 00:24:27.910 "trtype": "$TEST_TRANSPORT", 00:24:27.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.910 "adrfam": "ipv4", 00:24:27.910 "trsvcid": "$NVMF_PORT", 00:24:27.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.910 "hdgst": ${hdgst:-false}, 00:24:27.910 "ddgst": ${ddgst:-false} 00:24:27.910 }, 00:24:27.910 "method": "bdev_nvme_attach_controller" 00:24:27.910 } 00:24:27.910 EOF 00:24:27.910 )") 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # cat 00:24:27.910 05:09:07 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.910 05:09:07 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.910 { 00:24:27.910 "params": { 00:24:27.911 "name": "Nvme$subsystem", 00:24:27.911 "trtype": "$TEST_TRANSPORT", 00:24:27.911 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "$NVMF_PORT", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.911 "hdgst": ${hdgst:-false}, 00:24:27.911 "ddgst": ${ddgst:-false} 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 } 00:24:27.911 EOF 00:24:27.911 )") 00:24:27.911 05:09:07 -- nvmf/common.sh@543 -- # cat 00:24:27.911 05:09:07 -- nvmf/common.sh@545 -- # jq . 00:24:27.911 05:09:07 -- nvmf/common.sh@546 -- # IFS=, 00:24:27.911 05:09:07 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme1", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme2", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme3", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme4", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme5", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme6", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme7", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme8", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme9", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 },{ 00:24:27.911 "params": { 00:24:27.911 "name": "Nvme10", 00:24:27.911 "trtype": "tcp", 00:24:27.911 "traddr": "10.0.0.2", 00:24:27.911 "adrfam": "ipv4", 00:24:27.911 "trsvcid": "4420", 00:24:27.911 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:27.911 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:27.911 "hdgst": false, 00:24:27.911 "ddgst": false 00:24:27.911 }, 00:24:27.911 "method": "bdev_nvme_attach_controller" 00:24:27.911 }' 00:24:27.911 [2024-04-23 05:09:07.025554] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:27.911 [2024-04-23 05:09:07.025638] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2460522 ] 00:24:27.911 EAL: No free 2048 kB hugepages reported on node 1 00:24:27.911 [2024-04-23 05:09:07.062483] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:28.169 [2024-04-23 05:09:07.092279] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:28.169 [2024-04-23 05:09:07.177589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:29.550 Running I/O for 1 seconds... 00:24:30.927 00:24:30.927 Latency(us) 00:24:30.927 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:30.927 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme1n1 : 1.16 220.84 13.80 0.00 0.00 287089.59 22136.60 273406.48 00:24:30.927 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme2n1 : 1.16 221.45 13.84 0.00 0.00 281680.02 21262.79 250104.79 00:24:30.927 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme3n1 : 1.12 232.06 14.50 0.00 0.00 263120.13 6116.69 267192.70 00:24:30.927 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme4n1 : 1.15 222.93 13.93 0.00 0.00 270604.33 17864.63 274959.93 00:24:30.927 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme5n1 : 1.17 223.16 13.95 0.00 0.00 265417.35 4660.34 267192.70 00:24:30.927 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme6n1 : 1.18 216.18 13.51 0.00 0.00 269807.31 18350.08 285834.05 00:24:30.927 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme7n1 : 1.17 218.81 13.68 0.00 0.00 262411.76 30292.20 268746.15 00:24:30.927 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme8n1 : 1.17 218.25 13.64 0.00 0.00 258727.82 17767.54 270299.59 00:24:30.927 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme9n1 : 1.18 220.19 13.76 0.00 0.00 252050.55 1298.58 278066.82 00:24:30.927 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:30.927 Verification LBA range: start 0x0 length 0x400 00:24:30.927 Nvme10n1 : 1.19 215.20 13.45 0.00 0.00 254054.97 21262.79 304475.40 00:24:30.927 =================================================================================================================== 00:24:30.927 Total : 2209.07 138.07 0.00 0.00 266466.99 1298.58 304475.40 00:24:30.927 05:09:09 -- target/shutdown.sh@94 -- # stoptarget 00:24:30.927 05:09:09 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:30.927 05:09:09 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:30.927 05:09:09 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:30.927 05:09:09 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:30.927 05:09:09 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:30.927 05:09:09 -- nvmf/common.sh@117 -- # sync 00:24:30.927 05:09:09 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:24:30.927 05:09:09 -- nvmf/common.sh@120 -- # set +e 00:24:30.927 05:09:09 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:30.927 05:09:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:24:30.927 rmmod nvme_tcp 00:24:30.927 rmmod nvme_fabrics 00:24:30.927 rmmod nvme_keyring 00:24:30.927 05:09:09 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:30.927 05:09:09 -- nvmf/common.sh@124 -- # set -e 00:24:30.927 05:09:09 -- nvmf/common.sh@125 -- # return 0 00:24:30.927 05:09:09 -- nvmf/common.sh@478 -- # '[' -n 2459929 ']' 00:24:30.927 05:09:09 -- nvmf/common.sh@479 -- # killprocess 2459929 00:24:30.927 05:09:09 -- common/autotest_common.sh@936 -- # '[' -z 2459929 ']' 00:24:30.927 05:09:09 -- common/autotest_common.sh@940 -- # kill -0 2459929 00:24:30.927 05:09:09 -- common/autotest_common.sh@941 -- # uname 00:24:30.927 05:09:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:30.927 05:09:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2459929 00:24:30.927 05:09:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:30.927 05:09:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:30.927 05:09:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2459929' 00:24:30.927 killing process with pid 2459929 00:24:30.927 05:09:09 -- common/autotest_common.sh@955 -- # kill 2459929 00:24:30.927 05:09:09 -- common/autotest_common.sh@960 -- # wait 2459929 00:24:31.495 05:09:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:31.495 05:09:10 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:24:31.495 05:09:10 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:24:31.495 05:09:10 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:31.495 05:09:10 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:24:31.495 05:09:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:31.495 05:09:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:31.495 05:09:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:33.400 05:09:12 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:24:33.400 00:24:33.400 real 0m11.597s 00:24:33.400 user 0m33.435s 00:24:33.400 sys 0m3.109s 00:24:33.401 05:09:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:33.401 05:09:12 -- common/autotest_common.sh@10 -- # set +x 00:24:33.401 ************************************ 00:24:33.401 END TEST nvmf_shutdown_tc1 00:24:33.401 ************************************ 00:24:33.659 05:09:12 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:24:33.659 05:09:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:33.659 05:09:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:33.659 05:09:12 -- common/autotest_common.sh@10 -- # set +x 00:24:33.659 ************************************ 00:24:33.659 START TEST nvmf_shutdown_tc2 00:24:33.659 ************************************ 00:24:33.659 05:09:12 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:24:33.659 05:09:12 -- target/shutdown.sh@99 -- # starttarget 00:24:33.659 05:09:12 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:33.659 05:09:12 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:24:33.659 05:09:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:33.659 05:09:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:33.659 05:09:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:33.659 05:09:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:33.659 05:09:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:33.659 05:09:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:33.659 05:09:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:33.659 05:09:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:33.659 05:09:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:33.659 05:09:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:33.659 05:09:12 -- common/autotest_common.sh@10 -- # set +x 00:24:33.659 05:09:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:33.659 05:09:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:33.659 05:09:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:33.659 05:09:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:33.659 05:09:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:33.660 05:09:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:33.660 05:09:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:33.660 05:09:12 -- nvmf/common.sh@295 -- # net_devs=() 00:24:33.660 05:09:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:33.660 05:09:12 -- nvmf/common.sh@296 -- # e810=() 00:24:33.660 05:09:12 -- nvmf/common.sh@296 -- # local -ga e810 00:24:33.660 05:09:12 -- nvmf/common.sh@297 -- # x722=() 00:24:33.660 05:09:12 -- nvmf/common.sh@297 -- # local -ga x722 00:24:33.660 05:09:12 -- nvmf/common.sh@298 -- # mlx=() 00:24:33.660 05:09:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:33.660 05:09:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:33.660 05:09:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:33.660 05:09:12 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:33.660 05:09:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:33.660 05:09:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:33.660 05:09:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:33.660 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:33.660 05:09:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:33.660 05:09:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:33.660 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:33.660 05:09:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:33.660 05:09:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:33.660 05:09:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:33.660 05:09:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:33.660 05:09:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:33.660 05:09:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:33.660 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:33.660 05:09:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:33.660 05:09:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:33.660 05:09:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:33.660 05:09:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:33.660 05:09:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:33.660 05:09:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:33.660 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:33.660 05:09:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:33.660 05:09:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:33.660 05:09:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:33.660 05:09:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:24:33.660 05:09:12 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:33.660 05:09:12 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:33.660 05:09:12 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:33.660 05:09:12 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:24:33.660 05:09:12 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:33.660 05:09:12 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:33.660 05:09:12 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:24:33.660 05:09:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:33.660 05:09:12 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:33.660 05:09:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:24:33.660 05:09:12 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:24:33.660 05:09:12 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:24:33.660 05:09:12 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:33.660 05:09:12 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:33.660 05:09:12 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:33.660 05:09:12 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:24:33.660 05:09:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:33.660 05:09:12 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:33.660 05:09:12 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:33.660 05:09:12 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:24:33.660 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:33.660 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:24:33.660 00:24:33.660 --- 10.0.0.2 ping statistics --- 00:24:33.660 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:33.660 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:24:33.660 05:09:12 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:33.660 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:33.660 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:24:33.660 00:24:33.660 --- 10.0.0.1 ping statistics --- 00:24:33.660 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:33.660 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:24:33.660 05:09:12 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:33.660 05:09:12 -- nvmf/common.sh@411 -- # return 0 00:24:33.660 05:09:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:33.660 05:09:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:33.660 05:09:12 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:24:33.660 05:09:12 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:33.660 05:09:12 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:24:33.660 05:09:12 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:24:33.660 05:09:12 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:33.660 05:09:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:33.660 05:09:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:33.660 05:09:12 -- common/autotest_common.sh@10 -- # set +x 00:24:33.660 05:09:12 -- nvmf/common.sh@470 -- # nvmfpid=2461806 00:24:33.660 05:09:12 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:33.660 05:09:12 -- nvmf/common.sh@471 -- # waitforlisten 2461806 00:24:33.660 05:09:12 -- common/autotest_common.sh@817 -- # '[' -z 2461806 ']' 00:24:33.660 05:09:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:33.660 05:09:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:33.660 05:09:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:33.660 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:33.660 05:09:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:33.660 05:09:12 -- common/autotest_common.sh@10 -- # set +x 00:24:33.918 [2024-04-23 05:09:12.865467] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:33.918 [2024-04-23 05:09:12.865568] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:33.919 EAL: No free 2048 kB hugepages reported on node 1 00:24:33.919 [2024-04-23 05:09:12.903408] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:33.919 [2024-04-23 05:09:12.929929] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:33.919 [2024-04-23 05:09:13.014125] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:33.919 [2024-04-23 05:09:13.014183] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:33.919 [2024-04-23 05:09:13.014211] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:33.919 [2024-04-23 05:09:13.014223] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:33.919 [2024-04-23 05:09:13.014233] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:33.919 [2024-04-23 05:09:13.014327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:33.919 [2024-04-23 05:09:13.014369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:33.919 [2024-04-23 05:09:13.014427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:33.919 [2024-04-23 05:09:13.014429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:34.177 05:09:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:34.177 05:09:13 -- common/autotest_common.sh@850 -- # return 0 00:24:34.177 05:09:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:34.177 05:09:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:34.177 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:24:34.177 05:09:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:34.177 05:09:13 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:34.177 05:09:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:34.177 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:24:34.177 [2024-04-23 05:09:13.157119] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:34.177 05:09:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:34.177 05:09:13 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:34.177 05:09:13 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:34.177 05:09:13 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:34.177 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:24:34.177 05:09:13 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:34.177 05:09:13 -- target/shutdown.sh@28 -- # cat 00:24:34.177 05:09:13 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:34.177 05:09:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:34.177 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:24:34.177 Malloc1 00:24:34.177 [2024-04-23 05:09:13.232147] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:34.177 Malloc2 00:24:34.177 Malloc3 00:24:34.437 Malloc4 00:24:34.437 Malloc5 00:24:34.437 Malloc6 00:24:34.437 Malloc7 00:24:34.437 Malloc8 00:24:34.437 Malloc9 00:24:34.697 Malloc10 00:24:34.697 05:09:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:34.697 05:09:13 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:34.697 05:09:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:34.697 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:24:34.697 05:09:13 -- target/shutdown.sh@103 -- # perfpid=2461979 00:24:34.697 05:09:13 -- target/shutdown.sh@104 -- # waitforlisten 2461979 /var/tmp/bdevperf.sock 00:24:34.697 05:09:13 -- common/autotest_common.sh@817 -- # '[' -z 2461979 ']' 00:24:34.697 05:09:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:34.697 05:09:13 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:34.697 05:09:13 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:34.697 05:09:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:34.697 05:09:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:34.697 05:09:13 -- nvmf/common.sh@521 -- # config=() 00:24:34.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:34.697 05:09:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:34.697 05:09:13 -- nvmf/common.sh@521 -- # local subsystem config 00:24:34.697 05:09:13 -- common/autotest_common.sh@10 -- # set +x 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.697 "trtype": "$TEST_TRANSPORT", 00:24:34.697 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.697 "adrfam": "ipv4", 00:24:34.697 "trsvcid": "$NVMF_PORT", 00:24:34.697 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.697 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.697 "hdgst": ${hdgst:-false}, 00:24:34.697 "ddgst": ${ddgst:-false} 00:24:34.697 }, 00:24:34.697 "method": "bdev_nvme_attach_controller" 00:24:34.697 } 00:24:34.697 EOF 00:24:34.697 )") 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.697 05:09:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:34.697 05:09:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:34.697 { 00:24:34.697 "params": { 00:24:34.697 "name": "Nvme$subsystem", 00:24:34.698 "trtype": "$TEST_TRANSPORT", 00:24:34.698 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "$NVMF_PORT", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:34.698 "hdgst": ${hdgst:-false}, 00:24:34.698 "ddgst": ${ddgst:-false} 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 } 00:24:34.698 EOF 00:24:34.698 )") 00:24:34.698 05:09:13 -- nvmf/common.sh@543 -- # cat 00:24:34.698 05:09:13 -- nvmf/common.sh@545 -- # jq . 00:24:34.698 05:09:13 -- nvmf/common.sh@546 -- # IFS=, 00:24:34.698 05:09:13 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme1", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme2", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme3", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme4", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme5", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme6", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme7", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme8", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme9", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 },{ 00:24:34.698 "params": { 00:24:34.698 "name": "Nvme10", 00:24:34.698 "trtype": "tcp", 00:24:34.698 "traddr": "10.0.0.2", 00:24:34.698 "adrfam": "ipv4", 00:24:34.698 "trsvcid": "4420", 00:24:34.698 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:34.698 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:34.698 "hdgst": false, 00:24:34.698 "ddgst": false 00:24:34.698 }, 00:24:34.698 "method": "bdev_nvme_attach_controller" 00:24:34.698 }' 00:24:34.698 [2024-04-23 05:09:13.740735] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:34.698 [2024-04-23 05:09:13.740825] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2461979 ] 00:24:34.698 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.698 [2024-04-23 05:09:13.774891] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:34.698 [2024-04-23 05:09:13.803568] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:34.958 [2024-04-23 05:09:13.888236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:36.886 Running I/O for 10 seconds... 00:24:36.886 05:09:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:36.886 05:09:15 -- common/autotest_common.sh@850 -- # return 0 00:24:36.886 05:09:15 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:36.886 05:09:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.886 05:09:15 -- common/autotest_common.sh@10 -- # set +x 00:24:36.886 05:09:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.886 05:09:15 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:36.886 05:09:15 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:36.886 05:09:15 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:36.886 05:09:15 -- target/shutdown.sh@57 -- # local ret=1 00:24:36.886 05:09:15 -- target/shutdown.sh@58 -- # local i 00:24:36.886 05:09:15 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:36.886 05:09:15 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:36.886 05:09:15 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:36.887 05:09:15 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:36.887 05:09:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.887 05:09:15 -- common/autotest_common.sh@10 -- # set +x 00:24:36.887 05:09:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.887 05:09:15 -- target/shutdown.sh@60 -- # read_io_count=3 00:24:36.887 05:09:15 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:24:36.887 05:09:15 -- target/shutdown.sh@67 -- # sleep 0.25 00:24:37.145 05:09:16 -- target/shutdown.sh@59 -- # (( i-- )) 00:24:37.145 05:09:16 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:37.145 05:09:16 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:37.145 05:09:16 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:37.145 05:09:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:37.145 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:24:37.145 05:09:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:37.145 05:09:16 -- target/shutdown.sh@60 -- # read_io_count=67 00:24:37.145 05:09:16 -- target/shutdown.sh@63 -- # '[' 67 -ge 100 ']' 00:24:37.145 05:09:16 -- target/shutdown.sh@67 -- # sleep 0.25 00:24:37.433 05:09:16 -- target/shutdown.sh@59 -- # (( i-- )) 00:24:37.433 05:09:16 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:37.433 05:09:16 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:37.433 05:09:16 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:37.433 05:09:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:37.433 05:09:16 -- common/autotest_common.sh@10 -- # set +x 00:24:37.433 05:09:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:37.433 05:09:16 -- target/shutdown.sh@60 -- # read_io_count=131 00:24:37.433 05:09:16 -- target/shutdown.sh@63 -- # '[' 131 -ge 100 ']' 00:24:37.433 05:09:16 -- target/shutdown.sh@64 -- # ret=0 00:24:37.433 05:09:16 -- target/shutdown.sh@65 -- # break 00:24:37.433 05:09:16 -- target/shutdown.sh@69 -- # return 0 00:24:37.433 05:09:16 -- target/shutdown.sh@110 -- # killprocess 2461979 00:24:37.433 05:09:16 -- common/autotest_common.sh@936 -- # '[' -z 2461979 ']' 00:24:37.433 05:09:16 -- common/autotest_common.sh@940 -- # kill -0 2461979 00:24:37.433 05:09:16 -- common/autotest_common.sh@941 -- # uname 00:24:37.433 05:09:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:37.433 05:09:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2461979 00:24:37.433 05:09:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:37.433 05:09:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:37.433 05:09:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2461979' 00:24:37.433 killing process with pid 2461979 00:24:37.433 05:09:16 -- common/autotest_common.sh@955 -- # kill 2461979 00:24:37.433 05:09:16 -- common/autotest_common.sh@960 -- # wait 2461979 00:24:37.433 Received shutdown signal, test time was about 0.931842 seconds 00:24:37.433 00:24:37.433 Latency(us) 00:24:37.433 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:37.433 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme1n1 : 0.91 212.04 13.25 0.00 0.00 298264.40 19418.07 257872.02 00:24:37.433 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme2n1 : 0.91 241.35 15.08 0.00 0.00 250925.19 5922.51 254765.13 00:24:37.433 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme3n1 : 0.92 277.54 17.35 0.00 0.00 218413.70 17864.63 243891.01 00:24:37.433 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme4n1 : 0.93 282.57 17.66 0.00 0.00 208705.20 7621.59 226803.11 00:24:37.433 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme5n1 : 0.93 274.97 17.19 0.00 0.00 210715.12 15243.19 253211.69 00:24:37.433 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme6n1 : 0.92 209.43 13.09 0.00 0.00 270560.52 22330.79 254765.13 00:24:37.433 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme7n1 : 0.89 221.60 13.85 0.00 0.00 248176.82 2548.62 234570.33 00:24:37.433 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme8n1 : 0.90 213.15 13.32 0.00 0.00 253923.18 20486.07 259425.47 00:24:37.433 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme9n1 : 0.92 209.73 13.11 0.00 0.00 252928.51 21068.61 253211.69 00:24:37.433 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.433 Verification LBA range: start 0x0 length 0x400 00:24:37.433 Nvme10n1 : 0.93 207.30 12.96 0.00 0.00 250460.79 22816.24 287387.50 00:24:37.433 =================================================================================================================== 00:24:37.433 Total : 2349.67 146.85 0.00 0.00 243255.61 2548.62 287387.50 00:24:37.697 05:09:16 -- target/shutdown.sh@113 -- # sleep 1 00:24:38.635 05:09:17 -- target/shutdown.sh@114 -- # kill -0 2461806 00:24:38.635 05:09:17 -- target/shutdown.sh@116 -- # stoptarget 00:24:38.635 05:09:17 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:38.635 05:09:17 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:38.635 05:09:17 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:38.635 05:09:17 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:38.635 05:09:17 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:38.635 05:09:17 -- nvmf/common.sh@117 -- # sync 00:24:38.635 05:09:17 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:24:38.635 05:09:17 -- nvmf/common.sh@120 -- # set +e 00:24:38.635 05:09:17 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:38.635 05:09:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:24:38.635 rmmod nvme_tcp 00:24:38.635 rmmod nvme_fabrics 00:24:38.635 rmmod nvme_keyring 00:24:38.635 05:09:17 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:38.635 05:09:17 -- nvmf/common.sh@124 -- # set -e 00:24:38.635 05:09:17 -- nvmf/common.sh@125 -- # return 0 00:24:38.635 05:09:17 -- nvmf/common.sh@478 -- # '[' -n 2461806 ']' 00:24:38.635 05:09:17 -- nvmf/common.sh@479 -- # killprocess 2461806 00:24:38.635 05:09:17 -- common/autotest_common.sh@936 -- # '[' -z 2461806 ']' 00:24:38.635 05:09:17 -- common/autotest_common.sh@940 -- # kill -0 2461806 00:24:38.635 05:09:17 -- common/autotest_common.sh@941 -- # uname 00:24:38.635 05:09:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:38.635 05:09:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2461806 00:24:38.893 05:09:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:38.893 05:09:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:38.893 05:09:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2461806' 00:24:38.893 killing process with pid 2461806 00:24:38.893 05:09:17 -- common/autotest_common.sh@955 -- # kill 2461806 00:24:38.893 05:09:17 -- common/autotest_common.sh@960 -- # wait 2461806 00:24:39.151 05:09:18 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:39.151 05:09:18 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:24:39.151 05:09:18 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:24:39.151 05:09:18 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:39.151 05:09:18 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:24:39.151 05:09:18 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:39.151 05:09:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:39.151 05:09:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:41.690 05:09:20 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:24:41.690 00:24:41.690 real 0m7.639s 00:24:41.690 user 0m23.339s 00:24:41.690 sys 0m1.446s 00:24:41.690 05:09:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:41.690 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.690 ************************************ 00:24:41.690 END TEST nvmf_shutdown_tc2 00:24:41.690 ************************************ 00:24:41.690 05:09:20 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:24:41.690 05:09:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:41.690 05:09:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:41.690 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.690 ************************************ 00:24:41.690 START TEST nvmf_shutdown_tc3 00:24:41.690 ************************************ 00:24:41.690 05:09:20 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:24:41.690 05:09:20 -- target/shutdown.sh@121 -- # starttarget 00:24:41.690 05:09:20 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:41.690 05:09:20 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:24:41.690 05:09:20 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:41.690 05:09:20 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:41.690 05:09:20 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:41.690 05:09:20 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:41.690 05:09:20 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:41.690 05:09:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:41.690 05:09:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:41.690 05:09:20 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:41.690 05:09:20 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:41.690 05:09:20 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:41.690 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.690 05:09:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:41.690 05:09:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:41.690 05:09:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:41.690 05:09:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:41.690 05:09:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:41.690 05:09:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:41.690 05:09:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:41.690 05:09:20 -- nvmf/common.sh@295 -- # net_devs=() 00:24:41.690 05:09:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:41.690 05:09:20 -- nvmf/common.sh@296 -- # e810=() 00:24:41.690 05:09:20 -- nvmf/common.sh@296 -- # local -ga e810 00:24:41.690 05:09:20 -- nvmf/common.sh@297 -- # x722=() 00:24:41.690 05:09:20 -- nvmf/common.sh@297 -- # local -ga x722 00:24:41.690 05:09:20 -- nvmf/common.sh@298 -- # mlx=() 00:24:41.691 05:09:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:41.691 05:09:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:41.691 05:09:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:41.691 05:09:20 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:41.691 05:09:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:41.691 05:09:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:41.691 05:09:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:41.691 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:41.691 05:09:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:41.691 05:09:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:41.691 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:41.691 05:09:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:41.691 05:09:20 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:41.691 05:09:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.691 05:09:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:41.691 05:09:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.691 05:09:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:41.691 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:41.691 05:09:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.691 05:09:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:41.691 05:09:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.691 05:09:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:41.691 05:09:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.691 05:09:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:41.691 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:41.691 05:09:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.691 05:09:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:41.691 05:09:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:41.691 05:09:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:24:41.691 05:09:20 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:41.691 05:09:20 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:41.691 05:09:20 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:41.691 05:09:20 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:24:41.691 05:09:20 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:41.691 05:09:20 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:41.691 05:09:20 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:24:41.691 05:09:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:41.691 05:09:20 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:41.691 05:09:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:24:41.691 05:09:20 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:24:41.691 05:09:20 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:24:41.691 05:09:20 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:41.691 05:09:20 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:41.691 05:09:20 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:41.691 05:09:20 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:24:41.691 05:09:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:41.691 05:09:20 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:41.691 05:09:20 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:41.691 05:09:20 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:24:41.691 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:41.691 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.133 ms 00:24:41.691 00:24:41.691 --- 10.0.0.2 ping statistics --- 00:24:41.691 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:41.691 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:24:41.691 05:09:20 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:41.691 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:41.691 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:24:41.691 00:24:41.691 --- 10.0.0.1 ping statistics --- 00:24:41.691 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:41.691 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:24:41.691 05:09:20 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:41.691 05:09:20 -- nvmf/common.sh@411 -- # return 0 00:24:41.691 05:09:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:41.691 05:09:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:41.691 05:09:20 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:24:41.691 05:09:20 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:41.691 05:09:20 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:24:41.691 05:09:20 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:24:41.691 05:09:20 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:41.691 05:09:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:41.691 05:09:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:41.691 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.691 05:09:20 -- nvmf/common.sh@470 -- # nvmfpid=2462901 00:24:41.691 05:09:20 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:41.691 05:09:20 -- nvmf/common.sh@471 -- # waitforlisten 2462901 00:24:41.691 05:09:20 -- common/autotest_common.sh@817 -- # '[' -z 2462901 ']' 00:24:41.691 05:09:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:41.692 05:09:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:41.692 05:09:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:41.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:41.692 05:09:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:41.692 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.692 [2024-04-23 05:09:20.653613] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:41.692 [2024-04-23 05:09:20.653683] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:41.692 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.692 [2024-04-23 05:09:20.693418] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:41.692 [2024-04-23 05:09:20.726627] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:41.692 [2024-04-23 05:09:20.816647] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:41.692 [2024-04-23 05:09:20.816715] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:41.692 [2024-04-23 05:09:20.816742] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:41.692 [2024-04-23 05:09:20.816755] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:41.692 [2024-04-23 05:09:20.816767] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:41.692 [2024-04-23 05:09:20.816868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:41.692 [2024-04-23 05:09:20.816984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:41.692 [2024-04-23 05:09:20.817053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:41.692 [2024-04-23 05:09:20.817050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:41.953 05:09:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:41.953 05:09:20 -- common/autotest_common.sh@850 -- # return 0 00:24:41.953 05:09:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:41.953 05:09:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:41.953 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.953 05:09:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:41.953 05:09:20 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:41.953 05:09:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:41.953 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.953 [2024-04-23 05:09:20.977314] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:41.953 05:09:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:41.953 05:09:20 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:41.953 05:09:20 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:41.953 05:09:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:41.953 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.953 05:09:20 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:41.953 05:09:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:20 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:20 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:20 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:21 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:21 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:21 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:21 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:21 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:21 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.953 05:09:21 -- target/shutdown.sh@28 -- # cat 00:24:41.953 05:09:21 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:41.953 05:09:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:41.953 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:24:41.953 Malloc1 00:24:41.953 [2024-04-23 05:09:21.066534] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:41.953 Malloc2 00:24:42.211 Malloc3 00:24:42.211 Malloc4 00:24:42.211 Malloc5 00:24:42.211 Malloc6 00:24:42.211 Malloc7 00:24:42.470 Malloc8 00:24:42.470 Malloc9 00:24:42.470 Malloc10 00:24:42.470 05:09:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:42.470 05:09:21 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:42.470 05:09:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:42.470 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:24:42.470 05:09:21 -- target/shutdown.sh@125 -- # perfpid=2463080 00:24:42.470 05:09:21 -- target/shutdown.sh@126 -- # waitforlisten 2463080 /var/tmp/bdevperf.sock 00:24:42.470 05:09:21 -- common/autotest_common.sh@817 -- # '[' -z 2463080 ']' 00:24:42.470 05:09:21 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:42.471 05:09:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:42.471 05:09:21 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:42.471 05:09:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:42.471 05:09:21 -- nvmf/common.sh@521 -- # config=() 00:24:42.471 05:09:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:42.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:42.471 05:09:21 -- nvmf/common.sh@521 -- # local subsystem config 00:24:42.471 05:09:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:42.471 { 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme$subsystem", 00:24:42.471 "trtype": "$TEST_TRANSPORT", 00:24:42.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "$NVMF_PORT", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.471 "hdgst": ${hdgst:-false}, 00:24:42.471 "ddgst": ${ddgst:-false} 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 } 00:24:42.471 EOF 00:24:42.471 )") 00:24:42.471 05:09:21 -- nvmf/common.sh@543 -- # cat 00:24:42.471 05:09:21 -- nvmf/common.sh@545 -- # jq . 00:24:42.471 05:09:21 -- nvmf/common.sh@546 -- # IFS=, 00:24:42.471 05:09:21 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme1", 00:24:42.471 "trtype": "tcp", 00:24:42.471 "traddr": "10.0.0.2", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "4420", 00:24:42.471 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:42.471 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:42.471 "hdgst": false, 00:24:42.471 "ddgst": false 00:24:42.471 }, 00:24:42.471 "method": "bdev_nvme_attach_controller" 00:24:42.471 },{ 00:24:42.471 "params": { 00:24:42.471 "name": "Nvme2", 00:24:42.471 "trtype": "tcp", 00:24:42.471 "traddr": "10.0.0.2", 00:24:42.471 "adrfam": "ipv4", 00:24:42.471 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme3", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme4", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme5", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme6", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme7", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme8", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme9", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 },{ 00:24:42.472 "params": { 00:24:42.472 "name": "Nvme10", 00:24:42.472 "trtype": "tcp", 00:24:42.472 "traddr": "10.0.0.2", 00:24:42.472 "adrfam": "ipv4", 00:24:42.472 "trsvcid": "4420", 00:24:42.472 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:42.472 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:42.472 "hdgst": false, 00:24:42.472 "ddgst": false 00:24:42.472 }, 00:24:42.472 "method": "bdev_nvme_attach_controller" 00:24:42.472 }' 00:24:42.472 [2024-04-23 05:09:21.584917] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:42.472 [2024-04-23 05:09:21.585001] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2463080 ] 00:24:42.472 EAL: No free 2048 kB hugepages reported on node 1 00:24:42.472 [2024-04-23 05:09:21.619043] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:42.730 [2024-04-23 05:09:21.648804] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:42.730 [2024-04-23 05:09:21.733709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:44.632 Running I/O for 10 seconds... 00:24:44.632 05:09:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:44.632 05:09:23 -- common/autotest_common.sh@850 -- # return 0 00:24:44.632 05:09:23 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:44.632 05:09:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:44.632 05:09:23 -- common/autotest_common.sh@10 -- # set +x 00:24:44.632 05:09:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:44.632 05:09:23 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:44.632 05:09:23 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:44.632 05:09:23 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:44.632 05:09:23 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:44.632 05:09:23 -- target/shutdown.sh@57 -- # local ret=1 00:24:44.632 05:09:23 -- target/shutdown.sh@58 -- # local i 00:24:44.632 05:09:23 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:44.632 05:09:23 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:44.632 05:09:23 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:44.632 05:09:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:44.632 05:09:23 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:44.632 05:09:23 -- common/autotest_common.sh@10 -- # set +x 00:24:44.632 05:09:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:44.632 05:09:23 -- target/shutdown.sh@60 -- # read_io_count=3 00:24:44.632 05:09:23 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:24:44.632 05:09:23 -- target/shutdown.sh@67 -- # sleep 0.25 00:24:44.890 05:09:23 -- target/shutdown.sh@59 -- # (( i-- )) 00:24:44.890 05:09:23 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:44.890 05:09:23 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:44.890 05:09:23 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:44.890 05:09:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:44.890 05:09:23 -- common/autotest_common.sh@10 -- # set +x 00:24:44.890 05:09:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:44.890 05:09:23 -- target/shutdown.sh@60 -- # read_io_count=67 00:24:44.890 05:09:23 -- target/shutdown.sh@63 -- # '[' 67 -ge 100 ']' 00:24:44.890 05:09:23 -- target/shutdown.sh@67 -- # sleep 0.25 00:24:45.159 05:09:24 -- target/shutdown.sh@59 -- # (( i-- )) 00:24:45.159 05:09:24 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:45.159 05:09:24 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:45.159 05:09:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:45.159 05:09:24 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:45.159 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:24:45.159 05:09:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:45.159 05:09:24 -- target/shutdown.sh@60 -- # read_io_count=131 00:24:45.159 05:09:24 -- target/shutdown.sh@63 -- # '[' 131 -ge 100 ']' 00:24:45.159 05:09:24 -- target/shutdown.sh@64 -- # ret=0 00:24:45.159 05:09:24 -- target/shutdown.sh@65 -- # break 00:24:45.159 05:09:24 -- target/shutdown.sh@69 -- # return 0 00:24:45.159 05:09:24 -- target/shutdown.sh@135 -- # killprocess 2462901 00:24:45.159 05:09:24 -- common/autotest_common.sh@936 -- # '[' -z 2462901 ']' 00:24:45.159 05:09:24 -- common/autotest_common.sh@940 -- # kill -0 2462901 00:24:45.159 05:09:24 -- common/autotest_common.sh@941 -- # uname 00:24:45.159 05:09:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:45.159 05:09:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2462901 00:24:45.160 05:09:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:45.160 05:09:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:45.160 05:09:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2462901' 00:24:45.160 killing process with pid 2462901 00:24:45.160 05:09:24 -- common/autotest_common.sh@955 -- # kill 2462901 00:24:45.160 05:09:24 -- common/autotest_common.sh@960 -- # wait 2462901 00:24:45.160 [2024-04-23 05:09:24.250344] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250493] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250510] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250535] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250549] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250563] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250586] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250599] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250612] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250625] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250638] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250651] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250665] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250678] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250691] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250715] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250728] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250742] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250755] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250768] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250781] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250794] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250807] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250819] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250842] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250854] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250867] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250879] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250897] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250910] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250923] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250935] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250948] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250961] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250974] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.250987] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251000] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251012] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251025] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251038] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251051] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251065] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251081] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251094] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251106] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251118] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251131] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251143] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251155] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251169] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251181] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251194] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251206] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251218] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251231] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251243] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251256] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251268] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251280] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251292] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251305] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251318] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.251330] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2dc90 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253574] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253607] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253622] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253635] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253647] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253660] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253679] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253693] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253706] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253718] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253731] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253743] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253756] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253768] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253782] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253811] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253824] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.160 [2024-04-23 05:09:24.253836] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253848] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253860] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253872] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253885] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253897] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253910] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253922] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253933] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253946] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253958] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253970] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253982] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.253994] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254006] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254019] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254034] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254048] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254060] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254072] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254084] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254096] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254107] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254119] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254131] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254144] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254156] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254168] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254181] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254193] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254204] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254217] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254230] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254242] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254254] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254266] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254278] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254290] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254302] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254314] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254326] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254338] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254350] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254362] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254377] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.254389] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2e120 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257752] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257781] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257796] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257810] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257832] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257846] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257860] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257874] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257888] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257902] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257915] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257928] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257941] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257954] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257967] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257980] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.257993] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258006] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258019] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258031] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258045] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258073] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258086] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258099] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258112] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258130] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258144] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258156] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258169] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258182] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258195] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258207] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258219] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258231] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258245] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258258] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258270] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258283] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258295] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.161 [2024-04-23 05:09:24.258308] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258321] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258334] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258347] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258359] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258370] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258383] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258395] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258407] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258419] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258431] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258443] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258455] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258476] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258488] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258500] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258512] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258550] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258574] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258587] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258599] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258612] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258625] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.258638] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2eed0 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259775] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259799] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259835] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259849] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259862] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259875] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259888] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259900] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259913] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259924] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259937] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259950] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259962] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259975] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.259987] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260000] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260013] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260030] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260043] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260055] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260068] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260080] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260093] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260106] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260119] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260132] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260145] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260157] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260170] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260182] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260194] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260207] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260219] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260232] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260244] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260256] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260267] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260281] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260293] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260305] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260318] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260330] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260343] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260355] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260370] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260383] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260395] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260408] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260420] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260432] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260444] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260456] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260468] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260481] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260493] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260506] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260540] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260555] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260574] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260587] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260600] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.162 [2024-04-23 05:09:24.260612] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.260624] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f380 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262051] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262084] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262098] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262112] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262126] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262138] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262151] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262163] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262182] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262195] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262207] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262220] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262232] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262245] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262258] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262271] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262284] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262296] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262308] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262321] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262334] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262362] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262375] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262387] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262400] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262411] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262423] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262435] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262447] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262459] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262472] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262484] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262496] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262508] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262544] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262559] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262576] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262589] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262602] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262615] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262628] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262640] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262653] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262665] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262678] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262690] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262703] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262716] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262728] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262741] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262753] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262766] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262778] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262790] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262802] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262821] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262848] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262861] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262873] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262884] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262896] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262908] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.262921] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2f810 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264017] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264050] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264065] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264078] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264090] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264103] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264116] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264128] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264140] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264152] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264164] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264177] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264189] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264202] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264214] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264226] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264239] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264252] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.163 [2024-04-23 05:09:24.264264] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264276] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264289] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264302] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264315] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264327] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264339] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264351] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264364] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264382] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264395] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264408] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264420] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264433] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264447] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264459] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264471] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264484] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264497] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264509] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264532] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264546] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264561] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264573] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264585] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264597] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264610] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264623] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264635] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264648] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264660] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264672] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264684] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264697] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264709] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264721] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264737] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264751] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264763] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264776] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264788] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264804] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264816] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264829] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.264841] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa2fca0 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265609] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265634] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265648] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265661] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265674] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265686] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265699] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265711] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265724] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265736] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265748] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265761] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265773] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265786] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265798] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265811] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265834] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265846] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265874] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265908] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265921] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265934] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265946] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265959] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265972] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265984] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.265996] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.164 [2024-04-23 05:09:24.266010] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266024] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266036] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266048] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266060] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266073] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266087] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266101] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266113] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266125] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266137] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266164] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266177] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266193] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266207] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266220] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266233] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266245] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266258] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266274] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266287] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266300] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266313] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266325] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266338] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266378] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266397] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266410] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266422] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266435] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266447] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266460] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266472] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266484] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266497] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266509] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa30130 is same with the state(5) to be set 00:24:45.165 [2024-04-23 05:09:24.266883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.266928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.266959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.266974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.266991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.165 [2024-04-23 05:09:24.267633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.165 [2024-04-23 05:09:24.267647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.267985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.267998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.166 [2024-04-23 05:09:24.268885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.166 [2024-04-23 05:09:24.268901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.268916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.167 [2024-04-23 05:09:24.268930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.268979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:45.167 [2024-04-23 05:09:24.269593] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xaf8ca0 was disconnected and freed. reset controller. 00:24:45.167 [2024-04-23 05:09:24.269698] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.269722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.269738] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.269752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.269766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.269784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.269799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.269820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.269833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbbe510 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.269893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.269914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.269930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.269944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.269958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.269972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.269986] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa25e70 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.270061] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270153] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb363b0 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.270219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270254] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x54eda0 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.270397] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270460] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270488] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa263c0 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.270578] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270614] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270670] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa266f0 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.270740] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270779] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270807] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270846] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbc1e00 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.270923] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.270973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.270987] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.271000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.271014] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.271028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.271040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9fa370 is same with the state(5) to be set 00:24:45.167 [2024-04-23 05:09:24.271084] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.271105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.271119] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.167 [2024-04-23 05:09:24.271133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.167 [2024-04-23 05:09:24.271147] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.168 [2024-04-23 05:09:24.271161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.271174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.168 [2024-04-23 05:09:24.271187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.271200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbae8b0 is same with the state(5) to be set 00:24:45.168 [2024-04-23 05:09:24.271243] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.168 [2024-04-23 05:09:24.271267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.271282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.168 [2024-04-23 05:09:24.271296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.271309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.168 [2024-04-23 05:09:24.271322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.271336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:45.168 [2024-04-23 05:09:24.271349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.271361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e43c0 is same with the state(5) to be set 00:24:45.168 [2024-04-23 05:09:24.272156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.272981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.272996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.273010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.273025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.168 [2024-04-23 05:09:24.273039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.168 [2024-04-23 05:09:24.273054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.273068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.273083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.285960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.286977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.286993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.287024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.287054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.287084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.287115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.287208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:45.169 [2024-04-23 05:09:24.287310] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb03850 was disconnected and freed. reset controller. 00:24:45.169 [2024-04-23 05:09:24.287431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.287483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.169 [2024-04-23 05:09:24.287526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.169 [2024-04-23 05:09:24.287551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.287976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.287991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.170 [2024-04-23 05:09:24.288785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.170 [2024-04-23 05:09:24.288799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.288825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.288843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.288859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.288873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.288889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.288903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.288920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.288934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.288949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.288963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.288979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.288993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.171 [2024-04-23 05:09:24.289451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.171 [2024-04-23 05:09:24.289466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb81d60 is same with the state(5) to be set 00:24:45.171 [2024-04-23 05:09:24.289577] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb81d60 was disconnected and freed. reset controller. 00:24:45.171 [2024-04-23 05:09:24.291269] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbbe510 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291313] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa25e70 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291339] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb363b0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291364] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x54eda0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291388] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa263c0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291419] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa266f0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291445] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbc1e00 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291473] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9fa370 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291504] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbae8b0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.291564] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5e43c0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.294238] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:24:45.171 [2024-04-23 05:09:24.294275] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:24:45.171 [2024-04-23 05:09:24.295053] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:24:45.171 [2024-04-23 05:09:24.295263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.171 [2024-04-23 05:09:24.295383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.171 [2024-04-23 05:09:24.295408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb363b0 with addr=10.0.0.2, port=4420 00:24:45.171 [2024-04-23 05:09:24.295427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb363b0 is same with the state(5) to be set 00:24:45.171 [2024-04-23 05:09:24.295537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.171 [2024-04-23 05:09:24.295660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.171 [2024-04-23 05:09:24.295684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9fa370 with addr=10.0.0.2, port=4420 00:24:45.171 [2024-04-23 05:09:24.295700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9fa370 is same with the state(5) to be set 00:24:45.171 [2024-04-23 05:09:24.296390] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:45.171 [2024-04-23 05:09:24.296463] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:45.171 [2024-04-23 05:09:24.296539] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:45.171 [2024-04-23 05:09:24.296616] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:45.171 [2024-04-23 05:09:24.296853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.171 [2024-04-23 05:09:24.296967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.171 [2024-04-23 05:09:24.296991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa266f0 with addr=10.0.0.2, port=4420 00:24:45.171 [2024-04-23 05:09:24.297008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa266f0 is same with the state(5) to be set 00:24:45.171 [2024-04-23 05:09:24.297029] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb363b0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.297051] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9fa370 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.297135] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:45.171 [2024-04-23 05:09:24.297203] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:45.171 [2024-04-23 05:09:24.297342] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:45.171 [2024-04-23 05:09:24.297387] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa266f0 (9): Bad file descriptor 00:24:45.171 [2024-04-23 05:09:24.297410] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:24:45.171 [2024-04-23 05:09:24.297425] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:24:45.171 [2024-04-23 05:09:24.297443] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:24:45.171 [2024-04-23 05:09:24.297466] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:24:45.171 [2024-04-23 05:09:24.297481] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:24:45.171 [2024-04-23 05:09:24.297504] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:24:45.171 [2024-04-23 05:09:24.297615] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.171 [2024-04-23 05:09:24.297636] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.172 [2024-04-23 05:09:24.297649] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:24:45.172 [2024-04-23 05:09:24.297662] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:24:45.172 [2024-04-23 05:09:24.297676] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:24:45.172 [2024-04-23 05:09:24.297731] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.172 [2024-04-23 05:09:24.301401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.301976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.301991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.172 [2024-04-23 05:09:24.302596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.172 [2024-04-23 05:09:24.302611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.302972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.302987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.303397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.303413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb01160 is same with the state(5) to be set 00:24:45.173 [2024-04-23 05:09:24.304716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.173 [2024-04-23 05:09:24.304958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.173 [2024-04-23 05:09:24.304978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.304993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.305970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.305986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.306000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.306016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.306030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.306046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.306060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.306076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.306090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.306106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.306124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.306140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.306154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.174 [2024-04-23 05:09:24.306170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.174 [2024-04-23 05:09:24.306184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.306674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.306689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb02460 is same with the state(5) to be set 00:24:45.175 [2024-04-23 05:09:24.307922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.307946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.307967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.307982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.307998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.175 [2024-04-23 05:09:24.308653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.175 [2024-04-23 05:09:24.308669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.308974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.308989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.176 [2024-04-23 05:09:24.309969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.176 [2024-04-23 05:09:24.309984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.309998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.310013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb83170 is same with the state(5) to be set 00:24:45.177 [2024-04-23 05:09:24.311241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.311979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.311993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.177 [2024-04-23 05:09:24.312367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.177 [2024-04-23 05:09:24.312381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.312973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.312988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.178 [2024-04-23 05:09:24.313338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.178 [2024-04-23 05:09:24.313356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9eee70 is same with the state(5) to be set 00:24:45.443 [2024-04-23 05:09:24.314649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.314964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.314989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.443 [2024-04-23 05:09:24.315929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.443 [2024-04-23 05:09:24.315945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.315959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.315978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.315993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.316809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.316824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9f0320 is same with the state(5) to be set 00:24:45.444 [2024-04-23 05:09:24.318068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.444 [2024-04-23 05:09:24.318466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.444 [2024-04-23 05:09:24.318482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.318975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.318991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.319370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.319386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.445 [2024-04-23 05:09:24.326807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.445 [2024-04-23 05:09:24.326824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.326839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.326854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.326868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.326884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.326898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.326914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.326928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.326944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.326958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.326974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.326988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.327004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.327018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.327034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.327049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.327064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.327079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.327094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.327109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.327125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.327139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.327154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.327172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.327188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9f17d0 is same with the state(5) to be set 00:24:45.446 [2024-04-23 05:09:24.328534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.328981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.328996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.446 [2024-04-23 05:09:24.329359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.446 [2024-04-23 05:09:24.329375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.329977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.329993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.447 [2024-04-23 05:09:24.330426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.447 [2024-04-23 05:09:24.330442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.448 [2024-04-23 05:09:24.330459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.448 [2024-04-23 05:09:24.330475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.448 [2024-04-23 05:09:24.330489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.448 [2024-04-23 05:09:24.330506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:45.448 [2024-04-23 05:09:24.330530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:45.448 [2024-04-23 05:09:24.330547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9f2a30 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.332137] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:45.448 [2024-04-23 05:09:24.332170] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:24:45.448 [2024-04-23 05:09:24.332188] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:24:45.448 [2024-04-23 05:09:24.332206] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:24:45.448 [2024-04-23 05:09:24.332322] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.332349] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.332374] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.332493] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:24:45.448 [2024-04-23 05:09:24.332525] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:24:45.448 task offset: 19328 on job bdev=Nvme10n1 fails 00:24:45.448 00:24:45.448 Latency(us) 00:24:45.448 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:45.448 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme1n1 ended in about 0.91 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme1n1 : 0.91 140.00 8.75 70.00 0.00 301420.59 20680.25 267192.70 00:24:45.448 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme2n1 ended in about 0.92 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme2n1 : 0.92 139.51 8.72 69.76 0.00 296416.40 20874.43 270299.59 00:24:45.448 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme3n1 ended in about 0.90 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme3n1 : 0.90 212.73 13.30 70.91 0.00 214019.03 37865.24 246997.90 00:24:45.448 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme4n1 ended in about 0.90 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme4n1 : 0.90 212.48 13.28 70.83 0.00 209650.92 20194.80 262532.36 00:24:45.448 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme5n1 ended in about 0.92 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme5n1 : 0.92 144.44 9.03 69.50 0.00 272171.91 18350.08 250104.79 00:24:45.448 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme6n1 ended in about 0.92 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme6n1 : 0.92 138.50 8.66 69.25 0.00 274309.12 19126.80 259425.47 00:24:45.448 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme7n1 ended in about 0.93 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme7n1 : 0.93 137.99 8.62 68.99 0.00 269381.03 20777.34 270299.59 00:24:45.448 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme8n1 ended in about 0.94 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme8n1 : 0.94 136.46 8.53 68.23 0.00 266911.29 16408.27 250104.79 00:24:45.448 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme9n1 ended in about 0.94 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme9n1 : 0.94 135.98 8.50 67.99 0.00 262287.87 19418.07 276513.37 00:24:45.448 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:45.448 Job: Nvme10n1 ended in about 0.90 seconds with error 00:24:45.448 Verification LBA range: start 0x0 length 0x400 00:24:45.448 Nvme10n1 : 0.90 142.09 8.88 71.04 0.00 243065.49 20583.16 302921.96 00:24:45.448 =================================================================================================================== 00:24:45.448 Total : 1540.18 96.26 696.51 0.00 257927.62 16408.27 302921.96 00:24:45.448 [2024-04-23 05:09:24.359083] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:24:45.448 [2024-04-23 05:09:24.359186] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:24:45.448 [2024-04-23 05:09:24.359556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.359697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.359725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5e43c0 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.359745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e43c0 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.359849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.359977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.360004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbc1e00 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.360020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbc1e00 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.360140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.360256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.360282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa263c0 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.360299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa263c0 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.360406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.360520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.360546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbae8b0 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.360562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbae8b0 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.362462] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:24:45.448 [2024-04-23 05:09:24.362495] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:24:45.448 [2024-04-23 05:09:24.362678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.362797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.362824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbbe510 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.362841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbbe510 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.362946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.363056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.363082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x54eda0 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.363099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x54eda0 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.363265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.363372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.363398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa25e70 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.363415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa25e70 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.363440] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5e43c0 (9): Bad file descriptor 00:24:45.448 [2024-04-23 05:09:24.363464] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbc1e00 (9): Bad file descriptor 00:24:45.448 [2024-04-23 05:09:24.363483] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa263c0 (9): Bad file descriptor 00:24:45.448 [2024-04-23 05:09:24.363501] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbae8b0 (9): Bad file descriptor 00:24:45.448 [2024-04-23 05:09:24.363574] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.363603] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.363630] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.363650] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.363668] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:45.448 [2024-04-23 05:09:24.364041] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:24:45.448 [2024-04-23 05:09:24.364204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.364317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.364344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9fa370 with addr=10.0.0.2, port=4420 00:24:45.448 [2024-04-23 05:09:24.364360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9fa370 is same with the state(5) to be set 00:24:45.448 [2024-04-23 05:09:24.364465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.448 [2024-04-23 05:09:24.364575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.449 [2024-04-23 05:09:24.364601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb363b0 with addr=10.0.0.2, port=4420 00:24:45.449 [2024-04-23 05:09:24.364617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb363b0 is same with the state(5) to be set 00:24:45.449 [2024-04-23 05:09:24.364637] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbbe510 (9): Bad file descriptor 00:24:45.449 [2024-04-23 05:09:24.364656] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x54eda0 (9): Bad file descriptor 00:24:45.449 [2024-04-23 05:09:24.364680] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa25e70 (9): Bad file descriptor 00:24:45.449 [2024-04-23 05:09:24.364699] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.364713] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.364730] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:45.449 [2024-04-23 05:09:24.364750] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.364765] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.364779] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:24:45.449 [2024-04-23 05:09:24.364794] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.364808] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.364821] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:24:45.449 [2024-04-23 05:09:24.364838] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.364852] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.364865] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:24:45.449 [2024-04-23 05:09:24.364965] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.364987] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.364999] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.365011] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.365119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.449 [2024-04-23 05:09:24.365231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:45.449 [2024-04-23 05:09:24.365256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa266f0 with addr=10.0.0.2, port=4420 00:24:45.449 [2024-04-23 05:09:24.365272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa266f0 is same with the state(5) to be set 00:24:45.449 [2024-04-23 05:09:24.365290] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9fa370 (9): Bad file descriptor 00:24:45.449 [2024-04-23 05:09:24.365310] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb363b0 (9): Bad file descriptor 00:24:45.449 [2024-04-23 05:09:24.365326] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.365339] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.365353] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:24:45.449 [2024-04-23 05:09:24.365370] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.365384] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.365397] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:24:45.449 [2024-04-23 05:09:24.365412] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.365431] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.365445] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:24:45.449 [2024-04-23 05:09:24.365486] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.365505] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.365526] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.365553] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa266f0 (9): Bad file descriptor 00:24:45.449 [2024-04-23 05:09:24.365573] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.365586] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.365600] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:24:45.449 [2024-04-23 05:09:24.365617] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.365631] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.365643] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:24:45.449 [2024-04-23 05:09:24.365681] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.365698] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.449 [2024-04-23 05:09:24.365711] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:24:45.449 [2024-04-23 05:09:24.365723] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:24:45.449 [2024-04-23 05:09:24.365737] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:24:45.449 [2024-04-23 05:09:24.365776] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:45.709 05:09:24 -- target/shutdown.sh@136 -- # nvmfpid= 00:24:45.709 05:09:24 -- target/shutdown.sh@139 -- # sleep 1 00:24:47.092 05:09:25 -- target/shutdown.sh@142 -- # kill -9 2463080 00:24:47.092 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 142: kill: (2463080) - No such process 00:24:47.092 05:09:25 -- target/shutdown.sh@142 -- # true 00:24:47.092 05:09:25 -- target/shutdown.sh@144 -- # stoptarget 00:24:47.092 05:09:25 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:47.092 05:09:25 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:47.092 05:09:25 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:47.092 05:09:25 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:47.092 05:09:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:47.092 05:09:25 -- nvmf/common.sh@117 -- # sync 00:24:47.092 05:09:25 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:24:47.092 05:09:25 -- nvmf/common.sh@120 -- # set +e 00:24:47.092 05:09:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:47.092 05:09:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:24:47.092 rmmod nvme_tcp 00:24:47.092 rmmod nvme_fabrics 00:24:47.092 rmmod nvme_keyring 00:24:47.092 05:09:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:47.092 05:09:25 -- nvmf/common.sh@124 -- # set -e 00:24:47.092 05:09:25 -- nvmf/common.sh@125 -- # return 0 00:24:47.092 05:09:25 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:24:47.092 05:09:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:47.092 05:09:25 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:24:47.092 05:09:25 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:24:47.092 05:09:25 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:47.092 05:09:25 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:24:47.092 05:09:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:47.092 05:09:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:47.092 05:09:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:49.005 05:09:27 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:24:49.005 00:24:49.005 real 0m7.482s 00:24:49.005 user 0m18.284s 00:24:49.005 sys 0m1.500s 00:24:49.005 05:09:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:49.005 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:24:49.005 ************************************ 00:24:49.005 END TEST nvmf_shutdown_tc3 00:24:49.005 ************************************ 00:24:49.005 05:09:27 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:24:49.005 00:24:49.005 real 0m27.151s 00:24:49.005 user 1m15.235s 00:24:49.005 sys 0m6.293s 00:24:49.005 05:09:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:49.005 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:24:49.005 ************************************ 00:24:49.005 END TEST nvmf_shutdown 00:24:49.005 ************************************ 00:24:49.005 05:09:27 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:24:49.005 05:09:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:49.005 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:24:49.005 05:09:27 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:24:49.005 05:09:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:49.005 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:24:49.005 05:09:27 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:24:49.005 05:09:27 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:24:49.005 05:09:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:49.005 05:09:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:49.005 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:24:49.005 ************************************ 00:24:49.005 START TEST nvmf_multicontroller 00:24:49.005 ************************************ 00:24:49.005 05:09:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:24:49.005 * Looking for test storage... 00:24:49.005 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:49.005 05:09:28 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:49.005 05:09:28 -- nvmf/common.sh@7 -- # uname -s 00:24:49.005 05:09:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:49.005 05:09:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:49.005 05:09:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:49.005 05:09:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:49.005 05:09:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:49.006 05:09:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:49.006 05:09:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:49.006 05:09:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:49.006 05:09:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:49.006 05:09:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:49.006 05:09:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:49.006 05:09:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:49.006 05:09:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:49.006 05:09:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:49.006 05:09:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:49.006 05:09:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:49.006 05:09:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:49.006 05:09:28 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:49.006 05:09:28 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:49.006 05:09:28 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:49.006 05:09:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.006 05:09:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.006 05:09:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.006 05:09:28 -- paths/export.sh@5 -- # export PATH 00:24:49.006 05:09:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.006 05:09:28 -- nvmf/common.sh@47 -- # : 0 00:24:49.006 05:09:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:49.006 05:09:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:49.006 05:09:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:49.006 05:09:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:49.006 05:09:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:49.006 05:09:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:49.006 05:09:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:49.006 05:09:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:49.006 05:09:28 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:49.006 05:09:28 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:49.006 05:09:28 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:24:49.006 05:09:28 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:24:49.006 05:09:28 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:49.006 05:09:28 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:24:49.006 05:09:28 -- host/multicontroller.sh@23 -- # nvmftestinit 00:24:49.006 05:09:28 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:24:49.006 05:09:28 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:49.006 05:09:28 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:49.006 05:09:28 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:49.006 05:09:28 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:49.006 05:09:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.006 05:09:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.006 05:09:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:49.264 05:09:28 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:49.264 05:09:28 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:49.264 05:09:28 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:49.264 05:09:28 -- common/autotest_common.sh@10 -- # set +x 00:24:51.169 05:09:30 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:51.169 05:09:30 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:51.169 05:09:30 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:51.169 05:09:30 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:51.169 05:09:30 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:51.169 05:09:30 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:51.169 05:09:30 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:51.169 05:09:30 -- nvmf/common.sh@295 -- # net_devs=() 00:24:51.169 05:09:30 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:51.169 05:09:30 -- nvmf/common.sh@296 -- # e810=() 00:24:51.169 05:09:30 -- nvmf/common.sh@296 -- # local -ga e810 00:24:51.169 05:09:30 -- nvmf/common.sh@297 -- # x722=() 00:24:51.169 05:09:30 -- nvmf/common.sh@297 -- # local -ga x722 00:24:51.169 05:09:30 -- nvmf/common.sh@298 -- # mlx=() 00:24:51.169 05:09:30 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:51.169 05:09:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:51.169 05:09:30 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:51.169 05:09:30 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:51.169 05:09:30 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:51.169 05:09:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:51.169 05:09:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:51.169 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:51.169 05:09:30 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:51.169 05:09:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:51.169 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:51.169 05:09:30 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:51.169 05:09:30 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:51.169 05:09:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:51.169 05:09:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:51.169 05:09:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:51.169 05:09:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:51.169 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:51.169 05:09:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:51.169 05:09:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:51.169 05:09:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:51.169 05:09:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:51.169 05:09:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:51.169 05:09:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:51.169 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:51.169 05:09:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:51.169 05:09:30 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:51.169 05:09:30 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:51.169 05:09:30 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:24:51.169 05:09:30 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:24:51.169 05:09:30 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:51.169 05:09:30 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:51.169 05:09:30 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:51.169 05:09:30 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:24:51.169 05:09:30 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:51.169 05:09:30 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:51.169 05:09:30 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:24:51.169 05:09:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:51.169 05:09:30 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:51.169 05:09:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:24:51.169 05:09:30 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:24:51.169 05:09:30 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:24:51.169 05:09:30 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:51.169 05:09:30 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:51.169 05:09:30 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:51.169 05:09:30 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:24:51.169 05:09:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:51.169 05:09:30 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:51.169 05:09:30 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:51.169 05:09:30 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:24:51.169 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:51.169 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:24:51.169 00:24:51.169 --- 10.0.0.2 ping statistics --- 00:24:51.169 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:51.169 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:24:51.169 05:09:30 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:51.169 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:51.170 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:24:51.170 00:24:51.170 --- 10.0.0.1 ping statistics --- 00:24:51.170 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:51.170 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:24:51.170 05:09:30 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:51.170 05:09:30 -- nvmf/common.sh@411 -- # return 0 00:24:51.170 05:09:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:51.170 05:09:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:51.170 05:09:30 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:24:51.170 05:09:30 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:24:51.170 05:09:30 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:51.170 05:09:30 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:24:51.170 05:09:30 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:24:51.170 05:09:30 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:24:51.170 05:09:30 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:51.170 05:09:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:51.170 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.170 05:09:30 -- nvmf/common.sh@470 -- # nvmfpid=2465492 00:24:51.170 05:09:30 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:51.170 05:09:30 -- nvmf/common.sh@471 -- # waitforlisten 2465492 00:24:51.170 05:09:30 -- common/autotest_common.sh@817 -- # '[' -z 2465492 ']' 00:24:51.170 05:09:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:51.170 05:09:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:51.170 05:09:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:51.170 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:51.170 05:09:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:51.170 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.170 [2024-04-23 05:09:30.296336] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:51.170 [2024-04-23 05:09:30.296412] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:51.170 EAL: No free 2048 kB hugepages reported on node 1 00:24:51.427 [2024-04-23 05:09:30.335219] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:51.427 [2024-04-23 05:09:30.366956] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:51.427 [2024-04-23 05:09:30.459641] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:51.427 [2024-04-23 05:09:30.459709] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:51.427 [2024-04-23 05:09:30.459740] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:51.427 [2024-04-23 05:09:30.459752] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:51.427 [2024-04-23 05:09:30.459763] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:51.427 [2024-04-23 05:09:30.459903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:51.427 [2024-04-23 05:09:30.459980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:51.427 [2024-04-23 05:09:30.459983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:51.427 05:09:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:51.427 05:09:30 -- common/autotest_common.sh@850 -- # return 0 00:24:51.427 05:09:30 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:51.427 05:09:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:51.427 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.685 05:09:30 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:51.685 05:09:30 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:51.685 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.685 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.685 [2024-04-23 05:09:30.602394] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:51.685 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.685 05:09:30 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:51.685 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.685 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.685 Malloc0 00:24:51.685 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.685 05:09:30 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:51.685 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 [2024-04-23 05:09:30.662766] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 [2024-04-23 05:09:30.670630] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 Malloc1 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:24:51.686 05:09:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.686 05:09:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.686 05:09:30 -- host/multicontroller.sh@44 -- # bdevperf_pid=2465637 00:24:51.686 05:09:30 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:24:51.686 05:09:30 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:51.686 05:09:30 -- host/multicontroller.sh@47 -- # waitforlisten 2465637 /var/tmp/bdevperf.sock 00:24:51.686 05:09:30 -- common/autotest_common.sh@817 -- # '[' -z 2465637 ']' 00:24:51.686 05:09:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:51.686 05:09:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:51.686 05:09:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:51.686 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:51.686 05:09:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:51.686 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:24:51.944 05:09:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:51.944 05:09:31 -- common/autotest_common.sh@850 -- # return 0 00:24:51.944 05:09:31 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:24:51.944 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.944 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.202 NVMe0n1 00:24:52.202 05:09:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:52.202 05:09:31 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:52.202 05:09:31 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:24:52.202 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.202 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.202 05:09:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:52.202 1 00:24:52.202 05:09:31 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:24:52.202 05:09:31 -- common/autotest_common.sh@638 -- # local es=0 00:24:52.202 05:09:31 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:24:52.202 05:09:31 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:24:52.202 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.202 05:09:31 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:24:52.202 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.202 05:09:31 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:24:52.202 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.202 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.202 request: 00:24:52.202 { 00:24:52.202 "name": "NVMe0", 00:24:52.202 "trtype": "tcp", 00:24:52.202 "traddr": "10.0.0.2", 00:24:52.202 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:24:52.202 "hostaddr": "10.0.0.2", 00:24:52.202 "hostsvcid": "60000", 00:24:52.202 "adrfam": "ipv4", 00:24:52.202 "trsvcid": "4420", 00:24:52.202 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:52.202 "method": "bdev_nvme_attach_controller", 00:24:52.202 "req_id": 1 00:24:52.202 } 00:24:52.202 Got JSON-RPC error response 00:24:52.202 response: 00:24:52.202 { 00:24:52.202 "code": -114, 00:24:52.202 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:24:52.202 } 00:24:52.202 05:09:31 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:24:52.202 05:09:31 -- common/autotest_common.sh@641 -- # es=1 00:24:52.202 05:09:31 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:52.202 05:09:31 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:52.202 05:09:31 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:52.202 05:09:31 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:24:52.202 05:09:31 -- common/autotest_common.sh@638 -- # local es=0 00:24:52.202 05:09:31 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:24:52.202 05:09:31 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:24:52.202 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.202 05:09:31 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:24:52.202 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.202 05:09:31 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:24:52.202 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.202 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.202 request: 00:24:52.202 { 00:24:52.202 "name": "NVMe0", 00:24:52.202 "trtype": "tcp", 00:24:52.202 "traddr": "10.0.0.2", 00:24:52.202 "hostaddr": "10.0.0.2", 00:24:52.202 "hostsvcid": "60000", 00:24:52.202 "adrfam": "ipv4", 00:24:52.202 "trsvcid": "4420", 00:24:52.202 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:52.202 "method": "bdev_nvme_attach_controller", 00:24:52.202 "req_id": 1 00:24:52.202 } 00:24:52.202 Got JSON-RPC error response 00:24:52.202 response: 00:24:52.202 { 00:24:52.202 "code": -114, 00:24:52.202 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:24:52.202 } 00:24:52.202 05:09:31 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:24:52.202 05:09:31 -- common/autotest_common.sh@641 -- # es=1 00:24:52.202 05:09:31 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:52.203 05:09:31 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:52.203 05:09:31 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:52.203 05:09:31 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@638 -- # local es=0 00:24:52.203 05:09:31 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:24:52.203 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.203 05:09:31 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:24:52.203 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.203 05:09:31 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.203 request: 00:24:52.203 { 00:24:52.203 "name": "NVMe0", 00:24:52.203 "trtype": "tcp", 00:24:52.203 "traddr": "10.0.0.2", 00:24:52.203 "hostaddr": "10.0.0.2", 00:24:52.203 "hostsvcid": "60000", 00:24:52.203 "adrfam": "ipv4", 00:24:52.203 "trsvcid": "4420", 00:24:52.203 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:52.203 "multipath": "disable", 00:24:52.203 "method": "bdev_nvme_attach_controller", 00:24:52.203 "req_id": 1 00:24:52.203 } 00:24:52.203 Got JSON-RPC error response 00:24:52.203 response: 00:24:52.203 { 00:24:52.203 "code": -114, 00:24:52.203 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:24:52.203 } 00:24:52.203 05:09:31 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:24:52.203 05:09:31 -- common/autotest_common.sh@641 -- # es=1 00:24:52.203 05:09:31 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:52.203 05:09:31 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:52.203 05:09:31 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:52.203 05:09:31 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:24:52.203 05:09:31 -- common/autotest_common.sh@638 -- # local es=0 00:24:52.203 05:09:31 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:24:52.203 05:09:31 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:24:52.203 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.203 05:09:31 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:24:52.203 05:09:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:52.203 05:09:31 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:24:52.203 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.203 request: 00:24:52.203 { 00:24:52.203 "name": "NVMe0", 00:24:52.203 "trtype": "tcp", 00:24:52.203 "traddr": "10.0.0.2", 00:24:52.203 "hostaddr": "10.0.0.2", 00:24:52.203 "hostsvcid": "60000", 00:24:52.203 "adrfam": "ipv4", 00:24:52.203 "trsvcid": "4420", 00:24:52.203 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:52.203 "multipath": "failover", 00:24:52.203 "method": "bdev_nvme_attach_controller", 00:24:52.203 "req_id": 1 00:24:52.203 } 00:24:52.203 Got JSON-RPC error response 00:24:52.203 response: 00:24:52.203 { 00:24:52.203 "code": -114, 00:24:52.203 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:24:52.203 } 00:24:52.203 05:09:31 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:24:52.203 05:09:31 -- common/autotest_common.sh@641 -- # es=1 00:24:52.203 05:09:31 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:52.203 05:09:31 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:52.203 05:09:31 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:52.203 05:09:31 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:52.203 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.203 00:24:52.203 05:09:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:52.203 05:09:31 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:52.203 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.203 05:09:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:52.203 05:09:31 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:24:52.203 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.203 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.461 00:24:52.461 05:09:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:52.461 05:09:31 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:52.461 05:09:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:52.461 05:09:31 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:24:52.461 05:09:31 -- common/autotest_common.sh@10 -- # set +x 00:24:52.461 05:09:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:52.461 05:09:31 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:24:52.461 05:09:31 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:24:53.396 0 00:24:53.396 05:09:32 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:24:53.396 05:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:53.396 05:09:32 -- common/autotest_common.sh@10 -- # set +x 00:24:53.396 05:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:53.396 05:09:32 -- host/multicontroller.sh@100 -- # killprocess 2465637 00:24:53.396 05:09:32 -- common/autotest_common.sh@936 -- # '[' -z 2465637 ']' 00:24:53.396 05:09:32 -- common/autotest_common.sh@940 -- # kill -0 2465637 00:24:53.396 05:09:32 -- common/autotest_common.sh@941 -- # uname 00:24:53.396 05:09:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:53.396 05:09:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2465637 00:24:53.396 05:09:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:53.396 05:09:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:53.396 05:09:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2465637' 00:24:53.396 killing process with pid 2465637 00:24:53.396 05:09:32 -- common/autotest_common.sh@955 -- # kill 2465637 00:24:53.396 05:09:32 -- common/autotest_common.sh@960 -- # wait 2465637 00:24:53.654 05:09:32 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:53.654 05:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:53.654 05:09:32 -- common/autotest_common.sh@10 -- # set +x 00:24:53.654 05:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:53.654 05:09:32 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:53.654 05:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:53.654 05:09:32 -- common/autotest_common.sh@10 -- # set +x 00:24:53.654 05:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:53.654 05:09:32 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:24:53.654 05:09:32 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:53.654 05:09:32 -- common/autotest_common.sh@1598 -- # read -r file 00:24:53.654 05:09:32 -- common/autotest_common.sh@1597 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:24:53.654 05:09:32 -- common/autotest_common.sh@1597 -- # sort -u 00:24:53.654 05:09:32 -- common/autotest_common.sh@1599 -- # cat 00:24:53.654 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:24:53.654 [2024-04-23 05:09:30.769711] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:53.654 [2024-04-23 05:09:30.769793] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2465637 ] 00:24:53.654 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.654 [2024-04-23 05:09:30.801985] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:53.654 [2024-04-23 05:09:30.830149] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:53.654 [2024-04-23 05:09:30.914951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:53.654 [2024-04-23 05:09:31.369902] bdev.c:4548:bdev_name_add: *ERROR*: Bdev name 9a759d8f-5fd6-46ed-966a-d800ad9503a0 already exists 00:24:53.654 [2024-04-23 05:09:31.369942] bdev.c:7651:bdev_register: *ERROR*: Unable to add uuid:9a759d8f-5fd6-46ed-966a-d800ad9503a0 alias for bdev NVMe1n1 00:24:53.654 [2024-04-23 05:09:31.369975] bdev_nvme.c:4272:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:24:53.654 Running I/O for 1 seconds... 00:24:53.654 00:24:53.654 Latency(us) 00:24:53.654 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:53.654 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:24:53.654 NVMe0n1 : 1.01 19130.16 74.73 0.00 0.00 6680.88 4247.70 15243.19 00:24:53.654 =================================================================================================================== 00:24:53.654 Total : 19130.16 74.73 0.00 0.00 6680.88 4247.70 15243.19 00:24:53.654 Received shutdown signal, test time was about 1.000000 seconds 00:24:53.654 00:24:53.654 Latency(us) 00:24:53.654 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:53.654 =================================================================================================================== 00:24:53.654 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:53.654 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:24:53.654 05:09:32 -- common/autotest_common.sh@1604 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:53.654 05:09:32 -- common/autotest_common.sh@1598 -- # read -r file 00:24:53.654 05:09:32 -- host/multicontroller.sh@108 -- # nvmftestfini 00:24:53.654 05:09:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:53.654 05:09:32 -- nvmf/common.sh@117 -- # sync 00:24:53.654 05:09:32 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:24:53.654 05:09:32 -- nvmf/common.sh@120 -- # set +e 00:24:53.654 05:09:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:53.654 05:09:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:24:53.654 rmmod nvme_tcp 00:24:53.654 rmmod nvme_fabrics 00:24:53.654 rmmod nvme_keyring 00:24:53.654 05:09:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:53.654 05:09:32 -- nvmf/common.sh@124 -- # set -e 00:24:53.654 05:09:32 -- nvmf/common.sh@125 -- # return 0 00:24:53.654 05:09:32 -- nvmf/common.sh@478 -- # '[' -n 2465492 ']' 00:24:53.654 05:09:32 -- nvmf/common.sh@479 -- # killprocess 2465492 00:24:53.654 05:09:32 -- common/autotest_common.sh@936 -- # '[' -z 2465492 ']' 00:24:53.654 05:09:32 -- common/autotest_common.sh@940 -- # kill -0 2465492 00:24:53.654 05:09:32 -- common/autotest_common.sh@941 -- # uname 00:24:53.654 05:09:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:53.654 05:09:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2465492 00:24:53.911 05:09:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:53.912 05:09:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:53.912 05:09:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2465492' 00:24:53.912 killing process with pid 2465492 00:24:53.912 05:09:32 -- common/autotest_common.sh@955 -- # kill 2465492 00:24:53.912 05:09:32 -- common/autotest_common.sh@960 -- # wait 2465492 00:24:54.171 05:09:33 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:54.171 05:09:33 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:24:54.171 05:09:33 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:24:54.171 05:09:33 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:54.171 05:09:33 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:24:54.171 05:09:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:54.171 05:09:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:54.171 05:09:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.075 05:09:35 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:24:56.075 00:24:56.075 real 0m7.030s 00:24:56.075 user 0m10.509s 00:24:56.075 sys 0m2.237s 00:24:56.075 05:09:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:56.075 05:09:35 -- common/autotest_common.sh@10 -- # set +x 00:24:56.075 ************************************ 00:24:56.075 END TEST nvmf_multicontroller 00:24:56.075 ************************************ 00:24:56.075 05:09:35 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:24:56.075 05:09:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:56.075 05:09:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:56.075 05:09:35 -- common/autotest_common.sh@10 -- # set +x 00:24:56.335 ************************************ 00:24:56.335 START TEST nvmf_aer 00:24:56.335 ************************************ 00:24:56.335 05:09:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:24:56.335 * Looking for test storage... 00:24:56.335 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:56.335 05:09:35 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:56.335 05:09:35 -- nvmf/common.sh@7 -- # uname -s 00:24:56.335 05:09:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:56.335 05:09:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:56.335 05:09:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:56.335 05:09:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:56.335 05:09:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:56.335 05:09:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:56.335 05:09:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:56.336 05:09:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:56.336 05:09:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:56.336 05:09:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:56.336 05:09:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:56.336 05:09:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:56.336 05:09:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:56.336 05:09:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:56.336 05:09:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:56.336 05:09:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:56.336 05:09:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:56.336 05:09:35 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:56.336 05:09:35 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:56.336 05:09:35 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:56.336 05:09:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.336 05:09:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.336 05:09:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.336 05:09:35 -- paths/export.sh@5 -- # export PATH 00:24:56.336 05:09:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.336 05:09:35 -- nvmf/common.sh@47 -- # : 0 00:24:56.336 05:09:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:56.336 05:09:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:56.336 05:09:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:56.336 05:09:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:56.336 05:09:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:56.336 05:09:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:56.336 05:09:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:56.336 05:09:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:56.336 05:09:35 -- host/aer.sh@11 -- # nvmftestinit 00:24:56.336 05:09:35 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:24:56.336 05:09:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:56.336 05:09:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:56.336 05:09:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:56.336 05:09:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:56.336 05:09:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:56.336 05:09:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:56.336 05:09:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.336 05:09:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:56.336 05:09:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:56.336 05:09:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:56.336 05:09:35 -- common/autotest_common.sh@10 -- # set +x 00:24:58.276 05:09:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:58.276 05:09:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:58.276 05:09:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:58.276 05:09:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:58.276 05:09:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:58.276 05:09:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:58.276 05:09:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:58.276 05:09:37 -- nvmf/common.sh@295 -- # net_devs=() 00:24:58.276 05:09:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:58.276 05:09:37 -- nvmf/common.sh@296 -- # e810=() 00:24:58.276 05:09:37 -- nvmf/common.sh@296 -- # local -ga e810 00:24:58.276 05:09:37 -- nvmf/common.sh@297 -- # x722=() 00:24:58.276 05:09:37 -- nvmf/common.sh@297 -- # local -ga x722 00:24:58.276 05:09:37 -- nvmf/common.sh@298 -- # mlx=() 00:24:58.276 05:09:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:58.276 05:09:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:58.276 05:09:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:58.276 05:09:37 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:58.276 05:09:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:58.276 05:09:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:58.276 05:09:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:58.276 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:58.276 05:09:37 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:58.276 05:09:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:58.276 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:58.276 05:09:37 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:58.276 05:09:37 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:58.276 05:09:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.276 05:09:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:58.276 05:09:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.276 05:09:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:58.276 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:58.276 05:09:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.276 05:09:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:58.276 05:09:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.276 05:09:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:58.276 05:09:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.276 05:09:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:58.276 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:58.276 05:09:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.276 05:09:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:58.276 05:09:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:58.276 05:09:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:24:58.276 05:09:37 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:24:58.276 05:09:37 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:58.276 05:09:37 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:58.276 05:09:37 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:58.276 05:09:37 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:24:58.276 05:09:37 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:58.276 05:09:37 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:58.276 05:09:37 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:24:58.276 05:09:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:58.276 05:09:37 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:58.276 05:09:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:24:58.276 05:09:37 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:24:58.276 05:09:37 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:24:58.276 05:09:37 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:58.276 05:09:37 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:58.276 05:09:37 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:58.276 05:09:37 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:24:58.276 05:09:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:58.277 05:09:37 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:58.277 05:09:37 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:58.277 05:09:37 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:24:58.277 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:58.277 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.135 ms 00:24:58.277 00:24:58.277 --- 10.0.0.2 ping statistics --- 00:24:58.277 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.277 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:24:58.277 05:09:37 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:58.277 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:58.277 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:24:58.277 00:24:58.277 --- 10.0.0.1 ping statistics --- 00:24:58.277 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.277 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:24:58.277 05:09:37 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:58.277 05:09:37 -- nvmf/common.sh@411 -- # return 0 00:24:58.277 05:09:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:58.277 05:09:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:58.277 05:09:37 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:24:58.277 05:09:37 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:24:58.277 05:09:37 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:58.277 05:09:37 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:24:58.277 05:09:37 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:24:58.277 05:09:37 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:24:58.277 05:09:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:58.277 05:09:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:58.277 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.277 05:09:37 -- nvmf/common.sh@470 -- # nvmfpid=2467848 00:24:58.277 05:09:37 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:58.277 05:09:37 -- nvmf/common.sh@471 -- # waitforlisten 2467848 00:24:58.277 05:09:37 -- common/autotest_common.sh@817 -- # '[' -z 2467848 ']' 00:24:58.277 05:09:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:58.277 05:09:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:58.277 05:09:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:58.277 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:58.277 05:09:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:58.277 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.277 [2024-04-23 05:09:37.382374] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:24:58.277 [2024-04-23 05:09:37.382452] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:58.277 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.277 [2024-04-23 05:09:37.419546] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:24:58.536 [2024-04-23 05:09:37.446559] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:58.536 [2024-04-23 05:09:37.533919] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:58.536 [2024-04-23 05:09:37.533987] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:58.536 [2024-04-23 05:09:37.534000] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:58.536 [2024-04-23 05:09:37.534011] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:58.536 [2024-04-23 05:09:37.534021] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:58.536 [2024-04-23 05:09:37.534154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:58.536 [2024-04-23 05:09:37.534215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:58.536 [2024-04-23 05:09:37.534280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:58.536 [2024-04-23 05:09:37.534283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:58.536 05:09:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:58.536 05:09:37 -- common/autotest_common.sh@850 -- # return 0 00:24:58.536 05:09:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:58.536 05:09:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:58.536 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.536 05:09:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:58.536 05:09:37 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:58.536 05:09:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:58.536 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.536 [2024-04-23 05:09:37.685254] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:58.536 05:09:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:58.536 05:09:37 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:24:58.536 05:09:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:58.536 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.795 Malloc0 00:24:58.795 05:09:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:58.795 05:09:37 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:24:58.795 05:09:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:58.795 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.795 05:09:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:58.795 05:09:37 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:58.796 05:09:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:58.796 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.796 05:09:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:58.796 05:09:37 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:58.796 05:09:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:58.796 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.796 [2024-04-23 05:09:37.738871] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:58.796 05:09:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:58.796 05:09:37 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:24:58.796 05:09:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:58.796 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.796 [2024-04-23 05:09:37.746633] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:24:58.796 [ 00:24:58.796 { 00:24:58.796 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:24:58.796 "subtype": "Discovery", 00:24:58.796 "listen_addresses": [], 00:24:58.796 "allow_any_host": true, 00:24:58.796 "hosts": [] 00:24:58.796 }, 00:24:58.796 { 00:24:58.796 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:24:58.796 "subtype": "NVMe", 00:24:58.796 "listen_addresses": [ 00:24:58.796 { 00:24:58.796 "transport": "TCP", 00:24:58.796 "trtype": "TCP", 00:24:58.796 "adrfam": "IPv4", 00:24:58.796 "traddr": "10.0.0.2", 00:24:58.796 "trsvcid": "4420" 00:24:58.796 } 00:24:58.796 ], 00:24:58.796 "allow_any_host": true, 00:24:58.796 "hosts": [], 00:24:58.796 "serial_number": "SPDK00000000000001", 00:24:58.796 "model_number": "SPDK bdev Controller", 00:24:58.796 "max_namespaces": 2, 00:24:58.796 "min_cntlid": 1, 00:24:58.796 "max_cntlid": 65519, 00:24:58.796 "namespaces": [ 00:24:58.796 { 00:24:58.796 "nsid": 1, 00:24:58.796 "bdev_name": "Malloc0", 00:24:58.796 "name": "Malloc0", 00:24:58.796 "nguid": "E44AA17D9E884741A8969B0D7588B392", 00:24:58.796 "uuid": "e44aa17d-9e88-4741-a896-9b0d7588b392" 00:24:58.796 } 00:24:58.796 ] 00:24:58.796 } 00:24:58.796 ] 00:24:58.796 05:09:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:58.796 05:09:37 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:24:58.796 05:09:37 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:24:58.796 05:09:37 -- host/aer.sh@33 -- # aerpid=2467874 00:24:58.796 05:09:37 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:24:58.796 05:09:37 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:24:58.796 05:09:37 -- common/autotest_common.sh@1251 -- # local i=0 00:24:58.796 05:09:37 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:58.796 05:09:37 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:24:58.796 05:09:37 -- common/autotest_common.sh@1254 -- # i=1 00:24:58.796 05:09:37 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:24:58.796 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.796 05:09:37 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:58.796 05:09:37 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:24:58.796 05:09:37 -- common/autotest_common.sh@1254 -- # i=2 00:24:58.796 05:09:37 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:24:59.055 05:09:37 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:59.055 05:09:37 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:59.055 05:09:37 -- common/autotest_common.sh@1262 -- # return 0 00:24:59.055 05:09:37 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:24:59.055 05:09:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:59.055 05:09:37 -- common/autotest_common.sh@10 -- # set +x 00:24:59.055 Malloc1 00:24:59.055 05:09:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:59.055 05:09:38 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:24:59.055 05:09:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:59.055 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:24:59.055 05:09:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:59.055 05:09:38 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:24:59.055 05:09:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:59.055 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:24:59.055 [ 00:24:59.055 { 00:24:59.055 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:24:59.055 "subtype": "Discovery", 00:24:59.055 "listen_addresses": [], 00:24:59.055 "allow_any_host": true, 00:24:59.055 "hosts": [] 00:24:59.055 }, 00:24:59.055 { 00:24:59.055 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:24:59.055 "subtype": "NVMe", 00:24:59.055 "listen_addresses": [ 00:24:59.055 { 00:24:59.055 "transport": "TCP", 00:24:59.055 "trtype": "TCP", 00:24:59.055 "adrfam": "IPv4", 00:24:59.055 "traddr": "10.0.0.2", 00:24:59.055 "trsvcid": "4420" 00:24:59.055 } 00:24:59.055 ], 00:24:59.055 "allow_any_host": true, 00:24:59.055 "hosts": [], 00:24:59.055 "serial_number": "SPDK00000000000001", 00:24:59.055 "model_number": "SPDK bdev Controller", 00:24:59.055 "max_namespaces": 2, 00:24:59.055 "min_cntlid": 1, 00:24:59.055 "max_cntlid": 65519, 00:24:59.055 "namespaces": [ 00:24:59.055 { 00:24:59.055 "nsid": 1, 00:24:59.055 "bdev_name": "Malloc0", 00:24:59.055 "name": "Malloc0", 00:24:59.055 "nguid": "E44AA17D9E884741A8969B0D7588B392", 00:24:59.055 "uuid": "e44aa17d-9e88-4741-a896-9b0d7588b392" 00:24:59.055 }, 00:24:59.055 { 00:24:59.055 "nsid": 2, 00:24:59.055 "bdev_name": "Malloc1", 00:24:59.055 "name": "Malloc1", 00:24:59.055 "nguid": "11EA5AF01E1F4E3BA4BAA20A2FA65348", 00:24:59.056 "uuid": "11ea5af0-1e1f-4e3b-a4ba-a20a2fa65348" 00:24:59.056 } 00:24:59.056 ] 00:24:59.056 } 00:24:59.056 ] 00:24:59.056 05:09:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:59.056 05:09:38 -- host/aer.sh@43 -- # wait 2467874 00:24:59.056 Asynchronous Event Request test 00:24:59.056 Attaching to 10.0.0.2 00:24:59.056 Attached to 10.0.0.2 00:24:59.056 Registering asynchronous event callbacks... 00:24:59.056 Starting namespace attribute notice tests for all controllers... 00:24:59.056 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:24:59.056 aer_cb - Changed Namespace 00:24:59.056 Cleaning up... 00:24:59.056 05:09:38 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:24:59.056 05:09:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:59.056 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:24:59.056 05:09:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:59.056 05:09:38 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:24:59.056 05:09:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:59.056 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:24:59.056 05:09:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:59.056 05:09:38 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:59.056 05:09:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:59.056 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:24:59.056 05:09:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:59.056 05:09:38 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:24:59.056 05:09:38 -- host/aer.sh@51 -- # nvmftestfini 00:24:59.056 05:09:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:59.056 05:09:38 -- nvmf/common.sh@117 -- # sync 00:24:59.056 05:09:38 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:24:59.056 05:09:38 -- nvmf/common.sh@120 -- # set +e 00:24:59.056 05:09:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:59.056 05:09:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:24:59.056 rmmod nvme_tcp 00:24:59.056 rmmod nvme_fabrics 00:24:59.056 rmmod nvme_keyring 00:24:59.056 05:09:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:59.056 05:09:38 -- nvmf/common.sh@124 -- # set -e 00:24:59.056 05:09:38 -- nvmf/common.sh@125 -- # return 0 00:24:59.056 05:09:38 -- nvmf/common.sh@478 -- # '[' -n 2467848 ']' 00:24:59.056 05:09:38 -- nvmf/common.sh@479 -- # killprocess 2467848 00:24:59.056 05:09:38 -- common/autotest_common.sh@936 -- # '[' -z 2467848 ']' 00:24:59.056 05:09:38 -- common/autotest_common.sh@940 -- # kill -0 2467848 00:24:59.056 05:09:38 -- common/autotest_common.sh@941 -- # uname 00:24:59.056 05:09:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:59.056 05:09:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2467848 00:24:59.056 05:09:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:59.056 05:09:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:59.056 05:09:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2467848' 00:24:59.056 killing process with pid 2467848 00:24:59.056 05:09:38 -- common/autotest_common.sh@955 -- # kill 2467848 00:24:59.056 [2024-04-23 05:09:38.190822] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:24:59.056 05:09:38 -- common/autotest_common.sh@960 -- # wait 2467848 00:24:59.314 05:09:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:59.314 05:09:38 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:24:59.314 05:09:38 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:24:59.314 05:09:38 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:59.314 05:09:38 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:24:59.314 05:09:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.314 05:09:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.314 05:09:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.855 05:09:40 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:25:01.855 00:25:01.855 real 0m5.181s 00:25:01.855 user 0m3.993s 00:25:01.855 sys 0m1.851s 00:25:01.855 05:09:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:01.855 05:09:40 -- common/autotest_common.sh@10 -- # set +x 00:25:01.855 ************************************ 00:25:01.855 END TEST nvmf_aer 00:25:01.855 ************************************ 00:25:01.855 05:09:40 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:01.855 05:09:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:01.855 05:09:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:01.855 05:09:40 -- common/autotest_common.sh@10 -- # set +x 00:25:01.855 ************************************ 00:25:01.855 START TEST nvmf_async_init 00:25:01.855 ************************************ 00:25:01.855 05:09:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:01.855 * Looking for test storage... 00:25:01.855 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:01.855 05:09:40 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:01.855 05:09:40 -- nvmf/common.sh@7 -- # uname -s 00:25:01.855 05:09:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:01.855 05:09:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:01.855 05:09:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:01.855 05:09:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:01.855 05:09:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:01.855 05:09:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:01.855 05:09:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:01.855 05:09:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:01.855 05:09:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:01.855 05:09:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:01.855 05:09:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:01.855 05:09:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:01.855 05:09:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:01.855 05:09:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:01.855 05:09:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:01.855 05:09:40 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:01.855 05:09:40 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:01.855 05:09:40 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:01.855 05:09:40 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:01.855 05:09:40 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:01.855 05:09:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.855 05:09:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.855 05:09:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.855 05:09:40 -- paths/export.sh@5 -- # export PATH 00:25:01.855 05:09:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.855 05:09:40 -- nvmf/common.sh@47 -- # : 0 00:25:01.855 05:09:40 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:01.855 05:09:40 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:01.855 05:09:40 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:01.855 05:09:40 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:01.855 05:09:40 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:01.855 05:09:40 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:01.855 05:09:40 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:01.855 05:09:40 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:01.855 05:09:40 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:01.855 05:09:40 -- host/async_init.sh@14 -- # null_block_size=512 00:25:01.855 05:09:40 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:01.855 05:09:40 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:01.855 05:09:40 -- host/async_init.sh@20 -- # uuidgen 00:25:01.855 05:09:40 -- host/async_init.sh@20 -- # tr -d - 00:25:01.855 05:09:40 -- host/async_init.sh@20 -- # nguid=2d7965696fa248f887ed3334cc32d3d9 00:25:01.855 05:09:40 -- host/async_init.sh@22 -- # nvmftestinit 00:25:01.855 05:09:40 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:25:01.855 05:09:40 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:01.855 05:09:40 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:01.855 05:09:40 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:01.855 05:09:40 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:01.855 05:09:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:01.855 05:09:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:01.855 05:09:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.855 05:09:40 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:01.855 05:09:40 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:01.855 05:09:40 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:01.855 05:09:40 -- common/autotest_common.sh@10 -- # set +x 00:25:03.761 05:09:42 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:03.761 05:09:42 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:03.761 05:09:42 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:03.761 05:09:42 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:03.761 05:09:42 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:03.761 05:09:42 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:03.761 05:09:42 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:03.761 05:09:42 -- nvmf/common.sh@295 -- # net_devs=() 00:25:03.761 05:09:42 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:03.761 05:09:42 -- nvmf/common.sh@296 -- # e810=() 00:25:03.761 05:09:42 -- nvmf/common.sh@296 -- # local -ga e810 00:25:03.761 05:09:42 -- nvmf/common.sh@297 -- # x722=() 00:25:03.761 05:09:42 -- nvmf/common.sh@297 -- # local -ga x722 00:25:03.761 05:09:42 -- nvmf/common.sh@298 -- # mlx=() 00:25:03.761 05:09:42 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:03.761 05:09:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:03.761 05:09:42 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:03.761 05:09:42 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:25:03.761 05:09:42 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:03.761 05:09:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:03.761 05:09:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:03.761 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:03.761 05:09:42 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:03.761 05:09:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:03.761 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:03.761 05:09:42 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:03.761 05:09:42 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:03.761 05:09:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:03.761 05:09:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:03.761 05:09:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:03.761 05:09:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:03.761 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:03.761 05:09:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:03.761 05:09:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:03.761 05:09:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:03.761 05:09:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:03.761 05:09:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:03.761 05:09:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:03.761 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:03.761 05:09:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:03.761 05:09:42 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:03.761 05:09:42 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:03.761 05:09:42 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:25:03.761 05:09:42 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:25:03.761 05:09:42 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:03.761 05:09:42 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:03.761 05:09:42 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:03.761 05:09:42 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:25:03.761 05:09:42 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:03.761 05:09:42 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:03.761 05:09:42 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:25:03.762 05:09:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:03.762 05:09:42 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:03.762 05:09:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:25:03.762 05:09:42 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:25:03.762 05:09:42 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:25:03.762 05:09:42 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:03.762 05:09:42 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:03.762 05:09:42 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:03.762 05:09:42 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:25:03.762 05:09:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:03.762 05:09:42 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:03.762 05:09:42 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:03.762 05:09:42 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:25:03.762 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:03.762 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:25:03.762 00:25:03.762 --- 10.0.0.2 ping statistics --- 00:25:03.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.762 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:25:03.762 05:09:42 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:03.762 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:03.762 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:25:03.762 00:25:03.762 --- 10.0.0.1 ping statistics --- 00:25:03.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.762 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:25:03.762 05:09:42 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:03.762 05:09:42 -- nvmf/common.sh@411 -- # return 0 00:25:03.762 05:09:42 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:03.762 05:09:42 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:03.762 05:09:42 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:25:03.762 05:09:42 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:25:03.762 05:09:42 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:03.762 05:09:42 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:25:03.762 05:09:42 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:25:03.762 05:09:42 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:03.762 05:09:42 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:03.762 05:09:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:03.762 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:03.762 05:09:42 -- nvmf/common.sh@470 -- # nvmfpid=2469818 00:25:03.762 05:09:42 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:03.762 05:09:42 -- nvmf/common.sh@471 -- # waitforlisten 2469818 00:25:03.762 05:09:42 -- common/autotest_common.sh@817 -- # '[' -z 2469818 ']' 00:25:03.762 05:09:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:03.762 05:09:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:25:03.762 05:09:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:03.762 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:03.762 05:09:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:25:03.762 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:03.762 [2024-04-23 05:09:42.635248] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:25:03.762 [2024-04-23 05:09:42.635333] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:03.762 EAL: No free 2048 kB hugepages reported on node 1 00:25:03.762 [2024-04-23 05:09:42.672933] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:25:03.762 [2024-04-23 05:09:42.699422] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:03.762 [2024-04-23 05:09:42.784949] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:03.762 [2024-04-23 05:09:42.785022] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:03.762 [2024-04-23 05:09:42.785036] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:03.762 [2024-04-23 05:09:42.785047] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:03.762 [2024-04-23 05:09:42.785057] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:03.762 [2024-04-23 05:09:42.785084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:03.762 05:09:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:25:03.762 05:09:42 -- common/autotest_common.sh@850 -- # return 0 00:25:03.762 05:09:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:03.762 05:09:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:03.762 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:03.762 05:09:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:03.762 05:09:42 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:03.762 05:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:03.762 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:04.021 [2024-04-23 05:09:42.927132] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:04.021 05:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.021 05:09:42 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:04.021 05:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.021 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:04.021 null0 00:25:04.021 05:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.021 05:09:42 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:04.021 05:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.021 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:04.021 05:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.021 05:09:42 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:04.021 05:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.021 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:04.021 05:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.021 05:09:42 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 2d7965696fa248f887ed3334cc32d3d9 00:25:04.021 05:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.021 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:04.021 05:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.021 05:09:42 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:04.021 05:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.021 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:04.021 [2024-04-23 05:09:42.967372] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:04.021 05:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.021 05:09:42 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:04.021 05:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.021 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 nvme0n1 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 [ 00:25:04.280 { 00:25:04.280 "name": "nvme0n1", 00:25:04.280 "aliases": [ 00:25:04.280 "2d796569-6fa2-48f8-87ed-3334cc32d3d9" 00:25:04.280 ], 00:25:04.280 "product_name": "NVMe disk", 00:25:04.280 "block_size": 512, 00:25:04.280 "num_blocks": 2097152, 00:25:04.280 "uuid": "2d796569-6fa2-48f8-87ed-3334cc32d3d9", 00:25:04.280 "assigned_rate_limits": { 00:25:04.280 "rw_ios_per_sec": 0, 00:25:04.280 "rw_mbytes_per_sec": 0, 00:25:04.280 "r_mbytes_per_sec": 0, 00:25:04.280 "w_mbytes_per_sec": 0 00:25:04.280 }, 00:25:04.280 "claimed": false, 00:25:04.280 "zoned": false, 00:25:04.280 "supported_io_types": { 00:25:04.280 "read": true, 00:25:04.280 "write": true, 00:25:04.280 "unmap": false, 00:25:04.280 "write_zeroes": true, 00:25:04.280 "flush": true, 00:25:04.280 "reset": true, 00:25:04.280 "compare": true, 00:25:04.280 "compare_and_write": true, 00:25:04.280 "abort": true, 00:25:04.280 "nvme_admin": true, 00:25:04.280 "nvme_io": true 00:25:04.280 }, 00:25:04.280 "memory_domains": [ 00:25:04.280 { 00:25:04.280 "dma_device_id": "system", 00:25:04.280 "dma_device_type": 1 00:25:04.280 } 00:25:04.280 ], 00:25:04.280 "driver_specific": { 00:25:04.280 "nvme": [ 00:25:04.280 { 00:25:04.280 "trid": { 00:25:04.280 "trtype": "TCP", 00:25:04.280 "adrfam": "IPv4", 00:25:04.280 "traddr": "10.0.0.2", 00:25:04.280 "trsvcid": "4420", 00:25:04.280 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:04.280 }, 00:25:04.280 "ctrlr_data": { 00:25:04.280 "cntlid": 1, 00:25:04.280 "vendor_id": "0x8086", 00:25:04.280 "model_number": "SPDK bdev Controller", 00:25:04.280 "serial_number": "00000000000000000000", 00:25:04.280 "firmware_revision": "24.05", 00:25:04.280 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:04.280 "oacs": { 00:25:04.280 "security": 0, 00:25:04.280 "format": 0, 00:25:04.280 "firmware": 0, 00:25:04.280 "ns_manage": 0 00:25:04.280 }, 00:25:04.280 "multi_ctrlr": true, 00:25:04.280 "ana_reporting": false 00:25:04.280 }, 00:25:04.280 "vs": { 00:25:04.280 "nvme_version": "1.3" 00:25:04.280 }, 00:25:04.280 "ns_data": { 00:25:04.280 "id": 1, 00:25:04.280 "can_share": true 00:25:04.280 } 00:25:04.280 } 00:25:04.280 ], 00:25:04.280 "mp_policy": "active_passive" 00:25:04.280 } 00:25:04.280 } 00:25:04.280 ] 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 [2024-04-23 05:09:43.220057] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:04.280 [2024-04-23 05:09:43.220153] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee830 (9): Bad file descriptor 00:25:04.280 [2024-04-23 05:09:43.362689] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 [ 00:25:04.280 { 00:25:04.280 "name": "nvme0n1", 00:25:04.280 "aliases": [ 00:25:04.280 "2d796569-6fa2-48f8-87ed-3334cc32d3d9" 00:25:04.280 ], 00:25:04.280 "product_name": "NVMe disk", 00:25:04.280 "block_size": 512, 00:25:04.280 "num_blocks": 2097152, 00:25:04.280 "uuid": "2d796569-6fa2-48f8-87ed-3334cc32d3d9", 00:25:04.280 "assigned_rate_limits": { 00:25:04.280 "rw_ios_per_sec": 0, 00:25:04.280 "rw_mbytes_per_sec": 0, 00:25:04.280 "r_mbytes_per_sec": 0, 00:25:04.280 "w_mbytes_per_sec": 0 00:25:04.280 }, 00:25:04.280 "claimed": false, 00:25:04.280 "zoned": false, 00:25:04.280 "supported_io_types": { 00:25:04.280 "read": true, 00:25:04.280 "write": true, 00:25:04.280 "unmap": false, 00:25:04.280 "write_zeroes": true, 00:25:04.280 "flush": true, 00:25:04.280 "reset": true, 00:25:04.280 "compare": true, 00:25:04.280 "compare_and_write": true, 00:25:04.280 "abort": true, 00:25:04.280 "nvme_admin": true, 00:25:04.280 "nvme_io": true 00:25:04.280 }, 00:25:04.280 "memory_domains": [ 00:25:04.280 { 00:25:04.280 "dma_device_id": "system", 00:25:04.280 "dma_device_type": 1 00:25:04.280 } 00:25:04.280 ], 00:25:04.280 "driver_specific": { 00:25:04.280 "nvme": [ 00:25:04.280 { 00:25:04.280 "trid": { 00:25:04.280 "trtype": "TCP", 00:25:04.280 "adrfam": "IPv4", 00:25:04.280 "traddr": "10.0.0.2", 00:25:04.280 "trsvcid": "4420", 00:25:04.280 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:04.280 }, 00:25:04.280 "ctrlr_data": { 00:25:04.280 "cntlid": 2, 00:25:04.280 "vendor_id": "0x8086", 00:25:04.280 "model_number": "SPDK bdev Controller", 00:25:04.280 "serial_number": "00000000000000000000", 00:25:04.280 "firmware_revision": "24.05", 00:25:04.280 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:04.280 "oacs": { 00:25:04.280 "security": 0, 00:25:04.280 "format": 0, 00:25:04.280 "firmware": 0, 00:25:04.280 "ns_manage": 0 00:25:04.280 }, 00:25:04.280 "multi_ctrlr": true, 00:25:04.280 "ana_reporting": false 00:25:04.280 }, 00:25:04.280 "vs": { 00:25:04.280 "nvme_version": "1.3" 00:25:04.280 }, 00:25:04.280 "ns_data": { 00:25:04.280 "id": 1, 00:25:04.280 "can_share": true 00:25:04.280 } 00:25:04.280 } 00:25:04.280 ], 00:25:04.280 "mp_policy": "active_passive" 00:25:04.280 } 00:25:04.280 } 00:25:04.280 ] 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@53 -- # mktemp 00:25:04.280 05:09:43 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.A6W7VWwbJs 00:25:04.280 05:09:43 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:04.280 05:09:43 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.A6W7VWwbJs 00:25:04.280 05:09:43 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 [2024-04-23 05:09:43.412693] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:04.280 [2024-04-23 05:09:43.412831] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.A6W7VWwbJs 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 [2024-04-23 05:09:43.420714] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:25:04.280 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.280 05:09:43 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.A6W7VWwbJs 00:25:04.280 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.280 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.280 [2024-04-23 05:09:43.428725] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:04.280 [2024-04-23 05:09:43.428780] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:25:04.541 nvme0n1 00:25:04.541 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.541 05:09:43 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:04.541 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.541 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.541 [ 00:25:04.541 { 00:25:04.541 "name": "nvme0n1", 00:25:04.541 "aliases": [ 00:25:04.541 "2d796569-6fa2-48f8-87ed-3334cc32d3d9" 00:25:04.541 ], 00:25:04.541 "product_name": "NVMe disk", 00:25:04.541 "block_size": 512, 00:25:04.541 "num_blocks": 2097152, 00:25:04.541 "uuid": "2d796569-6fa2-48f8-87ed-3334cc32d3d9", 00:25:04.541 "assigned_rate_limits": { 00:25:04.541 "rw_ios_per_sec": 0, 00:25:04.541 "rw_mbytes_per_sec": 0, 00:25:04.541 "r_mbytes_per_sec": 0, 00:25:04.541 "w_mbytes_per_sec": 0 00:25:04.541 }, 00:25:04.541 "claimed": false, 00:25:04.541 "zoned": false, 00:25:04.541 "supported_io_types": { 00:25:04.541 "read": true, 00:25:04.541 "write": true, 00:25:04.541 "unmap": false, 00:25:04.541 "write_zeroes": true, 00:25:04.541 "flush": true, 00:25:04.541 "reset": true, 00:25:04.541 "compare": true, 00:25:04.541 "compare_and_write": true, 00:25:04.541 "abort": true, 00:25:04.541 "nvme_admin": true, 00:25:04.541 "nvme_io": true 00:25:04.541 }, 00:25:04.541 "memory_domains": [ 00:25:04.541 { 00:25:04.541 "dma_device_id": "system", 00:25:04.541 "dma_device_type": 1 00:25:04.541 } 00:25:04.541 ], 00:25:04.541 "driver_specific": { 00:25:04.541 "nvme": [ 00:25:04.541 { 00:25:04.541 "trid": { 00:25:04.541 "trtype": "TCP", 00:25:04.541 "adrfam": "IPv4", 00:25:04.541 "traddr": "10.0.0.2", 00:25:04.541 "trsvcid": "4421", 00:25:04.541 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:04.541 }, 00:25:04.541 "ctrlr_data": { 00:25:04.541 "cntlid": 3, 00:25:04.541 "vendor_id": "0x8086", 00:25:04.541 "model_number": "SPDK bdev Controller", 00:25:04.541 "serial_number": "00000000000000000000", 00:25:04.541 "firmware_revision": "24.05", 00:25:04.541 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:04.541 "oacs": { 00:25:04.541 "security": 0, 00:25:04.541 "format": 0, 00:25:04.541 "firmware": 0, 00:25:04.541 "ns_manage": 0 00:25:04.541 }, 00:25:04.541 "multi_ctrlr": true, 00:25:04.541 "ana_reporting": false 00:25:04.541 }, 00:25:04.541 "vs": { 00:25:04.541 "nvme_version": "1.3" 00:25:04.541 }, 00:25:04.541 "ns_data": { 00:25:04.541 "id": 1, 00:25:04.541 "can_share": true 00:25:04.541 } 00:25:04.541 } 00:25:04.541 ], 00:25:04.541 "mp_policy": "active_passive" 00:25:04.541 } 00:25:04.541 } 00:25:04.541 ] 00:25:04.541 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.541 05:09:43 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:04.541 05:09:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.541 05:09:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.541 05:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.541 05:09:43 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.A6W7VWwbJs 00:25:04.541 05:09:43 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:04.541 05:09:43 -- host/async_init.sh@78 -- # nvmftestfini 00:25:04.541 05:09:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:04.541 05:09:43 -- nvmf/common.sh@117 -- # sync 00:25:04.541 05:09:43 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:25:04.541 05:09:43 -- nvmf/common.sh@120 -- # set +e 00:25:04.541 05:09:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:04.541 05:09:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:25:04.541 rmmod nvme_tcp 00:25:04.541 rmmod nvme_fabrics 00:25:04.541 rmmod nvme_keyring 00:25:04.541 05:09:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:04.541 05:09:43 -- nvmf/common.sh@124 -- # set -e 00:25:04.541 05:09:43 -- nvmf/common.sh@125 -- # return 0 00:25:04.541 05:09:43 -- nvmf/common.sh@478 -- # '[' -n 2469818 ']' 00:25:04.541 05:09:43 -- nvmf/common.sh@479 -- # killprocess 2469818 00:25:04.541 05:09:43 -- common/autotest_common.sh@936 -- # '[' -z 2469818 ']' 00:25:04.541 05:09:43 -- common/autotest_common.sh@940 -- # kill -0 2469818 00:25:04.541 05:09:43 -- common/autotest_common.sh@941 -- # uname 00:25:04.541 05:09:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:04.541 05:09:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2469818 00:25:04.541 05:09:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:04.541 05:09:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:04.541 05:09:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2469818' 00:25:04.541 killing process with pid 2469818 00:25:04.541 05:09:43 -- common/autotest_common.sh@955 -- # kill 2469818 00:25:04.541 [2024-04-23 05:09:43.615332] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:25:04.541 [2024-04-23 05:09:43.615365] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:25:04.541 05:09:43 -- common/autotest_common.sh@960 -- # wait 2469818 00:25:04.801 05:09:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:04.801 05:09:43 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:25:04.801 05:09:43 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:25:04.801 05:09:43 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:04.801 05:09:43 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:25:04.801 05:09:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:04.801 05:09:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:04.801 05:09:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.706 05:09:45 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:25:06.706 00:25:06.706 real 0m5.294s 00:25:06.706 user 0m1.958s 00:25:06.706 sys 0m1.705s 00:25:06.706 05:09:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:06.706 05:09:45 -- common/autotest_common.sh@10 -- # set +x 00:25:06.706 ************************************ 00:25:06.706 END TEST nvmf_async_init 00:25:06.706 ************************************ 00:25:06.965 05:09:45 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:06.965 05:09:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:06.965 05:09:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:06.965 05:09:45 -- common/autotest_common.sh@10 -- # set +x 00:25:06.965 ************************************ 00:25:06.965 START TEST dma 00:25:06.965 ************************************ 00:25:06.965 05:09:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:06.965 * Looking for test storage... 00:25:06.965 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:06.965 05:09:46 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:06.965 05:09:46 -- nvmf/common.sh@7 -- # uname -s 00:25:06.965 05:09:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:06.965 05:09:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:06.965 05:09:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:06.965 05:09:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:06.965 05:09:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:06.965 05:09:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:06.965 05:09:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:06.965 05:09:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:06.965 05:09:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:06.965 05:09:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:06.965 05:09:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:06.965 05:09:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:06.965 05:09:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:06.965 05:09:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:06.965 05:09:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:06.965 05:09:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:06.965 05:09:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:06.965 05:09:46 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:06.965 05:09:46 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:06.965 05:09:46 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:06.965 05:09:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.965 05:09:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.965 05:09:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.965 05:09:46 -- paths/export.sh@5 -- # export PATH 00:25:06.965 05:09:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.965 05:09:46 -- nvmf/common.sh@47 -- # : 0 00:25:06.965 05:09:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:06.965 05:09:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:06.965 05:09:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:06.965 05:09:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:06.965 05:09:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:06.965 05:09:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:06.965 05:09:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:06.965 05:09:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:06.965 05:09:46 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:06.965 05:09:46 -- host/dma.sh@13 -- # exit 0 00:25:06.965 00:25:06.965 real 0m0.063s 00:25:06.965 user 0m0.032s 00:25:06.965 sys 0m0.036s 00:25:06.965 05:09:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:06.965 05:09:46 -- common/autotest_common.sh@10 -- # set +x 00:25:06.965 ************************************ 00:25:06.965 END TEST dma 00:25:06.965 ************************************ 00:25:06.965 05:09:46 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:06.965 05:09:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:06.965 05:09:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:06.965 05:09:46 -- common/autotest_common.sh@10 -- # set +x 00:25:07.224 ************************************ 00:25:07.224 START TEST nvmf_identify 00:25:07.224 ************************************ 00:25:07.224 05:09:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:07.224 * Looking for test storage... 00:25:07.224 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:07.224 05:09:46 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:07.224 05:09:46 -- nvmf/common.sh@7 -- # uname -s 00:25:07.224 05:09:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:07.224 05:09:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:07.224 05:09:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:07.224 05:09:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:07.224 05:09:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:07.224 05:09:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:07.224 05:09:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:07.224 05:09:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:07.224 05:09:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:07.224 05:09:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:07.224 05:09:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:07.224 05:09:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:07.224 05:09:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:07.224 05:09:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:07.224 05:09:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:07.224 05:09:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:07.224 05:09:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:07.224 05:09:46 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:07.224 05:09:46 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:07.224 05:09:46 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:07.225 05:09:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:07.225 05:09:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:07.225 05:09:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:07.225 05:09:46 -- paths/export.sh@5 -- # export PATH 00:25:07.225 05:09:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:07.225 05:09:46 -- nvmf/common.sh@47 -- # : 0 00:25:07.225 05:09:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:07.225 05:09:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:07.225 05:09:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:07.225 05:09:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:07.225 05:09:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:07.225 05:09:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:07.225 05:09:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:07.225 05:09:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:07.225 05:09:46 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:07.225 05:09:46 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:07.225 05:09:46 -- host/identify.sh@14 -- # nvmftestinit 00:25:07.225 05:09:46 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:25:07.225 05:09:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:07.225 05:09:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:07.225 05:09:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:07.225 05:09:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:07.225 05:09:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:07.225 05:09:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:07.225 05:09:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:07.225 05:09:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:07.225 05:09:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:07.225 05:09:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:07.225 05:09:46 -- common/autotest_common.sh@10 -- # set +x 00:25:09.132 05:09:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:09.132 05:09:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:09.132 05:09:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:09.132 05:09:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:09.132 05:09:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:09.132 05:09:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:09.132 05:09:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:09.132 05:09:48 -- nvmf/common.sh@295 -- # net_devs=() 00:25:09.132 05:09:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:09.132 05:09:48 -- nvmf/common.sh@296 -- # e810=() 00:25:09.132 05:09:48 -- nvmf/common.sh@296 -- # local -ga e810 00:25:09.132 05:09:48 -- nvmf/common.sh@297 -- # x722=() 00:25:09.132 05:09:48 -- nvmf/common.sh@297 -- # local -ga x722 00:25:09.132 05:09:48 -- nvmf/common.sh@298 -- # mlx=() 00:25:09.132 05:09:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:09.132 05:09:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:09.132 05:09:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:09.132 05:09:48 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:25:09.132 05:09:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:09.132 05:09:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:09.132 05:09:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:09.132 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:09.132 05:09:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:09.132 05:09:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:09.132 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:09.132 05:09:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:09.132 05:09:48 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:25:09.133 05:09:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:09.133 05:09:48 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:25:09.133 05:09:48 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:25:09.133 05:09:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:09.133 05:09:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:09.133 05:09:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:09.133 05:09:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:09.133 05:09:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:09.133 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:09.133 05:09:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:09.133 05:09:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:09.133 05:09:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:09.133 05:09:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:09.133 05:09:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:09.133 05:09:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:09.133 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:09.133 05:09:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:09.133 05:09:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:09.133 05:09:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:09.133 05:09:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:09.133 05:09:48 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:25:09.133 05:09:48 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:25:09.133 05:09:48 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:09.133 05:09:48 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:09.133 05:09:48 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:09.133 05:09:48 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:25:09.133 05:09:48 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:09.133 05:09:48 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:09.133 05:09:48 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:25:09.133 05:09:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:09.133 05:09:48 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:09.133 05:09:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:25:09.133 05:09:48 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:25:09.133 05:09:48 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:25:09.133 05:09:48 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:09.133 05:09:48 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:09.133 05:09:48 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:09.133 05:09:48 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:25:09.133 05:09:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:09.133 05:09:48 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:09.133 05:09:48 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:09.133 05:09:48 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:25:09.133 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:09.133 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.142 ms 00:25:09.133 00:25:09.133 --- 10.0.0.2 ping statistics --- 00:25:09.133 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:09.133 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:25:09.133 05:09:48 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:09.133 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:09.133 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.217 ms 00:25:09.133 00:25:09.133 --- 10.0.0.1 ping statistics --- 00:25:09.133 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:09.133 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:25:09.133 05:09:48 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:09.133 05:09:48 -- nvmf/common.sh@411 -- # return 0 00:25:09.133 05:09:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:09.133 05:09:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:09.133 05:09:48 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:25:09.133 05:09:48 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:25:09.133 05:09:48 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:09.133 05:09:48 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:25:09.133 05:09:48 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:25:09.133 05:09:48 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:09.133 05:09:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:09.133 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.133 05:09:48 -- host/identify.sh@19 -- # nvmfpid=2471961 00:25:09.133 05:09:48 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:09.133 05:09:48 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:09.133 05:09:48 -- host/identify.sh@23 -- # waitforlisten 2471961 00:25:09.133 05:09:48 -- common/autotest_common.sh@817 -- # '[' -z 2471961 ']' 00:25:09.133 05:09:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:09.133 05:09:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:25:09.133 05:09:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:09.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:09.133 05:09:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:25:09.133 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.392 [2024-04-23 05:09:48.335000] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:25:09.392 [2024-04-23 05:09:48.335087] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:09.392 EAL: No free 2048 kB hugepages reported on node 1 00:25:09.392 [2024-04-23 05:09:48.373792] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:25:09.392 [2024-04-23 05:09:48.406024] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:09.392 [2024-04-23 05:09:48.495600] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:09.392 [2024-04-23 05:09:48.495663] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:09.392 [2024-04-23 05:09:48.495688] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:09.392 [2024-04-23 05:09:48.495702] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:09.392 [2024-04-23 05:09:48.495714] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:09.392 [2024-04-23 05:09:48.495798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:09.392 [2024-04-23 05:09:48.495854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:09.392 [2024-04-23 05:09:48.495914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:09.392 [2024-04-23 05:09:48.495917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:09.653 05:09:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:25:09.653 05:09:48 -- common/autotest_common.sh@850 -- # return 0 00:25:09.653 05:09:48 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:09.653 05:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.653 [2024-04-23 05:09:48.620037] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:09.653 05:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:09.653 05:09:48 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:09.653 05:09:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.653 05:09:48 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:09.653 05:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.653 Malloc0 00:25:09.653 05:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:09.653 05:09:48 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:09.653 05:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.653 05:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:09.653 05:09:48 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:09.653 05:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.653 05:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:09.653 05:09:48 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:09.653 05:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.653 [2024-04-23 05:09:48.696412] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:09.653 05:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:09.653 05:09:48 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:09.653 05:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.653 05:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:09.653 05:09:48 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:09.653 05:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:09.653 05:09:48 -- common/autotest_common.sh@10 -- # set +x 00:25:09.654 [2024-04-23 05:09:48.712155] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:09.654 [ 00:25:09.654 { 00:25:09.654 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:09.654 "subtype": "Discovery", 00:25:09.654 "listen_addresses": [ 00:25:09.654 { 00:25:09.654 "transport": "TCP", 00:25:09.654 "trtype": "TCP", 00:25:09.654 "adrfam": "IPv4", 00:25:09.654 "traddr": "10.0.0.2", 00:25:09.654 "trsvcid": "4420" 00:25:09.654 } 00:25:09.654 ], 00:25:09.654 "allow_any_host": true, 00:25:09.654 "hosts": [] 00:25:09.654 }, 00:25:09.654 { 00:25:09.654 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:09.654 "subtype": "NVMe", 00:25:09.654 "listen_addresses": [ 00:25:09.654 { 00:25:09.654 "transport": "TCP", 00:25:09.654 "trtype": "TCP", 00:25:09.654 "adrfam": "IPv4", 00:25:09.654 "traddr": "10.0.0.2", 00:25:09.654 "trsvcid": "4420" 00:25:09.654 } 00:25:09.654 ], 00:25:09.654 "allow_any_host": true, 00:25:09.654 "hosts": [], 00:25:09.654 "serial_number": "SPDK00000000000001", 00:25:09.654 "model_number": "SPDK bdev Controller", 00:25:09.654 "max_namespaces": 32, 00:25:09.654 "min_cntlid": 1, 00:25:09.654 "max_cntlid": 65519, 00:25:09.654 "namespaces": [ 00:25:09.654 { 00:25:09.654 "nsid": 1, 00:25:09.654 "bdev_name": "Malloc0", 00:25:09.654 "name": "Malloc0", 00:25:09.654 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:09.654 "eui64": "ABCDEF0123456789", 00:25:09.654 "uuid": "c8c0e846-8472-4e85-9d99-27a663dce743" 00:25:09.654 } 00:25:09.654 ] 00:25:09.654 } 00:25:09.654 ] 00:25:09.654 05:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:09.654 05:09:48 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:09.654 [2024-04-23 05:09:48.738057] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:25:09.654 [2024-04-23 05:09:48.738107] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2472098 ] 00:25:09.654 EAL: No free 2048 kB hugepages reported on node 1 00:25:09.654 [2024-04-23 05:09:48.758315] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:25:09.654 [2024-04-23 05:09:48.776132] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:09.654 [2024-04-23 05:09:48.776191] nvme_tcp.c:2326:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:09.654 [2024-04-23 05:09:48.776200] nvme_tcp.c:2330:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:09.654 [2024-04-23 05:09:48.776215] nvme_tcp.c:2348:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:09.654 [2024-04-23 05:09:48.776228] sock.c: 336:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:09.654 [2024-04-23 05:09:48.776506] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:09.654 [2024-04-23 05:09:48.776582] nvme_tcp.c:1543:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1f0b130 0 00:25:09.654 [2024-04-23 05:09:48.782532] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:09.654 [2024-04-23 05:09:48.782555] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:09.654 [2024-04-23 05:09:48.782565] nvme_tcp.c:1589:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:09.654 [2024-04-23 05:09:48.782571] nvme_tcp.c:1590:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:09.654 [2024-04-23 05:09:48.782624] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.782637] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.782645] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.654 [2024-04-23 05:09:48.782665] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:09.654 [2024-04-23 05:09:48.782692] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.654 [2024-04-23 05:09:48.789528] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.654 [2024-04-23 05:09:48.789548] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.654 [2024-04-23 05:09:48.789556] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.789565] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.654 [2024-04-23 05:09:48.789585] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:09.654 [2024-04-23 05:09:48.789596] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:09.654 [2024-04-23 05:09:48.789606] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:09.654 [2024-04-23 05:09:48.789629] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.789637] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.789644] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.654 [2024-04-23 05:09:48.789656] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.654 [2024-04-23 05:09:48.789680] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.654 [2024-04-23 05:09:48.789818] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.654 [2024-04-23 05:09:48.789830] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.654 [2024-04-23 05:09:48.789837] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.789850] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.654 [2024-04-23 05:09:48.789863] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:09.654 [2024-04-23 05:09:48.789876] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:09.654 [2024-04-23 05:09:48.789889] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.789897] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.789903] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.654 [2024-04-23 05:09:48.789914] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.654 [2024-04-23 05:09:48.789935] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.654 [2024-04-23 05:09:48.790052] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.654 [2024-04-23 05:09:48.790063] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.654 [2024-04-23 05:09:48.790070] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790077] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.654 [2024-04-23 05:09:48.790088] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:09.654 [2024-04-23 05:09:48.790102] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:09.654 [2024-04-23 05:09:48.790114] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790121] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790128] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.654 [2024-04-23 05:09:48.790138] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.654 [2024-04-23 05:09:48.790158] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.654 [2024-04-23 05:09:48.790266] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.654 [2024-04-23 05:09:48.790278] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.654 [2024-04-23 05:09:48.790285] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790292] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.654 [2024-04-23 05:09:48.790302] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:09.654 [2024-04-23 05:09:48.790319] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790328] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790334] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.654 [2024-04-23 05:09:48.790345] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.654 [2024-04-23 05:09:48.790365] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.654 [2024-04-23 05:09:48.790481] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.654 [2024-04-23 05:09:48.790496] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.654 [2024-04-23 05:09:48.790503] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790509] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.654 [2024-04-23 05:09:48.790532] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:09.654 [2024-04-23 05:09:48.790546] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:09.654 [2024-04-23 05:09:48.790560] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:09.654 [2024-04-23 05:09:48.790671] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:09.654 [2024-04-23 05:09:48.790679] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:09.654 [2024-04-23 05:09:48.790694] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790702] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.654 [2024-04-23 05:09:48.790708] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.654 [2024-04-23 05:09:48.790719] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.654 [2024-04-23 05:09:48.790740] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.654 [2024-04-23 05:09:48.790885] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.655 [2024-04-23 05:09:48.790897] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.655 [2024-04-23 05:09:48.790904] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.790911] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.655 [2024-04-23 05:09:48.790921] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:09.655 [2024-04-23 05:09:48.790937] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.790946] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.790952] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.655 [2024-04-23 05:09:48.790963] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.655 [2024-04-23 05:09:48.790984] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.655 [2024-04-23 05:09:48.791099] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.655 [2024-04-23 05:09:48.791111] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.655 [2024-04-23 05:09:48.791118] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.791125] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.655 [2024-04-23 05:09:48.791135] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:09.655 [2024-04-23 05:09:48.791143] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:09.655 [2024-04-23 05:09:48.791156] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:09.655 [2024-04-23 05:09:48.791171] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:09.655 [2024-04-23 05:09:48.791189] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.791197] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.655 [2024-04-23 05:09:48.791208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.655 [2024-04-23 05:09:48.791232] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.655 [2024-04-23 05:09:48.791387] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.655 [2024-04-23 05:09:48.791399] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.655 [2024-04-23 05:09:48.791406] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.791413] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f0b130): datao=0, datal=4096, cccid=0 00:25:09.655 [2024-04-23 05:09:48.791421] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1f73860) on tqpair(0x1f0b130): expected_datao=0, payload_size=4096 00:25:09.655 [2024-04-23 05:09:48.791430] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.791448] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.655 [2024-04-23 05:09:48.791458] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.920 [2024-04-23 05:09:48.836528] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.920 [2024-04-23 05:09:48.836549] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.920 [2024-04-23 05:09:48.836557] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.920 [2024-04-23 05:09:48.836564] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.920 [2024-04-23 05:09:48.836579] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:09.920 [2024-04-23 05:09:48.836589] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:09.920 [2024-04-23 05:09:48.836598] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:09.920 [2024-04-23 05:09:48.836606] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:09.920 [2024-04-23 05:09:48.836615] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:09.920 [2024-04-23 05:09:48.836622] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:09.920 [2024-04-23 05:09:48.836638] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:09.920 [2024-04-23 05:09:48.836651] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.920 [2024-04-23 05:09:48.836659] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836665] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.836677] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:09.921 [2024-04-23 05:09:48.836700] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.921 [2024-04-23 05:09:48.836851] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.921 [2024-04-23 05:09:48.836866] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.921 [2024-04-23 05:09:48.836873] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836880] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73860) on tqpair=0x1f0b130 00:25:09.921 [2024-04-23 05:09:48.836896] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836904] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836910] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.836920] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.921 [2024-04-23 05:09:48.836930] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836942] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836949] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.836958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.921 [2024-04-23 05:09:48.836968] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836975] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.836981] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.836990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.921 [2024-04-23 05:09:48.836999] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837006] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837012] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.837036] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.921 [2024-04-23 05:09:48.837044] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:09.921 [2024-04-23 05:09:48.837065] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:09.921 [2024-04-23 05:09:48.837077] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837084] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.837094] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.921 [2024-04-23 05:09:48.837131] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73860, cid 0, qid 0 00:25:09.921 [2024-04-23 05:09:48.837141] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f739c0, cid 1, qid 0 00:25:09.921 [2024-04-23 05:09:48.837149] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73b20, cid 2, qid 0 00:25:09.921 [2024-04-23 05:09:48.837156] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73c80, cid 3, qid 0 00:25:09.921 [2024-04-23 05:09:48.837163] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73de0, cid 4, qid 0 00:25:09.921 [2024-04-23 05:09:48.837381] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.921 [2024-04-23 05:09:48.837393] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.921 [2024-04-23 05:09:48.837400] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837407] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73de0) on tqpair=0x1f0b130 00:25:09.921 [2024-04-23 05:09:48.837418] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:09.921 [2024-04-23 05:09:48.837427] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:09.921 [2024-04-23 05:09:48.837445] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837454] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.837464] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.921 [2024-04-23 05:09:48.837485] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73de0, cid 4, qid 0 00:25:09.921 [2024-04-23 05:09:48.837633] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.921 [2024-04-23 05:09:48.837647] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.921 [2024-04-23 05:09:48.837658] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837665] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f0b130): datao=0, datal=4096, cccid=4 00:25:09.921 [2024-04-23 05:09:48.837673] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1f73de0) on tqpair(0x1f0b130): expected_datao=0, payload_size=4096 00:25:09.921 [2024-04-23 05:09:48.837680] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837691] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837699] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837710] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.921 [2024-04-23 05:09:48.837720] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.921 [2024-04-23 05:09:48.837727] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837734] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73de0) on tqpair=0x1f0b130 00:25:09.921 [2024-04-23 05:09:48.837755] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:09.921 [2024-04-23 05:09:48.837791] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837800] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.837811] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.921 [2024-04-23 05:09:48.837823] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837830] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.837836] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.837845] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.921 [2024-04-23 05:09:48.837874] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73de0, cid 4, qid 0 00:25:09.921 [2024-04-23 05:09:48.837886] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73f40, cid 5, qid 0 00:25:09.921 [2024-04-23 05:09:48.838036] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.921 [2024-04-23 05:09:48.838052] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.921 [2024-04-23 05:09:48.838058] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.838065] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f0b130): datao=0, datal=1024, cccid=4 00:25:09.921 [2024-04-23 05:09:48.838072] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1f73de0) on tqpair(0x1f0b130): expected_datao=0, payload_size=1024 00:25:09.921 [2024-04-23 05:09:48.838080] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.838090] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.838097] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.838106] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.921 [2024-04-23 05:09:48.838115] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.921 [2024-04-23 05:09:48.838121] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.838128] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73f40) on tqpair=0x1f0b130 00:25:09.921 [2024-04-23 05:09:48.878682] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.921 [2024-04-23 05:09:48.878701] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.921 [2024-04-23 05:09:48.878709] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.878716] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73de0) on tqpair=0x1f0b130 00:25:09.921 [2024-04-23 05:09:48.878746] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.878758] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.878769] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.921 [2024-04-23 05:09:48.878799] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73de0, cid 4, qid 0 00:25:09.921 [2024-04-23 05:09:48.878926] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.921 [2024-04-23 05:09:48.878942] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.921 [2024-04-23 05:09:48.878949] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.878955] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f0b130): datao=0, datal=3072, cccid=4 00:25:09.921 [2024-04-23 05:09:48.878963] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1f73de0) on tqpair(0x1f0b130): expected_datao=0, payload_size=3072 00:25:09.921 [2024-04-23 05:09:48.878971] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.878981] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.878989] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.879001] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.921 [2024-04-23 05:09:48.879011] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.921 [2024-04-23 05:09:48.879018] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.879025] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73de0) on tqpair=0x1f0b130 00:25:09.921 [2024-04-23 05:09:48.879040] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.921 [2024-04-23 05:09:48.879049] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f0b130) 00:25:09.921 [2024-04-23 05:09:48.879060] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.921 [2024-04-23 05:09:48.879087] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73de0, cid 4, qid 0 00:25:09.921 [2024-04-23 05:09:48.879218] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.922 [2024-04-23 05:09:48.879230] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.922 [2024-04-23 05:09:48.879237] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.922 [2024-04-23 05:09:48.879243] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f0b130): datao=0, datal=8, cccid=4 00:25:09.922 [2024-04-23 05:09:48.879251] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1f73de0) on tqpair(0x1f0b130): expected_datao=0, payload_size=8 00:25:09.922 [2024-04-23 05:09:48.879259] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.922 [2024-04-23 05:09:48.879268] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.922 [2024-04-23 05:09:48.879276] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.922 [2024-04-23 05:09:48.922538] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.922 [2024-04-23 05:09:48.922556] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.922 [2024-04-23 05:09:48.922578] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.922 [2024-04-23 05:09:48.922585] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73de0) on tqpair=0x1f0b130 00:25:09.922 ===================================================== 00:25:09.922 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:09.922 ===================================================== 00:25:09.922 Controller Capabilities/Features 00:25:09.922 ================================ 00:25:09.922 Vendor ID: 0000 00:25:09.922 Subsystem Vendor ID: 0000 00:25:09.922 Serial Number: .................... 00:25:09.922 Model Number: ........................................ 00:25:09.922 Firmware Version: 24.05 00:25:09.922 Recommended Arb Burst: 0 00:25:09.922 IEEE OUI Identifier: 00 00 00 00:25:09.922 Multi-path I/O 00:25:09.922 May have multiple subsystem ports: No 00:25:09.922 May have multiple controllers: No 00:25:09.922 Associated with SR-IOV VF: No 00:25:09.922 Max Data Transfer Size: 131072 00:25:09.922 Max Number of Namespaces: 0 00:25:09.922 Max Number of I/O Queues: 1024 00:25:09.922 NVMe Specification Version (VS): 1.3 00:25:09.922 NVMe Specification Version (Identify): 1.3 00:25:09.922 Maximum Queue Entries: 128 00:25:09.922 Contiguous Queues Required: Yes 00:25:09.922 Arbitration Mechanisms Supported 00:25:09.922 Weighted Round Robin: Not Supported 00:25:09.922 Vendor Specific: Not Supported 00:25:09.922 Reset Timeout: 15000 ms 00:25:09.922 Doorbell Stride: 4 bytes 00:25:09.922 NVM Subsystem Reset: Not Supported 00:25:09.922 Command Sets Supported 00:25:09.922 NVM Command Set: Supported 00:25:09.922 Boot Partition: Not Supported 00:25:09.922 Memory Page Size Minimum: 4096 bytes 00:25:09.922 Memory Page Size Maximum: 4096 bytes 00:25:09.922 Persistent Memory Region: Not Supported 00:25:09.922 Optional Asynchronous Events Supported 00:25:09.922 Namespace Attribute Notices: Not Supported 00:25:09.922 Firmware Activation Notices: Not Supported 00:25:09.922 ANA Change Notices: Not Supported 00:25:09.922 PLE Aggregate Log Change Notices: Not Supported 00:25:09.922 LBA Status Info Alert Notices: Not Supported 00:25:09.922 EGE Aggregate Log Change Notices: Not Supported 00:25:09.922 Normal NVM Subsystem Shutdown event: Not Supported 00:25:09.922 Zone Descriptor Change Notices: Not Supported 00:25:09.922 Discovery Log Change Notices: Supported 00:25:09.922 Controller Attributes 00:25:09.922 128-bit Host Identifier: Not Supported 00:25:09.922 Non-Operational Permissive Mode: Not Supported 00:25:09.922 NVM Sets: Not Supported 00:25:09.922 Read Recovery Levels: Not Supported 00:25:09.922 Endurance Groups: Not Supported 00:25:09.922 Predictable Latency Mode: Not Supported 00:25:09.922 Traffic Based Keep ALive: Not Supported 00:25:09.922 Namespace Granularity: Not Supported 00:25:09.922 SQ Associations: Not Supported 00:25:09.922 UUID List: Not Supported 00:25:09.922 Multi-Domain Subsystem: Not Supported 00:25:09.922 Fixed Capacity Management: Not Supported 00:25:09.922 Variable Capacity Management: Not Supported 00:25:09.922 Delete Endurance Group: Not Supported 00:25:09.922 Delete NVM Set: Not Supported 00:25:09.922 Extended LBA Formats Supported: Not Supported 00:25:09.922 Flexible Data Placement Supported: Not Supported 00:25:09.922 00:25:09.922 Controller Memory Buffer Support 00:25:09.922 ================================ 00:25:09.922 Supported: No 00:25:09.922 00:25:09.922 Persistent Memory Region Support 00:25:09.922 ================================ 00:25:09.922 Supported: No 00:25:09.922 00:25:09.922 Admin Command Set Attributes 00:25:09.922 ============================ 00:25:09.922 Security Send/Receive: Not Supported 00:25:09.922 Format NVM: Not Supported 00:25:09.922 Firmware Activate/Download: Not Supported 00:25:09.922 Namespace Management: Not Supported 00:25:09.922 Device Self-Test: Not Supported 00:25:09.922 Directives: Not Supported 00:25:09.922 NVMe-MI: Not Supported 00:25:09.922 Virtualization Management: Not Supported 00:25:09.922 Doorbell Buffer Config: Not Supported 00:25:09.922 Get LBA Status Capability: Not Supported 00:25:09.922 Command & Feature Lockdown Capability: Not Supported 00:25:09.922 Abort Command Limit: 1 00:25:09.922 Async Event Request Limit: 4 00:25:09.922 Number of Firmware Slots: N/A 00:25:09.922 Firmware Slot 1 Read-Only: N/A 00:25:09.922 Firmware Activation Without Reset: N/A 00:25:09.922 Multiple Update Detection Support: N/A 00:25:09.922 Firmware Update Granularity: No Information Provided 00:25:09.922 Per-Namespace SMART Log: No 00:25:09.922 Asymmetric Namespace Access Log Page: Not Supported 00:25:09.922 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:09.922 Command Effects Log Page: Not Supported 00:25:09.922 Get Log Page Extended Data: Supported 00:25:09.922 Telemetry Log Pages: Not Supported 00:25:09.922 Persistent Event Log Pages: Not Supported 00:25:09.922 Supported Log Pages Log Page: May Support 00:25:09.922 Commands Supported & Effects Log Page: Not Supported 00:25:09.922 Feature Identifiers & Effects Log Page:May Support 00:25:09.922 NVMe-MI Commands & Effects Log Page: May Support 00:25:09.922 Data Area 4 for Telemetry Log: Not Supported 00:25:09.922 Error Log Page Entries Supported: 128 00:25:09.922 Keep Alive: Not Supported 00:25:09.922 00:25:09.922 NVM Command Set Attributes 00:25:09.922 ========================== 00:25:09.922 Submission Queue Entry Size 00:25:09.922 Max: 1 00:25:09.922 Min: 1 00:25:09.922 Completion Queue Entry Size 00:25:09.922 Max: 1 00:25:09.922 Min: 1 00:25:09.922 Number of Namespaces: 0 00:25:09.922 Compare Command: Not Supported 00:25:09.922 Write Uncorrectable Command: Not Supported 00:25:09.922 Dataset Management Command: Not Supported 00:25:09.922 Write Zeroes Command: Not Supported 00:25:09.922 Set Features Save Field: Not Supported 00:25:09.922 Reservations: Not Supported 00:25:09.922 Timestamp: Not Supported 00:25:09.922 Copy: Not Supported 00:25:09.922 Volatile Write Cache: Not Present 00:25:09.922 Atomic Write Unit (Normal): 1 00:25:09.922 Atomic Write Unit (PFail): 1 00:25:09.922 Atomic Compare & Write Unit: 1 00:25:09.922 Fused Compare & Write: Supported 00:25:09.922 Scatter-Gather List 00:25:09.922 SGL Command Set: Supported 00:25:09.922 SGL Keyed: Supported 00:25:09.922 SGL Bit Bucket Descriptor: Not Supported 00:25:09.922 SGL Metadata Pointer: Not Supported 00:25:09.922 Oversized SGL: Not Supported 00:25:09.922 SGL Metadata Address: Not Supported 00:25:09.922 SGL Offset: Supported 00:25:09.922 Transport SGL Data Block: Not Supported 00:25:09.922 Replay Protected Memory Block: Not Supported 00:25:09.922 00:25:09.922 Firmware Slot Information 00:25:09.922 ========================= 00:25:09.922 Active slot: 0 00:25:09.922 00:25:09.922 00:25:09.922 Error Log 00:25:09.922 ========= 00:25:09.922 00:25:09.922 Active Namespaces 00:25:09.922 ================= 00:25:09.922 Discovery Log Page 00:25:09.922 ================== 00:25:09.922 Generation Counter: 2 00:25:09.922 Number of Records: 2 00:25:09.922 Record Format: 0 00:25:09.922 00:25:09.922 Discovery Log Entry 0 00:25:09.922 ---------------------- 00:25:09.922 Transport Type: 3 (TCP) 00:25:09.922 Address Family: 1 (IPv4) 00:25:09.922 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:09.922 Entry Flags: 00:25:09.922 Duplicate Returned Information: 1 00:25:09.922 Explicit Persistent Connection Support for Discovery: 1 00:25:09.922 Transport Requirements: 00:25:09.922 Secure Channel: Not Required 00:25:09.922 Port ID: 0 (0x0000) 00:25:09.922 Controller ID: 65535 (0xffff) 00:25:09.922 Admin Max SQ Size: 128 00:25:09.922 Transport Service Identifier: 4420 00:25:09.922 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:09.922 Transport Address: 10.0.0.2 00:25:09.922 Discovery Log Entry 1 00:25:09.923 ---------------------- 00:25:09.923 Transport Type: 3 (TCP) 00:25:09.923 Address Family: 1 (IPv4) 00:25:09.923 Subsystem Type: 2 (NVM Subsystem) 00:25:09.923 Entry Flags: 00:25:09.923 Duplicate Returned Information: 0 00:25:09.923 Explicit Persistent Connection Support for Discovery: 0 00:25:09.923 Transport Requirements: 00:25:09.923 Secure Channel: Not Required 00:25:09.923 Port ID: 0 (0x0000) 00:25:09.923 Controller ID: 65535 (0xffff) 00:25:09.923 Admin Max SQ Size: 128 00:25:09.923 Transport Service Identifier: 4420 00:25:09.923 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:09.923 Transport Address: 10.0.0.2 [2024-04-23 05:09:48.922711] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:09.923 [2024-04-23 05:09:48.922739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.923 [2024-04-23 05:09:48.922752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.923 [2024-04-23 05:09:48.922765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.923 [2024-04-23 05:09:48.922775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.923 [2024-04-23 05:09:48.922789] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.922797] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.922804] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f0b130) 00:25:09.923 [2024-04-23 05:09:48.922815] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.923 [2024-04-23 05:09:48.922841] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73c80, cid 3, qid 0 00:25:09.923 [2024-04-23 05:09:48.922940] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.923 [2024-04-23 05:09:48.922955] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.923 [2024-04-23 05:09:48.922962] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.922969] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73c80) on tqpair=0x1f0b130 00:25:09.923 [2024-04-23 05:09:48.922984] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.922991] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.922998] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f0b130) 00:25:09.923 [2024-04-23 05:09:48.923008] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.923 [2024-04-23 05:09:48.923034] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73c80, cid 3, qid 0 00:25:09.923 [2024-04-23 05:09:48.926527] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.923 [2024-04-23 05:09:48.926544] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.923 [2024-04-23 05:09:48.926551] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.926558] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73c80) on tqpair=0x1f0b130 00:25:09.923 [2024-04-23 05:09:48.926567] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:09.923 [2024-04-23 05:09:48.926576] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:09.923 [2024-04-23 05:09:48.926593] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.926602] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.926609] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f0b130) 00:25:09.923 [2024-04-23 05:09:48.926619] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.923 [2024-04-23 05:09:48.926641] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1f73c80, cid 3, qid 0 00:25:09.923 [2024-04-23 05:09:48.926795] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.923 [2024-04-23 05:09:48.926807] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.923 [2024-04-23 05:09:48.926814] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:48.926820] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1f73c80) on tqpair=0x1f0b130 00:25:09.923 [2024-04-23 05:09:48.926836] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 0 milliseconds 00:25:09.923 00:25:09.923 05:09:48 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:09.923 [2024-04-23 05:09:48.961144] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:25:09.923 [2024-04-23 05:09:48.961191] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2472105 ] 00:25:09.923 EAL: No free 2048 kB hugepages reported on node 1 00:25:09.923 [2024-04-23 05:09:48.979835] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:25:09.923 [2024-04-23 05:09:48.998682] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:09.923 [2024-04-23 05:09:48.998723] nvme_tcp.c:2326:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:09.923 [2024-04-23 05:09:48.998733] nvme_tcp.c:2330:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:09.923 [2024-04-23 05:09:48.998747] nvme_tcp.c:2348:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:09.923 [2024-04-23 05:09:48.998759] sock.c: 336:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:09.923 [2024-04-23 05:09:48.999002] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:09.923 [2024-04-23 05:09:48.999043] nvme_tcp.c:1543:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x16fb130 0 00:25:09.923 [2024-04-23 05:09:49.009533] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:09.923 [2024-04-23 05:09:49.009552] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:09.923 [2024-04-23 05:09:49.009560] nvme_tcp.c:1589:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:09.923 [2024-04-23 05:09:49.009566] nvme_tcp.c:1590:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:09.923 [2024-04-23 05:09:49.009604] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.009615] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.009622] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.923 [2024-04-23 05:09:49.009636] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:09.923 [2024-04-23 05:09:49.009662] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.923 [2024-04-23 05:09:49.017576] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.923 [2024-04-23 05:09:49.017594] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.923 [2024-04-23 05:09:49.017602] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.017609] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.923 [2024-04-23 05:09:49.017624] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:09.923 [2024-04-23 05:09:49.017634] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:09.923 [2024-04-23 05:09:49.017644] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:09.923 [2024-04-23 05:09:49.017662] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.017671] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.017677] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.923 [2024-04-23 05:09:49.017689] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.923 [2024-04-23 05:09:49.017713] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.923 [2024-04-23 05:09:49.017837] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.923 [2024-04-23 05:09:49.017857] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.923 [2024-04-23 05:09:49.017865] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.017872] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.923 [2024-04-23 05:09:49.017881] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:09.923 [2024-04-23 05:09:49.017895] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:09.923 [2024-04-23 05:09:49.017908] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.017915] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.017922] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.923 [2024-04-23 05:09:49.017932] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.923 [2024-04-23 05:09:49.017954] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.923 [2024-04-23 05:09:49.018057] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.923 [2024-04-23 05:09:49.018073] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.923 [2024-04-23 05:09:49.018079] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.018086] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.923 [2024-04-23 05:09:49.018096] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:09.923 [2024-04-23 05:09:49.018110] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:09.923 [2024-04-23 05:09:49.018123] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.018130] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.923 [2024-04-23 05:09:49.018136] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.018147] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.924 [2024-04-23 05:09:49.018168] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.924 [2024-04-23 05:09:49.018271] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.924 [2024-04-23 05:09:49.018286] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.924 [2024-04-23 05:09:49.018293] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018299] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.924 [2024-04-23 05:09:49.018309] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:09.924 [2024-04-23 05:09:49.018327] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018336] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018342] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.018353] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.924 [2024-04-23 05:09:49.018374] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.924 [2024-04-23 05:09:49.018476] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.924 [2024-04-23 05:09:49.018488] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.924 [2024-04-23 05:09:49.018495] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018502] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.924 [2024-04-23 05:09:49.018521] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:09.924 [2024-04-23 05:09:49.018532] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:09.924 [2024-04-23 05:09:49.018546] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:09.924 [2024-04-23 05:09:49.018656] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:09.924 [2024-04-23 05:09:49.018663] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:09.924 [2024-04-23 05:09:49.018675] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018683] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018689] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.018700] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.924 [2024-04-23 05:09:49.018721] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.924 [2024-04-23 05:09:49.018855] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.924 [2024-04-23 05:09:49.018867] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.924 [2024-04-23 05:09:49.018874] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018881] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.924 [2024-04-23 05:09:49.018890] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:09.924 [2024-04-23 05:09:49.018907] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018916] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.018922] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.018933] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.924 [2024-04-23 05:09:49.018953] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.924 [2024-04-23 05:09:49.019051] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.924 [2024-04-23 05:09:49.019063] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.924 [2024-04-23 05:09:49.019070] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.019077] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.924 [2024-04-23 05:09:49.019085] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:09.924 [2024-04-23 05:09:49.019094] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:09.924 [2024-04-23 05:09:49.019107] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:09.924 [2024-04-23 05:09:49.019121] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:09.924 [2024-04-23 05:09:49.019136] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.019144] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.019155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.924 [2024-04-23 05:09:49.019180] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.924 [2024-04-23 05:09:49.019319] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.924 [2024-04-23 05:09:49.019335] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.924 [2024-04-23 05:09:49.019342] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.019348] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=4096, cccid=0 00:25:09.924 [2024-04-23 05:09:49.019356] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1763860) on tqpair(0x16fb130): expected_datao=0, payload_size=4096 00:25:09.924 [2024-04-23 05:09:49.019363] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.019381] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.019390] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059652] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.924 [2024-04-23 05:09:49.059671] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.924 [2024-04-23 05:09:49.059678] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059685] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.924 [2024-04-23 05:09:49.059698] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:09.924 [2024-04-23 05:09:49.059707] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:09.924 [2024-04-23 05:09:49.059714] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:09.924 [2024-04-23 05:09:49.059721] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:09.924 [2024-04-23 05:09:49.059728] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:09.924 [2024-04-23 05:09:49.059736] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:09.924 [2024-04-23 05:09:49.059751] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:09.924 [2024-04-23 05:09:49.059763] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059771] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059777] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.059788] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:09.924 [2024-04-23 05:09:49.059811] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.924 [2024-04-23 05:09:49.059912] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.924 [2024-04-23 05:09:49.059927] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.924 [2024-04-23 05:09:49.059934] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059941] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763860) on tqpair=0x16fb130 00:25:09.924 [2024-04-23 05:09:49.059952] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059960] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059966] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.059977] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.924 [2024-04-23 05:09:49.059986] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.059993] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.060004] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.060013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.924 [2024-04-23 05:09:49.060023] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.060030] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.060036] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.060045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.924 [2024-04-23 05:09:49.060055] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.060061] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.060067] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.060076] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.924 [2024-04-23 05:09:49.060085] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:09.924 [2024-04-23 05:09:49.060104] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:09.924 [2024-04-23 05:09:49.060117] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.924 [2024-04-23 05:09:49.060124] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16fb130) 00:25:09.924 [2024-04-23 05:09:49.060135] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.924 [2024-04-23 05:09:49.060173] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763860, cid 0, qid 0 00:25:09.924 [2024-04-23 05:09:49.060184] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17639c0, cid 1, qid 0 00:25:09.925 [2024-04-23 05:09:49.060192] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763b20, cid 2, qid 0 00:25:09.925 [2024-04-23 05:09:49.060199] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.925 [2024-04-23 05:09:49.060221] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763de0, cid 4, qid 0 00:25:09.925 [2024-04-23 05:09:49.060411] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.925 [2024-04-23 05:09:49.060426] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.925 [2024-04-23 05:09:49.060433] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.060440] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763de0) on tqpair=0x16fb130 00:25:09.925 [2024-04-23 05:09:49.060449] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:09.925 [2024-04-23 05:09:49.060458] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.060477] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.060490] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.060502] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.060509] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.060523] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16fb130) 00:25:09.925 [2024-04-23 05:09:49.060534] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:09.925 [2024-04-23 05:09:49.060560] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763de0, cid 4, qid 0 00:25:09.925 [2024-04-23 05:09:49.060706] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.925 [2024-04-23 05:09:49.060718] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.925 [2024-04-23 05:09:49.060725] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.060732] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763de0) on tqpair=0x16fb130 00:25:09.925 [2024-04-23 05:09:49.060786] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.060805] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.060819] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.060827] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16fb130) 00:25:09.925 [2024-04-23 05:09:49.060838] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.925 [2024-04-23 05:09:49.060859] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763de0, cid 4, qid 0 00:25:09.925 [2024-04-23 05:09:49.061014] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.925 [2024-04-23 05:09:49.061030] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.925 [2024-04-23 05:09:49.061036] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061043] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=4096, cccid=4 00:25:09.925 [2024-04-23 05:09:49.061051] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1763de0) on tqpair(0x16fb130): expected_datao=0, payload_size=4096 00:25:09.925 [2024-04-23 05:09:49.061058] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061068] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061076] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061088] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.925 [2024-04-23 05:09:49.061097] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.925 [2024-04-23 05:09:49.061104] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061111] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763de0) on tqpair=0x16fb130 00:25:09.925 [2024-04-23 05:09:49.061130] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:09.925 [2024-04-23 05:09:49.061151] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.061170] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.061183] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061190] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16fb130) 00:25:09.925 [2024-04-23 05:09:49.061201] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.925 [2024-04-23 05:09:49.061222] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763de0, cid 4, qid 0 00:25:09.925 [2024-04-23 05:09:49.061350] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.925 [2024-04-23 05:09:49.061362] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.925 [2024-04-23 05:09:49.061369] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061375] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=4096, cccid=4 00:25:09.925 [2024-04-23 05:09:49.061389] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1763de0) on tqpair(0x16fb130): expected_datao=0, payload_size=4096 00:25:09.925 [2024-04-23 05:09:49.061397] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061407] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061414] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061425] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.925 [2024-04-23 05:09:49.061435] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.925 [2024-04-23 05:09:49.061441] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061448] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763de0) on tqpair=0x16fb130 00:25:09.925 [2024-04-23 05:09:49.061473] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.061493] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:09.925 [2024-04-23 05:09:49.061506] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061524] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16fb130) 00:25:09.925 [2024-04-23 05:09:49.061536] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.925 [2024-04-23 05:09:49.061558] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763de0, cid 4, qid 0 00:25:09.925 [2024-04-23 05:09:49.061676] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.925 [2024-04-23 05:09:49.061689] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.925 [2024-04-23 05:09:49.061695] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061702] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=4096, cccid=4 00:25:09.925 [2024-04-23 05:09:49.061709] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1763de0) on tqpair(0x16fb130): expected_datao=0, payload_size=4096 00:25:09.925 [2024-04-23 05:09:49.061717] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.925 [2024-04-23 05:09:49.061726] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.061734] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.061745] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.926 [2024-04-23 05:09:49.061754] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.926 [2024-04-23 05:09:49.061761] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.061767] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763de0) on tqpair=0x16fb130 00:25:09.926 [2024-04-23 05:09:49.061783] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:09.926 [2024-04-23 05:09:49.061798] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:09.926 [2024-04-23 05:09:49.061814] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:09.926 [2024-04-23 05:09:49.061826] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:09.926 [2024-04-23 05:09:49.061836] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:09.926 [2024-04-23 05:09:49.061845] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:09.926 [2024-04-23 05:09:49.061853] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:09.926 [2024-04-23 05:09:49.061865] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:09.926 [2024-04-23 05:09:49.061884] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.061893] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.061903] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.061914] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.061921] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.061927] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.061936] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.926 [2024-04-23 05:09:49.061961] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763de0, cid 4, qid 0 00:25:09.926 [2024-04-23 05:09:49.061973] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763f40, cid 5, qid 0 00:25:09.926 [2024-04-23 05:09:49.062117] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.926 [2024-04-23 05:09:49.062129] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.926 [2024-04-23 05:09:49.062135] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062142] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763de0) on tqpair=0x16fb130 00:25:09.926 [2024-04-23 05:09:49.062153] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.926 [2024-04-23 05:09:49.062162] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.926 [2024-04-23 05:09:49.062169] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062176] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763f40) on tqpair=0x16fb130 00:25:09.926 [2024-04-23 05:09:49.062192] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062201] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.062211] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.062231] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763f40, cid 5, qid 0 00:25:09.926 [2024-04-23 05:09:49.062345] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.926 [2024-04-23 05:09:49.062361] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.926 [2024-04-23 05:09:49.062367] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062374] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763f40) on tqpair=0x16fb130 00:25:09.926 [2024-04-23 05:09:49.062391] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062400] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.062410] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.062431] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763f40, cid 5, qid 0 00:25:09.926 [2024-04-23 05:09:49.062547] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.926 [2024-04-23 05:09:49.062563] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.926 [2024-04-23 05:09:49.062570] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062577] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763f40) on tqpair=0x16fb130 00:25:09.926 [2024-04-23 05:09:49.062594] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062607] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.062618] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.062639] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763f40, cid 5, qid 0 00:25:09.926 [2024-04-23 05:09:49.062740] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.926 [2024-04-23 05:09:49.062752] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.926 [2024-04-23 05:09:49.062758] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062765] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763f40) on tqpair=0x16fb130 00:25:09.926 [2024-04-23 05:09:49.062785] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062794] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.062805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.062817] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062824] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.062833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.062844] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062852] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.062861] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.062872] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.062879] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x16fb130) 00:25:09.926 [2024-04-23 05:09:49.062889] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.926 [2024-04-23 05:09:49.062910] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763f40, cid 5, qid 0 00:25:09.926 [2024-04-23 05:09:49.062922] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763de0, cid 4, qid 0 00:25:09.926 [2024-04-23 05:09:49.062930] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17640a0, cid 6, qid 0 00:25:09.926 [2024-04-23 05:09:49.062937] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1764200, cid 7, qid 0 00:25:09.926 [2024-04-23 05:09:49.063189] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.926 [2024-04-23 05:09:49.063205] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.926 [2024-04-23 05:09:49.063212] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063218] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=8192, cccid=5 00:25:09.926 [2024-04-23 05:09:49.063226] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1763f40) on tqpair(0x16fb130): expected_datao=0, payload_size=8192 00:25:09.926 [2024-04-23 05:09:49.063233] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063243] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063250] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063259] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.926 [2024-04-23 05:09:49.063268] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.926 [2024-04-23 05:09:49.063278] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063284] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=512, cccid=4 00:25:09.926 [2024-04-23 05:09:49.063292] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1763de0) on tqpair(0x16fb130): expected_datao=0, payload_size=512 00:25:09.926 [2024-04-23 05:09:49.063299] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063308] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063315] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063323] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.926 [2024-04-23 05:09:49.063332] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.926 [2024-04-23 05:09:49.063338] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063345] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=512, cccid=6 00:25:09.926 [2024-04-23 05:09:49.063352] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17640a0) on tqpair(0x16fb130): expected_datao=0, payload_size=512 00:25:09.926 [2024-04-23 05:09:49.063359] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063368] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063375] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063383] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:09.926 [2024-04-23 05:09:49.063392] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:09.926 [2024-04-23 05:09:49.063398] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063404] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16fb130): datao=0, datal=4096, cccid=7 00:25:09.926 [2024-04-23 05:09:49.063411] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1764200) on tqpair(0x16fb130): expected_datao=0, payload_size=4096 00:25:09.926 [2024-04-23 05:09:49.063418] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.926 [2024-04-23 05:09:49.063428] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:09.927 [2024-04-23 05:09:49.063435] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:09.927 [2024-04-23 05:09:49.063446] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.927 [2024-04-23 05:09:49.063455] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.927 [2024-04-23 05:09:49.063462] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.927 [2024-04-23 05:09:49.063468] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763f40) on tqpair=0x16fb130 00:25:09.927 [2024-04-23 05:09:49.063489] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.927 [2024-04-23 05:09:49.067538] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.927 [2024-04-23 05:09:49.067553] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.927 [2024-04-23 05:09:49.067560] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763de0) on tqpair=0x16fb130 00:25:09.927 [2024-04-23 05:09:49.067577] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.927 [2024-04-23 05:09:49.067587] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.927 [2024-04-23 05:09:49.067593] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.927 [2024-04-23 05:09:49.067600] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17640a0) on tqpair=0x16fb130 00:25:09.927 [2024-04-23 05:09:49.067611] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.927 [2024-04-23 05:09:49.067620] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.927 [2024-04-23 05:09:49.067626] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.927 [2024-04-23 05:09:49.067633] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1764200) on tqpair=0x16fb130 00:25:09.927 ===================================================== 00:25:09.927 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:09.927 ===================================================== 00:25:09.927 Controller Capabilities/Features 00:25:09.927 ================================ 00:25:09.927 Vendor ID: 8086 00:25:09.927 Subsystem Vendor ID: 8086 00:25:09.927 Serial Number: SPDK00000000000001 00:25:09.927 Model Number: SPDK bdev Controller 00:25:09.927 Firmware Version: 24.05 00:25:09.927 Recommended Arb Burst: 6 00:25:09.927 IEEE OUI Identifier: e4 d2 5c 00:25:09.927 Multi-path I/O 00:25:09.927 May have multiple subsystem ports: Yes 00:25:09.927 May have multiple controllers: Yes 00:25:09.927 Associated with SR-IOV VF: No 00:25:09.927 Max Data Transfer Size: 131072 00:25:09.927 Max Number of Namespaces: 32 00:25:09.927 Max Number of I/O Queues: 127 00:25:09.927 NVMe Specification Version (VS): 1.3 00:25:09.927 NVMe Specification Version (Identify): 1.3 00:25:09.927 Maximum Queue Entries: 128 00:25:09.927 Contiguous Queues Required: Yes 00:25:09.927 Arbitration Mechanisms Supported 00:25:09.927 Weighted Round Robin: Not Supported 00:25:09.927 Vendor Specific: Not Supported 00:25:09.927 Reset Timeout: 15000 ms 00:25:09.927 Doorbell Stride: 4 bytes 00:25:09.927 NVM Subsystem Reset: Not Supported 00:25:09.927 Command Sets Supported 00:25:09.927 NVM Command Set: Supported 00:25:09.927 Boot Partition: Not Supported 00:25:09.927 Memory Page Size Minimum: 4096 bytes 00:25:09.927 Memory Page Size Maximum: 4096 bytes 00:25:09.927 Persistent Memory Region: Not Supported 00:25:09.927 Optional Asynchronous Events Supported 00:25:09.927 Namespace Attribute Notices: Supported 00:25:09.927 Firmware Activation Notices: Not Supported 00:25:09.927 ANA Change Notices: Not Supported 00:25:09.927 PLE Aggregate Log Change Notices: Not Supported 00:25:09.927 LBA Status Info Alert Notices: Not Supported 00:25:09.927 EGE Aggregate Log Change Notices: Not Supported 00:25:09.927 Normal NVM Subsystem Shutdown event: Not Supported 00:25:09.927 Zone Descriptor Change Notices: Not Supported 00:25:09.927 Discovery Log Change Notices: Not Supported 00:25:09.927 Controller Attributes 00:25:09.927 128-bit Host Identifier: Supported 00:25:09.927 Non-Operational Permissive Mode: Not Supported 00:25:09.927 NVM Sets: Not Supported 00:25:09.927 Read Recovery Levels: Not Supported 00:25:09.927 Endurance Groups: Not Supported 00:25:09.927 Predictable Latency Mode: Not Supported 00:25:09.927 Traffic Based Keep ALive: Not Supported 00:25:09.927 Namespace Granularity: Not Supported 00:25:09.927 SQ Associations: Not Supported 00:25:09.927 UUID List: Not Supported 00:25:09.927 Multi-Domain Subsystem: Not Supported 00:25:09.927 Fixed Capacity Management: Not Supported 00:25:09.927 Variable Capacity Management: Not Supported 00:25:09.927 Delete Endurance Group: Not Supported 00:25:09.927 Delete NVM Set: Not Supported 00:25:09.927 Extended LBA Formats Supported: Not Supported 00:25:09.927 Flexible Data Placement Supported: Not Supported 00:25:09.927 00:25:09.927 Controller Memory Buffer Support 00:25:09.927 ================================ 00:25:09.927 Supported: No 00:25:09.927 00:25:09.927 Persistent Memory Region Support 00:25:09.927 ================================ 00:25:09.927 Supported: No 00:25:09.927 00:25:09.927 Admin Command Set Attributes 00:25:09.927 ============================ 00:25:09.927 Security Send/Receive: Not Supported 00:25:09.927 Format NVM: Not Supported 00:25:09.927 Firmware Activate/Download: Not Supported 00:25:09.927 Namespace Management: Not Supported 00:25:09.927 Device Self-Test: Not Supported 00:25:09.927 Directives: Not Supported 00:25:09.927 NVMe-MI: Not Supported 00:25:09.927 Virtualization Management: Not Supported 00:25:09.927 Doorbell Buffer Config: Not Supported 00:25:09.927 Get LBA Status Capability: Not Supported 00:25:09.927 Command & Feature Lockdown Capability: Not Supported 00:25:09.927 Abort Command Limit: 4 00:25:09.927 Async Event Request Limit: 4 00:25:09.927 Number of Firmware Slots: N/A 00:25:09.927 Firmware Slot 1 Read-Only: N/A 00:25:09.927 Firmware Activation Without Reset: N/A 00:25:09.927 Multiple Update Detection Support: N/A 00:25:09.927 Firmware Update Granularity: No Information Provided 00:25:09.927 Per-Namespace SMART Log: No 00:25:09.927 Asymmetric Namespace Access Log Page: Not Supported 00:25:09.927 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:09.927 Command Effects Log Page: Supported 00:25:09.927 Get Log Page Extended Data: Supported 00:25:09.927 Telemetry Log Pages: Not Supported 00:25:09.927 Persistent Event Log Pages: Not Supported 00:25:09.927 Supported Log Pages Log Page: May Support 00:25:09.927 Commands Supported & Effects Log Page: Not Supported 00:25:09.927 Feature Identifiers & Effects Log Page:May Support 00:25:09.927 NVMe-MI Commands & Effects Log Page: May Support 00:25:09.927 Data Area 4 for Telemetry Log: Not Supported 00:25:09.927 Error Log Page Entries Supported: 128 00:25:09.927 Keep Alive: Supported 00:25:09.927 Keep Alive Granularity: 10000 ms 00:25:09.927 00:25:09.927 NVM Command Set Attributes 00:25:09.927 ========================== 00:25:09.927 Submission Queue Entry Size 00:25:09.927 Max: 64 00:25:09.927 Min: 64 00:25:09.927 Completion Queue Entry Size 00:25:09.927 Max: 16 00:25:09.927 Min: 16 00:25:09.927 Number of Namespaces: 32 00:25:09.927 Compare Command: Supported 00:25:09.927 Write Uncorrectable Command: Not Supported 00:25:09.927 Dataset Management Command: Supported 00:25:09.927 Write Zeroes Command: Supported 00:25:09.927 Set Features Save Field: Not Supported 00:25:09.927 Reservations: Supported 00:25:09.927 Timestamp: Not Supported 00:25:09.927 Copy: Supported 00:25:09.927 Volatile Write Cache: Present 00:25:09.927 Atomic Write Unit (Normal): 1 00:25:09.927 Atomic Write Unit (PFail): 1 00:25:09.927 Atomic Compare & Write Unit: 1 00:25:09.927 Fused Compare & Write: Supported 00:25:09.927 Scatter-Gather List 00:25:09.927 SGL Command Set: Supported 00:25:09.927 SGL Keyed: Supported 00:25:09.927 SGL Bit Bucket Descriptor: Not Supported 00:25:09.927 SGL Metadata Pointer: Not Supported 00:25:09.927 Oversized SGL: Not Supported 00:25:09.927 SGL Metadata Address: Not Supported 00:25:09.927 SGL Offset: Supported 00:25:09.927 Transport SGL Data Block: Not Supported 00:25:09.927 Replay Protected Memory Block: Not Supported 00:25:09.927 00:25:09.927 Firmware Slot Information 00:25:09.927 ========================= 00:25:09.927 Active slot: 1 00:25:09.927 Slot 1 Firmware Revision: 24.05 00:25:09.927 00:25:09.927 00:25:09.927 Commands Supported and Effects 00:25:09.927 ============================== 00:25:09.927 Admin Commands 00:25:09.927 -------------- 00:25:09.927 Get Log Page (02h): Supported 00:25:09.927 Identify (06h): Supported 00:25:09.927 Abort (08h): Supported 00:25:09.927 Set Features (09h): Supported 00:25:09.927 Get Features (0Ah): Supported 00:25:09.927 Asynchronous Event Request (0Ch): Supported 00:25:09.927 Keep Alive (18h): Supported 00:25:09.927 I/O Commands 00:25:09.927 ------------ 00:25:09.927 Flush (00h): Supported LBA-Change 00:25:09.927 Write (01h): Supported LBA-Change 00:25:09.927 Read (02h): Supported 00:25:09.927 Compare (05h): Supported 00:25:09.927 Write Zeroes (08h): Supported LBA-Change 00:25:09.927 Dataset Management (09h): Supported LBA-Change 00:25:09.927 Copy (19h): Supported LBA-Change 00:25:09.927 Unknown (79h): Supported LBA-Change 00:25:09.928 Unknown (7Ah): Supported 00:25:09.928 00:25:09.928 Error Log 00:25:09.928 ========= 00:25:09.928 00:25:09.928 Arbitration 00:25:09.928 =========== 00:25:09.928 Arbitration Burst: 1 00:25:09.928 00:25:09.928 Power Management 00:25:09.928 ================ 00:25:09.928 Number of Power States: 1 00:25:09.928 Current Power State: Power State #0 00:25:09.928 Power State #0: 00:25:09.928 Max Power: 0.00 W 00:25:09.928 Non-Operational State: Operational 00:25:09.928 Entry Latency: Not Reported 00:25:09.928 Exit Latency: Not Reported 00:25:09.928 Relative Read Throughput: 0 00:25:09.928 Relative Read Latency: 0 00:25:09.928 Relative Write Throughput: 0 00:25:09.928 Relative Write Latency: 0 00:25:09.928 Idle Power: Not Reported 00:25:09.928 Active Power: Not Reported 00:25:09.928 Non-Operational Permissive Mode: Not Supported 00:25:09.928 00:25:09.928 Health Information 00:25:09.928 ================== 00:25:09.928 Critical Warnings: 00:25:09.928 Available Spare Space: OK 00:25:09.928 Temperature: OK 00:25:09.928 Device Reliability: OK 00:25:09.928 Read Only: No 00:25:09.928 Volatile Memory Backup: OK 00:25:09.928 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:09.928 Temperature Threshold: [2024-04-23 05:09:49.067770] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.067784] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.067796] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.067820] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1764200, cid 7, qid 0 00:25:09.928 [2024-04-23 05:09:49.067971] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.067986] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.067993] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068000] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1764200) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.068040] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:09.928 [2024-04-23 05:09:49.068061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.928 [2024-04-23 05:09:49.068073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.928 [2024-04-23 05:09:49.068083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.928 [2024-04-23 05:09:49.068092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.928 [2024-04-23 05:09:49.068105] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068112] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068119] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.068129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.068151] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.068285] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.068297] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.068304] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068310] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.068323] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068330] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068337] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.068347] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.068372] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.068494] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.068509] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.068525] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068533] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.068542] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:09.928 [2024-04-23 05:09:49.068550] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:09.928 [2024-04-23 05:09:49.068566] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068574] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068584] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.068595] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.068616] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.068720] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.068732] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.068739] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068746] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.068763] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068772] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068779] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.068789] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.068809] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.068913] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.068928] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.068935] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068942] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.068959] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068968] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.068975] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.068985] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.069005] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.069102] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.069117] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.069124] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069131] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.069148] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069157] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069164] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.069174] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.069194] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.069294] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.069306] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.069312] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069319] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.069336] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069345] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069352] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.069365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.069386] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.069493] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.069508] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.069525] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069533] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.069551] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069561] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069567] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.928 [2024-04-23 05:09:49.069577] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.928 [2024-04-23 05:09:49.069598] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.928 [2024-04-23 05:09:49.069699] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.928 [2024-04-23 05:09:49.069711] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.928 [2024-04-23 05:09:49.069718] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069724] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.928 [2024-04-23 05:09:49.069741] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.928 [2024-04-23 05:09:49.069750] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.069756] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.069767] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.069787] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.069881] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.069893] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.069900] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.069907] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.069923] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.069932] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.069939] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.069949] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.069969] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.070072] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.070087] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.070094] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070101] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.070118] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070127] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070134] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.070147] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.070169] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.070266] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.070278] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.070285] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070292] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.070309] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070318] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070324] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.070335] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.070354] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.070457] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.070469] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.070475] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070482] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.070499] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070507] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070523] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.070535] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.070555] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.070660] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.070675] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.070682] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070688] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.070706] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070715] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070721] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.070732] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.070752] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.070856] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.070868] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.070874] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070881] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.070898] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070906] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.070913] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.070923] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.070947] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.071053] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.071068] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.071075] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071082] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.071099] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071108] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071114] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.071125] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.071145] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.071246] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.071257] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.071264] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071271] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.071288] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071297] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071303] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.071313] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.071333] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.071434] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.071448] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.071455] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071462] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.071479] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071488] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.071495] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16fb130) 00:25:09.929 [2024-04-23 05:09:49.071505] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.929 [2024-04-23 05:09:49.075565] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1763c80, cid 3, qid 0 00:25:09.929 [2024-04-23 05:09:49.075733] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:09.929 [2024-04-23 05:09:49.075749] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:09.929 [2024-04-23 05:09:49.075756] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:09.929 [2024-04-23 05:09:49.075762] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1763c80) on tqpair=0x16fb130 00:25:09.929 [2024-04-23 05:09:49.075777] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:25:10.189 0 Kelvin (-273 Celsius) 00:25:10.189 Available Spare: 0% 00:25:10.189 Available Spare Threshold: 0% 00:25:10.189 Life Percentage Used: 0% 00:25:10.189 Data Units Read: 0 00:25:10.189 Data Units Written: 0 00:25:10.189 Host Read Commands: 0 00:25:10.189 Host Write Commands: 0 00:25:10.189 Controller Busy Time: 0 minutes 00:25:10.189 Power Cycles: 0 00:25:10.189 Power On Hours: 0 hours 00:25:10.189 Unsafe Shutdowns: 0 00:25:10.189 Unrecoverable Media Errors: 0 00:25:10.189 Lifetime Error Log Entries: 0 00:25:10.189 Warning Temperature Time: 0 minutes 00:25:10.189 Critical Temperature Time: 0 minutes 00:25:10.189 00:25:10.189 Number of Queues 00:25:10.189 ================ 00:25:10.189 Number of I/O Submission Queues: 127 00:25:10.189 Number of I/O Completion Queues: 127 00:25:10.189 00:25:10.189 Active Namespaces 00:25:10.189 ================= 00:25:10.189 Namespace ID:1 00:25:10.189 Error Recovery Timeout: Unlimited 00:25:10.189 Command Set Identifier: NVM (00h) 00:25:10.189 Deallocate: Supported 00:25:10.189 Deallocated/Unwritten Error: Not Supported 00:25:10.189 Deallocated Read Value: Unknown 00:25:10.189 Deallocate in Write Zeroes: Not Supported 00:25:10.189 Deallocated Guard Field: 0xFFFF 00:25:10.189 Flush: Supported 00:25:10.189 Reservation: Supported 00:25:10.189 Namespace Sharing Capabilities: Multiple Controllers 00:25:10.189 Size (in LBAs): 131072 (0GiB) 00:25:10.189 Capacity (in LBAs): 131072 (0GiB) 00:25:10.189 Utilization (in LBAs): 131072 (0GiB) 00:25:10.189 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:10.189 EUI64: ABCDEF0123456789 00:25:10.189 UUID: c8c0e846-8472-4e85-9d99-27a663dce743 00:25:10.189 Thin Provisioning: Not Supported 00:25:10.189 Per-NS Atomic Units: Yes 00:25:10.189 Atomic Boundary Size (Normal): 0 00:25:10.189 Atomic Boundary Size (PFail): 0 00:25:10.189 Atomic Boundary Offset: 0 00:25:10.189 Maximum Single Source Range Length: 65535 00:25:10.189 Maximum Copy Length: 65535 00:25:10.189 Maximum Source Range Count: 1 00:25:10.189 NGUID/EUI64 Never Reused: No 00:25:10.189 Namespace Write Protected: No 00:25:10.189 Number of LBA Formats: 1 00:25:10.189 Current LBA Format: LBA Format #00 00:25:10.189 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:10.189 00:25:10.189 05:09:49 -- host/identify.sh@51 -- # sync 00:25:10.189 05:09:49 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:10.189 05:09:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:10.189 05:09:49 -- common/autotest_common.sh@10 -- # set +x 00:25:10.189 05:09:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:10.189 05:09:49 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:10.189 05:09:49 -- host/identify.sh@56 -- # nvmftestfini 00:25:10.189 05:09:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:10.189 05:09:49 -- nvmf/common.sh@117 -- # sync 00:25:10.189 05:09:49 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:25:10.189 05:09:49 -- nvmf/common.sh@120 -- # set +e 00:25:10.189 05:09:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:10.189 05:09:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:25:10.189 rmmod nvme_tcp 00:25:10.189 rmmod nvme_fabrics 00:25:10.189 rmmod nvme_keyring 00:25:10.189 05:09:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:10.189 05:09:49 -- nvmf/common.sh@124 -- # set -e 00:25:10.189 05:09:49 -- nvmf/common.sh@125 -- # return 0 00:25:10.189 05:09:49 -- nvmf/common.sh@478 -- # '[' -n 2471961 ']' 00:25:10.189 05:09:49 -- nvmf/common.sh@479 -- # killprocess 2471961 00:25:10.189 05:09:49 -- common/autotest_common.sh@936 -- # '[' -z 2471961 ']' 00:25:10.189 05:09:49 -- common/autotest_common.sh@940 -- # kill -0 2471961 00:25:10.189 05:09:49 -- common/autotest_common.sh@941 -- # uname 00:25:10.189 05:09:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:10.189 05:09:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2471961 00:25:10.189 05:09:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:10.189 05:09:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:10.189 05:09:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2471961' 00:25:10.189 killing process with pid 2471961 00:25:10.189 05:09:49 -- common/autotest_common.sh@955 -- # kill 2471961 00:25:10.189 [2024-04-23 05:09:49.176590] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:10.189 05:09:49 -- common/autotest_common.sh@960 -- # wait 2471961 00:25:10.448 05:09:49 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:10.448 05:09:49 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:25:10.448 05:09:49 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:25:10.448 05:09:49 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:10.448 05:09:49 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:25:10.448 05:09:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:10.448 05:09:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:10.448 05:09:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.354 05:09:51 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:25:12.354 00:25:12.354 real 0m5.296s 00:25:12.354 user 0m4.273s 00:25:12.354 sys 0m1.818s 00:25:12.354 05:09:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:12.354 05:09:51 -- common/autotest_common.sh@10 -- # set +x 00:25:12.354 ************************************ 00:25:12.354 END TEST nvmf_identify 00:25:12.354 ************************************ 00:25:12.354 05:09:51 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:12.354 05:09:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:12.354 05:09:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:12.354 05:09:51 -- common/autotest_common.sh@10 -- # set +x 00:25:12.613 ************************************ 00:25:12.613 START TEST nvmf_perf 00:25:12.613 ************************************ 00:25:12.613 05:09:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:12.613 * Looking for test storage... 00:25:12.613 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:12.613 05:09:51 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:12.613 05:09:51 -- nvmf/common.sh@7 -- # uname -s 00:25:12.613 05:09:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:12.613 05:09:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:12.613 05:09:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:12.613 05:09:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:12.613 05:09:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:12.613 05:09:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:12.613 05:09:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:12.613 05:09:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:12.613 05:09:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:12.613 05:09:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:12.613 05:09:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:12.613 05:09:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:12.613 05:09:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:12.613 05:09:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:12.613 05:09:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:12.613 05:09:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:12.613 05:09:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:12.613 05:09:51 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:12.613 05:09:51 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:12.613 05:09:51 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:12.613 05:09:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.613 05:09:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.613 05:09:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.613 05:09:51 -- paths/export.sh@5 -- # export PATH 00:25:12.613 05:09:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.613 05:09:51 -- nvmf/common.sh@47 -- # : 0 00:25:12.613 05:09:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:12.613 05:09:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:12.613 05:09:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:12.613 05:09:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:12.613 05:09:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:12.613 05:09:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:12.613 05:09:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:12.613 05:09:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:12.613 05:09:51 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:12.613 05:09:51 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:12.613 05:09:51 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:12.613 05:09:51 -- host/perf.sh@17 -- # nvmftestinit 00:25:12.613 05:09:51 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:25:12.613 05:09:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:12.613 05:09:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:12.613 05:09:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:12.613 05:09:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:12.613 05:09:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.613 05:09:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.613 05:09:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.613 05:09:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:12.613 05:09:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:12.613 05:09:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:12.613 05:09:51 -- common/autotest_common.sh@10 -- # set +x 00:25:14.516 05:09:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:14.516 05:09:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:14.516 05:09:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:14.516 05:09:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:14.516 05:09:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:14.516 05:09:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:14.516 05:09:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:14.516 05:09:53 -- nvmf/common.sh@295 -- # net_devs=() 00:25:14.516 05:09:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:14.516 05:09:53 -- nvmf/common.sh@296 -- # e810=() 00:25:14.516 05:09:53 -- nvmf/common.sh@296 -- # local -ga e810 00:25:14.516 05:09:53 -- nvmf/common.sh@297 -- # x722=() 00:25:14.516 05:09:53 -- nvmf/common.sh@297 -- # local -ga x722 00:25:14.516 05:09:53 -- nvmf/common.sh@298 -- # mlx=() 00:25:14.516 05:09:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:14.516 05:09:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:14.516 05:09:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:14.516 05:09:53 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:25:14.516 05:09:53 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:25:14.516 05:09:53 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:25:14.516 05:09:53 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:25:14.516 05:09:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:14.516 05:09:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:14.516 05:09:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:14.516 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:14.516 05:09:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:14.516 05:09:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:14.517 05:09:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:14.517 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:14.517 05:09:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:14.517 05:09:53 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:14.517 05:09:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:14.517 05:09:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:14.517 05:09:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:14.517 05:09:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:14.517 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:14.517 05:09:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:14.517 05:09:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:14.517 05:09:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:14.517 05:09:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:14.517 05:09:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:14.517 05:09:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:14.517 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:14.517 05:09:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:14.517 05:09:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:14.517 05:09:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:14.517 05:09:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:25:14.517 05:09:53 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:14.517 05:09:53 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:14.517 05:09:53 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:14.517 05:09:53 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:25:14.517 05:09:53 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:14.517 05:09:53 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:14.517 05:09:53 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:25:14.517 05:09:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:14.517 05:09:53 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:14.517 05:09:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:25:14.517 05:09:53 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:25:14.517 05:09:53 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:25:14.517 05:09:53 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:14.517 05:09:53 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:14.517 05:09:53 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:14.517 05:09:53 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:25:14.517 05:09:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:14.517 05:09:53 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:14.517 05:09:53 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:14.517 05:09:53 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:25:14.517 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:14.517 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:25:14.517 00:25:14.517 --- 10.0.0.2 ping statistics --- 00:25:14.517 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.517 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:25:14.517 05:09:53 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:14.517 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:14.517 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:25:14.517 00:25:14.517 --- 10.0.0.1 ping statistics --- 00:25:14.517 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.517 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:25:14.517 05:09:53 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:14.517 05:09:53 -- nvmf/common.sh@411 -- # return 0 00:25:14.517 05:09:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:14.517 05:09:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:14.517 05:09:53 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:25:14.517 05:09:53 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:14.517 05:09:53 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:25:14.517 05:09:53 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:25:14.774 05:09:53 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:14.774 05:09:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:14.774 05:09:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:14.774 05:09:53 -- common/autotest_common.sh@10 -- # set +x 00:25:14.774 05:09:53 -- nvmf/common.sh@470 -- # nvmfpid=2474043 00:25:14.774 05:09:53 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:14.774 05:09:53 -- nvmf/common.sh@471 -- # waitforlisten 2474043 00:25:14.774 05:09:53 -- common/autotest_common.sh@817 -- # '[' -z 2474043 ']' 00:25:14.774 05:09:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:14.774 05:09:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:25:14.774 05:09:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:14.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:14.774 05:09:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:25:14.774 05:09:53 -- common/autotest_common.sh@10 -- # set +x 00:25:14.774 [2024-04-23 05:09:53.733919] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:25:14.774 [2024-04-23 05:09:53.734006] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:14.774 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.774 [2024-04-23 05:09:53.773478] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:25:14.774 [2024-04-23 05:09:53.804139] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:14.774 [2024-04-23 05:09:53.898645] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:14.775 [2024-04-23 05:09:53.898711] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:14.775 [2024-04-23 05:09:53.898725] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:14.775 [2024-04-23 05:09:53.898737] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:14.775 [2024-04-23 05:09:53.898748] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:14.775 [2024-04-23 05:09:53.898815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:14.775 [2024-04-23 05:09:53.898906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:14.775 [2024-04-23 05:09:53.899027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:14.775 [2024-04-23 05:09:53.899030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:15.032 05:09:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:25:15.032 05:09:54 -- common/autotest_common.sh@850 -- # return 0 00:25:15.032 05:09:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:15.032 05:09:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:15.032 05:09:54 -- common/autotest_common.sh@10 -- # set +x 00:25:15.032 05:09:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:15.032 05:09:54 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:15.032 05:09:54 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:18.322 05:09:57 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:18.322 05:09:57 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:18.322 05:09:57 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:25:18.322 05:09:57 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:18.610 05:09:57 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:18.610 05:09:57 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:25:18.610 05:09:57 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:18.610 05:09:57 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:18.610 05:09:57 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:18.868 [2024-04-23 05:09:57.872523] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:18.868 05:09:57 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:19.126 05:09:58 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:19.126 05:09:58 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:19.385 05:09:58 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:19.385 05:09:58 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:19.643 05:09:58 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:19.977 [2024-04-23 05:09:58.864164] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:19.977 05:09:58 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:19.977 05:09:59 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:25:19.977 05:09:59 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:19.977 05:09:59 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:19.977 05:09:59 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:21.355 Initializing NVMe Controllers 00:25:21.355 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:25:21.355 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:25:21.355 Initialization complete. Launching workers. 00:25:21.356 ======================================================== 00:25:21.356 Latency(us) 00:25:21.356 Device Information : IOPS MiB/s Average min max 00:25:21.356 PCIE (0000:88:00.0) NSID 1 from core 0: 84491.47 330.04 378.37 17.03 5306.42 00:25:21.356 ======================================================== 00:25:21.356 Total : 84491.47 330.04 378.37 17.03 5306.42 00:25:21.356 00:25:21.356 05:10:00 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:21.356 EAL: No free 2048 kB hugepages reported on node 1 00:25:22.730 Initializing NVMe Controllers 00:25:22.730 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:22.730 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:22.730 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:22.730 Initialization complete. Launching workers. 00:25:22.730 ======================================================== 00:25:22.730 Latency(us) 00:25:22.730 Device Information : IOPS MiB/s Average min max 00:25:22.730 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 64.00 0.25 16226.86 164.76 45857.78 00:25:22.730 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 52.00 0.20 19451.39 7940.22 47924.18 00:25:22.730 ======================================================== 00:25:22.730 Total : 116.00 0.45 17672.34 164.76 47924.18 00:25:22.730 00:25:22.730 05:10:01 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:22.730 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.106 Initializing NVMe Controllers 00:25:24.106 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:24.106 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:24.106 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:24.106 Initialization complete. Launching workers. 00:25:24.106 ======================================================== 00:25:24.106 Latency(us) 00:25:24.106 Device Information : IOPS MiB/s Average min max 00:25:24.106 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8283.02 32.36 3864.11 638.82 7736.45 00:25:24.106 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3873.54 15.13 8311.11 6875.95 15528.15 00:25:24.106 ======================================================== 00:25:24.106 Total : 12156.57 47.49 5281.09 638.82 15528.15 00:25:24.106 00:25:24.106 05:10:03 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:24.106 05:10:03 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:24.106 05:10:03 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:24.106 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.642 Initializing NVMe Controllers 00:25:26.642 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:26.642 Controller IO queue size 128, less than required. 00:25:26.642 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:26.642 Controller IO queue size 128, less than required. 00:25:26.642 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:26.642 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:26.642 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:26.642 Initialization complete. Launching workers. 00:25:26.642 ======================================================== 00:25:26.642 Latency(us) 00:25:26.642 Device Information : IOPS MiB/s Average min max 00:25:26.642 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1501.00 375.25 86677.37 46649.33 142270.78 00:25:26.642 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 566.81 141.70 241626.21 82841.33 343285.37 00:25:26.642 ======================================================== 00:25:26.642 Total : 2067.82 516.95 129150.66 46649.33 343285.37 00:25:26.642 00:25:26.642 05:10:05 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:25:26.642 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.642 No valid NVMe controllers or AIO or URING devices found 00:25:26.642 Initializing NVMe Controllers 00:25:26.642 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:26.642 Controller IO queue size 128, less than required. 00:25:26.642 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:26.642 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:25:26.642 Controller IO queue size 128, less than required. 00:25:26.642 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:26.642 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:25:26.642 WARNING: Some requested NVMe devices were skipped 00:25:26.642 05:10:05 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:25:26.642 EAL: No free 2048 kB hugepages reported on node 1 00:25:29.176 Initializing NVMe Controllers 00:25:29.176 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:29.176 Controller IO queue size 128, less than required. 00:25:29.176 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:29.176 Controller IO queue size 128, less than required. 00:25:29.176 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:29.176 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:29.176 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:29.176 Initialization complete. Launching workers. 00:25:29.176 00:25:29.176 ==================== 00:25:29.176 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:25:29.176 TCP transport: 00:25:29.176 polls: 11094 00:25:29.176 idle_polls: 5789 00:25:29.176 sock_completions: 5305 00:25:29.176 nvme_completions: 5679 00:25:29.176 submitted_requests: 8500 00:25:29.176 queued_requests: 1 00:25:29.176 00:25:29.176 ==================== 00:25:29.176 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:25:29.176 TCP transport: 00:25:29.176 polls: 10826 00:25:29.176 idle_polls: 5721 00:25:29.176 sock_completions: 5105 00:25:29.176 nvme_completions: 6005 00:25:29.176 submitted_requests: 9124 00:25:29.176 queued_requests: 1 00:25:29.176 ======================================================== 00:25:29.176 Latency(us) 00:25:29.176 Device Information : IOPS MiB/s Average min max 00:25:29.177 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1416.93 354.23 93195.52 62318.47 142849.84 00:25:29.177 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1498.28 374.57 86439.10 40834.30 133236.20 00:25:29.177 ======================================================== 00:25:29.177 Total : 2915.20 728.80 89723.04 40834.30 142849.84 00:25:29.177 00:25:29.177 05:10:08 -- host/perf.sh@66 -- # sync 00:25:29.177 05:10:08 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:29.437 05:10:08 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:25:29.437 05:10:08 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:25:29.437 05:10:08 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:25:33.629 05:10:11 -- host/perf.sh@72 -- # ls_guid=bcc9f6ca-c354-4826-838e-a65152ad2435 00:25:33.629 05:10:11 -- host/perf.sh@73 -- # get_lvs_free_mb bcc9f6ca-c354-4826-838e-a65152ad2435 00:25:33.629 05:10:11 -- common/autotest_common.sh@1350 -- # local lvs_uuid=bcc9f6ca-c354-4826-838e-a65152ad2435 00:25:33.629 05:10:11 -- common/autotest_common.sh@1351 -- # local lvs_info 00:25:33.629 05:10:11 -- common/autotest_common.sh@1352 -- # local fc 00:25:33.629 05:10:11 -- common/autotest_common.sh@1353 -- # local cs 00:25:33.629 05:10:11 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:33.629 05:10:12 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:25:33.629 { 00:25:33.629 "uuid": "bcc9f6ca-c354-4826-838e-a65152ad2435", 00:25:33.629 "name": "lvs_0", 00:25:33.629 "base_bdev": "Nvme0n1", 00:25:33.629 "total_data_clusters": 238234, 00:25:33.629 "free_clusters": 238234, 00:25:33.629 "block_size": 512, 00:25:33.629 "cluster_size": 4194304 00:25:33.629 } 00:25:33.629 ]' 00:25:33.629 05:10:12 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="bcc9f6ca-c354-4826-838e-a65152ad2435") .free_clusters' 00:25:33.629 05:10:12 -- common/autotest_common.sh@1355 -- # fc=238234 00:25:33.629 05:10:12 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="bcc9f6ca-c354-4826-838e-a65152ad2435") .cluster_size' 00:25:33.629 05:10:12 -- common/autotest_common.sh@1356 -- # cs=4194304 00:25:33.629 05:10:12 -- common/autotest_common.sh@1359 -- # free_mb=952936 00:25:33.629 05:10:12 -- common/autotest_common.sh@1360 -- # echo 952936 00:25:33.629 952936 00:25:33.629 05:10:12 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:25:33.629 05:10:12 -- host/perf.sh@78 -- # free_mb=20480 00:25:33.629 05:10:12 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u bcc9f6ca-c354-4826-838e-a65152ad2435 lbd_0 20480 00:25:33.887 05:10:12 -- host/perf.sh@80 -- # lb_guid=b8267ac1-4627-4e25-9676-8c231e523601 00:25:33.887 05:10:12 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore b8267ac1-4627-4e25-9676-8c231e523601 lvs_n_0 00:25:34.452 05:10:13 -- host/perf.sh@83 -- # ls_nested_guid=d39c5d3b-1223-4904-8e53-51d710758e8c 00:25:34.452 05:10:13 -- host/perf.sh@84 -- # get_lvs_free_mb d39c5d3b-1223-4904-8e53-51d710758e8c 00:25:34.452 05:10:13 -- common/autotest_common.sh@1350 -- # local lvs_uuid=d39c5d3b-1223-4904-8e53-51d710758e8c 00:25:34.452 05:10:13 -- common/autotest_common.sh@1351 -- # local lvs_info 00:25:34.452 05:10:13 -- common/autotest_common.sh@1352 -- # local fc 00:25:34.452 05:10:13 -- common/autotest_common.sh@1353 -- # local cs 00:25:34.452 05:10:13 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:34.710 05:10:13 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:25:34.710 { 00:25:34.710 "uuid": "bcc9f6ca-c354-4826-838e-a65152ad2435", 00:25:34.710 "name": "lvs_0", 00:25:34.710 "base_bdev": "Nvme0n1", 00:25:34.710 "total_data_clusters": 238234, 00:25:34.710 "free_clusters": 233114, 00:25:34.710 "block_size": 512, 00:25:34.710 "cluster_size": 4194304 00:25:34.710 }, 00:25:34.710 { 00:25:34.710 "uuid": "d39c5d3b-1223-4904-8e53-51d710758e8c", 00:25:34.710 "name": "lvs_n_0", 00:25:34.710 "base_bdev": "b8267ac1-4627-4e25-9676-8c231e523601", 00:25:34.710 "total_data_clusters": 5114, 00:25:34.710 "free_clusters": 5114, 00:25:34.710 "block_size": 512, 00:25:34.710 "cluster_size": 4194304 00:25:34.710 } 00:25:34.710 ]' 00:25:34.710 05:10:13 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="d39c5d3b-1223-4904-8e53-51d710758e8c") .free_clusters' 00:25:34.710 05:10:13 -- common/autotest_common.sh@1355 -- # fc=5114 00:25:34.710 05:10:13 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="d39c5d3b-1223-4904-8e53-51d710758e8c") .cluster_size' 00:25:34.710 05:10:13 -- common/autotest_common.sh@1356 -- # cs=4194304 00:25:34.710 05:10:13 -- common/autotest_common.sh@1359 -- # free_mb=20456 00:25:34.710 05:10:13 -- common/autotest_common.sh@1360 -- # echo 20456 00:25:34.710 20456 00:25:34.710 05:10:13 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:25:34.710 05:10:13 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d39c5d3b-1223-4904-8e53-51d710758e8c lbd_nest_0 20456 00:25:34.968 05:10:14 -- host/perf.sh@88 -- # lb_nested_guid=b470ab2d-154c-49bc-a632-6b13252f77d8 00:25:34.968 05:10:14 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:35.226 05:10:14 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:25:35.226 05:10:14 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 b470ab2d-154c-49bc-a632-6b13252f77d8 00:25:35.484 05:10:14 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:35.742 05:10:14 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:25:35.742 05:10:14 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:25:35.742 05:10:14 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:25:35.742 05:10:14 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:35.742 05:10:14 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:35.742 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.993 Initializing NVMe Controllers 00:25:47.993 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:47.993 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:47.993 Initialization complete. Launching workers. 00:25:47.993 ======================================================== 00:25:47.993 Latency(us) 00:25:47.993 Device Information : IOPS MiB/s Average min max 00:25:47.993 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.00 0.02 22793.61 193.53 48796.67 00:25:47.993 ======================================================== 00:25:47.993 Total : 44.00 0.02 22793.61 193.53 48796.67 00:25:47.993 00:25:47.993 05:10:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:47.993 05:10:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:47.993 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.972 Initializing NVMe Controllers 00:25:57.972 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:57.972 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:57.972 Initialization complete. Launching workers. 00:25:57.972 ======================================================== 00:25:57.972 Latency(us) 00:25:57.972 Device Information : IOPS MiB/s Average min max 00:25:57.972 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 80.60 10.07 12414.45 2567.58 47900.43 00:25:57.972 ======================================================== 00:25:57.972 Total : 80.60 10.07 12414.45 2567.58 47900.43 00:25:57.972 00:25:57.972 05:10:35 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:25:57.972 05:10:35 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:57.972 05:10:35 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:57.972 EAL: No free 2048 kB hugepages reported on node 1 00:26:07.955 Initializing NVMe Controllers 00:26:07.955 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:07.955 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:07.955 Initialization complete. Launching workers. 00:26:07.955 ======================================================== 00:26:07.955 Latency(us) 00:26:07.955 Device Information : IOPS MiB/s Average min max 00:26:07.955 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7231.60 3.53 4424.95 272.88 11721.31 00:26:07.955 ======================================================== 00:26:07.955 Total : 7231.60 3.53 4424.95 272.88 11721.31 00:26:07.955 00:26:07.955 05:10:45 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:07.955 05:10:45 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:07.955 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.962 Initializing NVMe Controllers 00:26:17.962 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:17.962 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:17.962 Initialization complete. Launching workers. 00:26:17.962 ======================================================== 00:26:17.962 Latency(us) 00:26:17.962 Device Information : IOPS MiB/s Average min max 00:26:17.962 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3013.53 376.69 10619.64 736.53 23124.65 00:26:17.962 ======================================================== 00:26:17.962 Total : 3013.53 376.69 10619.64 736.53 23124.65 00:26:17.962 00:26:17.962 05:10:56 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:17.962 05:10:56 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:17.963 05:10:56 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:17.963 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.976 Initializing NVMe Controllers 00:26:27.976 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:27.976 Controller IO queue size 128, less than required. 00:26:27.976 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:27.976 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:27.976 Initialization complete. Launching workers. 00:26:27.976 ======================================================== 00:26:27.976 Latency(us) 00:26:27.976 Device Information : IOPS MiB/s Average min max 00:26:27.976 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11806.31 5.76 10841.28 1755.92 30280.37 00:26:27.976 ======================================================== 00:26:27.976 Total : 11806.31 5.76 10841.28 1755.92 30280.37 00:26:27.976 00:26:27.976 05:11:06 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:27.976 05:11:06 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:27.976 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.948 Initializing NVMe Controllers 00:26:37.948 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:37.948 Controller IO queue size 128, less than required. 00:26:37.948 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:37.948 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:37.948 Initialization complete. Launching workers. 00:26:37.948 ======================================================== 00:26:37.948 Latency(us) 00:26:37.948 Device Information : IOPS MiB/s Average min max 00:26:37.948 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1201.50 150.19 106810.79 16189.99 233558.14 00:26:37.948 ======================================================== 00:26:37.948 Total : 1201.50 150.19 106810.79 16189.99 233558.14 00:26:37.948 00:26:37.948 05:11:16 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:38.205 05:11:17 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b470ab2d-154c-49bc-a632-6b13252f77d8 00:26:38.770 05:11:17 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:26:39.028 05:11:18 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b8267ac1-4627-4e25-9676-8c231e523601 00:26:39.595 05:11:18 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:26:39.595 05:11:18 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:26:39.595 05:11:18 -- host/perf.sh@114 -- # nvmftestfini 00:26:39.595 05:11:18 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:39.595 05:11:18 -- nvmf/common.sh@117 -- # sync 00:26:39.595 05:11:18 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:26:39.595 05:11:18 -- nvmf/common.sh@120 -- # set +e 00:26:39.595 05:11:18 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:39.595 05:11:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:26:39.595 rmmod nvme_tcp 00:26:39.595 rmmod nvme_fabrics 00:26:39.595 rmmod nvme_keyring 00:26:39.595 05:11:18 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:39.595 05:11:18 -- nvmf/common.sh@124 -- # set -e 00:26:39.595 05:11:18 -- nvmf/common.sh@125 -- # return 0 00:26:39.595 05:11:18 -- nvmf/common.sh@478 -- # '[' -n 2474043 ']' 00:26:39.595 05:11:18 -- nvmf/common.sh@479 -- # killprocess 2474043 00:26:39.595 05:11:18 -- common/autotest_common.sh@936 -- # '[' -z 2474043 ']' 00:26:39.595 05:11:18 -- common/autotest_common.sh@940 -- # kill -0 2474043 00:26:39.595 05:11:18 -- common/autotest_common.sh@941 -- # uname 00:26:39.595 05:11:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:39.595 05:11:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2474043 00:26:39.852 05:11:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:39.852 05:11:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:39.852 05:11:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2474043' 00:26:39.852 killing process with pid 2474043 00:26:39.852 05:11:18 -- common/autotest_common.sh@955 -- # kill 2474043 00:26:39.852 05:11:18 -- common/autotest_common.sh@960 -- # wait 2474043 00:26:41.227 05:11:20 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:41.227 05:11:20 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:26:41.227 05:11:20 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:26:41.227 05:11:20 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:41.227 05:11:20 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:26:41.227 05:11:20 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:41.227 05:11:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:41.227 05:11:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:43.757 05:11:22 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:26:43.757 00:26:43.757 real 1m30.820s 00:26:43.757 user 5m34.881s 00:26:43.757 sys 0m16.209s 00:26:43.757 05:11:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:43.757 05:11:22 -- common/autotest_common.sh@10 -- # set +x 00:26:43.757 ************************************ 00:26:43.757 END TEST nvmf_perf 00:26:43.757 ************************************ 00:26:43.757 05:11:22 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:26:43.757 05:11:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:43.757 05:11:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:43.757 05:11:22 -- common/autotest_common.sh@10 -- # set +x 00:26:43.757 ************************************ 00:26:43.757 START TEST nvmf_fio_host 00:26:43.757 ************************************ 00:26:43.757 05:11:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:26:43.757 * Looking for test storage... 00:26:43.757 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:43.757 05:11:22 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:43.757 05:11:22 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:43.757 05:11:22 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:43.757 05:11:22 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:43.757 05:11:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- paths/export.sh@5 -- # export PATH 00:26:43.757 05:11:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:43.757 05:11:22 -- nvmf/common.sh@7 -- # uname -s 00:26:43.757 05:11:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:43.757 05:11:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:43.757 05:11:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:43.757 05:11:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:43.757 05:11:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:43.757 05:11:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:43.757 05:11:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:43.757 05:11:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:43.757 05:11:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:43.757 05:11:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:43.757 05:11:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:43.757 05:11:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:43.757 05:11:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:43.757 05:11:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:43.757 05:11:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:43.757 05:11:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:43.757 05:11:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:43.757 05:11:22 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:43.757 05:11:22 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:43.757 05:11:22 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:43.757 05:11:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- paths/export.sh@5 -- # export PATH 00:26:43.757 05:11:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.757 05:11:22 -- nvmf/common.sh@47 -- # : 0 00:26:43.757 05:11:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:43.757 05:11:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:43.757 05:11:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:43.757 05:11:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:43.757 05:11:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:43.757 05:11:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:43.757 05:11:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:43.757 05:11:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:43.757 05:11:22 -- host/fio.sh@12 -- # nvmftestinit 00:26:43.757 05:11:22 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:26:43.757 05:11:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:43.757 05:11:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:43.757 05:11:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:43.757 05:11:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:43.757 05:11:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:43.757 05:11:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:43.757 05:11:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:43.757 05:11:22 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:43.757 05:11:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:43.757 05:11:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:43.757 05:11:22 -- common/autotest_common.sh@10 -- # set +x 00:26:45.657 05:11:24 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:45.657 05:11:24 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:45.657 05:11:24 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:45.657 05:11:24 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:45.657 05:11:24 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:45.657 05:11:24 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:45.657 05:11:24 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:45.657 05:11:24 -- nvmf/common.sh@295 -- # net_devs=() 00:26:45.657 05:11:24 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:45.657 05:11:24 -- nvmf/common.sh@296 -- # e810=() 00:26:45.657 05:11:24 -- nvmf/common.sh@296 -- # local -ga e810 00:26:45.657 05:11:24 -- nvmf/common.sh@297 -- # x722=() 00:26:45.657 05:11:24 -- nvmf/common.sh@297 -- # local -ga x722 00:26:45.657 05:11:24 -- nvmf/common.sh@298 -- # mlx=() 00:26:45.657 05:11:24 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:45.657 05:11:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:45.657 05:11:24 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:45.657 05:11:24 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:45.657 05:11:24 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:45.657 05:11:24 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:45.657 05:11:24 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:45.658 05:11:24 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:45.658 05:11:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:45.658 05:11:24 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:45.658 05:11:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:45.658 05:11:24 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:45.658 05:11:24 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:45.658 05:11:24 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:26:45.658 05:11:24 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:45.658 05:11:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:45.658 05:11:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:45.658 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:45.658 05:11:24 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:45.658 05:11:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:45.658 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:45.658 05:11:24 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:45.658 05:11:24 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:45.658 05:11:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.658 05:11:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:45.658 05:11:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.658 05:11:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:45.658 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:45.658 05:11:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.658 05:11:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:45.658 05:11:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.658 05:11:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:45.658 05:11:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.658 05:11:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:45.658 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:45.658 05:11:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.658 05:11:24 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:45.658 05:11:24 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:45.658 05:11:24 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:26:45.658 05:11:24 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:45.658 05:11:24 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:45.658 05:11:24 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:45.658 05:11:24 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:26:45.658 05:11:24 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:45.658 05:11:24 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:45.658 05:11:24 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:26:45.658 05:11:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:45.658 05:11:24 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:45.658 05:11:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:26:45.658 05:11:24 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:26:45.658 05:11:24 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:26:45.658 05:11:24 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:45.658 05:11:24 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:45.658 05:11:24 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:45.658 05:11:24 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:26:45.658 05:11:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:45.658 05:11:24 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:45.658 05:11:24 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:45.658 05:11:24 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:26:45.658 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:45.658 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:26:45.658 00:26:45.658 --- 10.0.0.2 ping statistics --- 00:26:45.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:45.658 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:26:45.658 05:11:24 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:45.658 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:45.658 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:26:45.658 00:26:45.658 --- 10.0.0.1 ping statistics --- 00:26:45.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:45.658 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:26:45.658 05:11:24 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:45.658 05:11:24 -- nvmf/common.sh@411 -- # return 0 00:26:45.658 05:11:24 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:45.658 05:11:24 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:45.658 05:11:24 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:26:45.658 05:11:24 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:45.658 05:11:24 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:26:45.658 05:11:24 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:26:45.658 05:11:24 -- host/fio.sh@14 -- # [[ y != y ]] 00:26:45.658 05:11:24 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:26:45.658 05:11:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:45.658 05:11:24 -- common/autotest_common.sh@10 -- # set +x 00:26:45.658 05:11:24 -- host/fio.sh@22 -- # nvmfpid=2486028 00:26:45.658 05:11:24 -- host/fio.sh@21 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:45.658 05:11:24 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:45.658 05:11:24 -- host/fio.sh@26 -- # waitforlisten 2486028 00:26:45.658 05:11:24 -- common/autotest_common.sh@817 -- # '[' -z 2486028 ']' 00:26:45.658 05:11:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:45.658 05:11:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:45.658 05:11:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:45.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:45.658 05:11:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:45.658 05:11:24 -- common/autotest_common.sh@10 -- # set +x 00:26:45.658 [2024-04-23 05:11:24.693753] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:26:45.658 [2024-04-23 05:11:24.693845] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:45.658 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.658 [2024-04-23 05:11:24.737614] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:26:45.658 [2024-04-23 05:11:24.768444] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:45.917 [2024-04-23 05:11:24.857255] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:45.917 [2024-04-23 05:11:24.857309] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:45.917 [2024-04-23 05:11:24.857331] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:45.917 [2024-04-23 05:11:24.857342] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:45.917 [2024-04-23 05:11:24.857359] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:45.917 [2024-04-23 05:11:24.857443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:45.917 [2024-04-23 05:11:24.857542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:45.917 [2024-04-23 05:11:24.857573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:45.917 [2024-04-23 05:11:24.857576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:45.917 05:11:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:45.917 05:11:24 -- common/autotest_common.sh@850 -- # return 0 00:26:45.917 05:11:24 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:45.917 05:11:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.917 05:11:24 -- common/autotest_common.sh@10 -- # set +x 00:26:45.917 [2024-04-23 05:11:24.984296] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:45.917 05:11:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.917 05:11:24 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:26:45.917 05:11:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:45.917 05:11:24 -- common/autotest_common.sh@10 -- # set +x 00:26:45.917 05:11:25 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:45.917 05:11:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.917 05:11:25 -- common/autotest_common.sh@10 -- # set +x 00:26:45.917 Malloc1 00:26:45.917 05:11:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.917 05:11:25 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:45.917 05:11:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.917 05:11:25 -- common/autotest_common.sh@10 -- # set +x 00:26:45.917 05:11:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.917 05:11:25 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:26:45.917 05:11:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.917 05:11:25 -- common/autotest_common.sh@10 -- # set +x 00:26:45.917 05:11:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.917 05:11:25 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:45.917 05:11:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.917 05:11:25 -- common/autotest_common.sh@10 -- # set +x 00:26:45.917 [2024-04-23 05:11:25.058175] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:45.917 05:11:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.917 05:11:25 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:45.917 05:11:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.917 05:11:25 -- common/autotest_common.sh@10 -- # set +x 00:26:45.917 05:11:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.917 05:11:25 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:26:45.917 05:11:25 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:45.917 05:11:25 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:45.917 05:11:25 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:26:45.917 05:11:25 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:45.917 05:11:25 -- common/autotest_common.sh@1325 -- # local sanitizers 00:26:45.917 05:11:25 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:45.917 05:11:25 -- common/autotest_common.sh@1327 -- # shift 00:26:45.917 05:11:25 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:26:45.917 05:11:25 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:26:45.918 05:11:25 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:45.918 05:11:25 -- common/autotest_common.sh@1331 -- # grep libasan 00:26:45.918 05:11:25 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:26:46.178 05:11:25 -- common/autotest_common.sh@1331 -- # asan_lib= 00:26:46.178 05:11:25 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:26:46.178 05:11:25 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:26:46.178 05:11:25 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:46.178 05:11:25 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:26:46.178 05:11:25 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:26:46.178 05:11:25 -- common/autotest_common.sh@1331 -- # asan_lib= 00:26:46.178 05:11:25 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:26:46.178 05:11:25 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:46.178 05:11:25 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:46.178 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:26:46.178 fio-3.35 00:26:46.178 Starting 1 thread 00:26:46.178 EAL: No free 2048 kB hugepages reported on node 1 00:26:48.709 00:26:48.709 test: (groupid=0, jobs=1): err= 0: pid=2486248: Tue Apr 23 05:11:27 2024 00:26:48.709 read: IOPS=8352, BW=32.6MiB/s (34.2MB/s)(65.5MiB/2007msec) 00:26:48.709 slat (usec): min=2, max=157, avg= 2.70, stdev= 1.89 00:26:48.709 clat (usec): min=2475, max=14095, avg=8426.63, stdev=669.51 00:26:48.709 lat (usec): min=2501, max=14097, avg=8429.33, stdev=669.35 00:26:48.709 clat percentiles (usec): 00:26:48.709 | 1.00th=[ 6915], 5.00th=[ 7373], 10.00th=[ 7635], 20.00th=[ 7898], 00:26:48.709 | 30.00th=[ 8094], 40.00th=[ 8291], 50.00th=[ 8455], 60.00th=[ 8586], 00:26:48.709 | 70.00th=[ 8717], 80.00th=[ 8979], 90.00th=[ 9241], 95.00th=[ 9372], 00:26:48.709 | 99.00th=[ 9896], 99.50th=[10028], 99.90th=[12518], 99.95th=[13829], 00:26:48.709 | 99.99th=[14091] 00:26:48.709 bw ( KiB/s): min=32840, max=34272, per=99.90%, avg=33376.00, stdev=620.47, samples=4 00:26:48.709 iops : min= 8210, max= 8568, avg=8344.00, stdev=155.12, samples=4 00:26:48.709 write: IOPS=8354, BW=32.6MiB/s (34.2MB/s)(65.5MiB/2007msec); 0 zone resets 00:26:48.709 slat (usec): min=2, max=139, avg= 2.85, stdev= 1.45 00:26:48.709 clat (usec): min=1425, max=13113, avg=6799.08, stdev=550.24 00:26:48.709 lat (usec): min=1435, max=13116, avg=6801.93, stdev=550.15 00:26:48.709 clat percentiles (usec): 00:26:48.709 | 1.00th=[ 5604], 5.00th=[ 5997], 10.00th=[ 6194], 20.00th=[ 6390], 00:26:48.709 | 30.00th=[ 6521], 40.00th=[ 6652], 50.00th=[ 6783], 60.00th=[ 6915], 00:26:48.709 | 70.00th=[ 7046], 80.00th=[ 7242], 90.00th=[ 7439], 95.00th=[ 7570], 00:26:48.709 | 99.00th=[ 7963], 99.50th=[ 8094], 99.90th=[10683], 99.95th=[11994], 00:26:48.709 | 99.99th=[13042] 00:26:48.709 bw ( KiB/s): min=32928, max=33816, per=100.00%, avg=33430.00, stdev=368.89, samples=4 00:26:48.709 iops : min= 8232, max= 8454, avg=8357.50, stdev=92.22, samples=4 00:26:48.709 lat (msec) : 2=0.03%, 4=0.12%, 10=99.50%, 20=0.34% 00:26:48.709 cpu : usr=59.37%, sys=36.54%, ctx=71, majf=0, minf=39 00:26:48.709 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:26:48.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:48.709 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:48.709 issued rwts: total=16763,16767,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:48.709 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:48.709 00:26:48.709 Run status group 0 (all jobs): 00:26:48.709 READ: bw=32.6MiB/s (34.2MB/s), 32.6MiB/s-32.6MiB/s (34.2MB/s-34.2MB/s), io=65.5MiB (68.7MB), run=2007-2007msec 00:26:48.709 WRITE: bw=32.6MiB/s (34.2MB/s), 32.6MiB/s-32.6MiB/s (34.2MB/s-34.2MB/s), io=65.5MiB (68.7MB), run=2007-2007msec 00:26:48.709 05:11:27 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:48.709 05:11:27 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:48.709 05:11:27 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:26:48.709 05:11:27 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:48.709 05:11:27 -- common/autotest_common.sh@1325 -- # local sanitizers 00:26:48.709 05:11:27 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:48.709 05:11:27 -- common/autotest_common.sh@1327 -- # shift 00:26:48.709 05:11:27 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:26:48.709 05:11:27 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # grep libasan 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # asan_lib= 00:26:48.709 05:11:27 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:26:48.709 05:11:27 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:26:48.709 05:11:27 -- common/autotest_common.sh@1331 -- # asan_lib= 00:26:48.709 05:11:27 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:26:48.709 05:11:27 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:48.709 05:11:27 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:48.967 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:26:48.967 fio-3.35 00:26:48.967 Starting 1 thread 00:26:48.967 EAL: No free 2048 kB hugepages reported on node 1 00:26:51.497 00:26:51.497 test: (groupid=0, jobs=1): err= 0: pid=2486698: Tue Apr 23 05:11:30 2024 00:26:51.497 read: IOPS=8369, BW=131MiB/s (137MB/s)(263MiB/2008msec) 00:26:51.497 slat (usec): min=2, max=113, avg= 3.65, stdev= 1.70 00:26:51.497 clat (usec): min=2317, max=16476, avg=8905.62, stdev=1950.76 00:26:51.497 lat (usec): min=2320, max=16479, avg=8909.26, stdev=1950.79 00:26:51.497 clat percentiles (usec): 00:26:51.497 | 1.00th=[ 4817], 5.00th=[ 5800], 10.00th=[ 6456], 20.00th=[ 7308], 00:26:51.497 | 30.00th=[ 7898], 40.00th=[ 8455], 50.00th=[ 8848], 60.00th=[ 9241], 00:26:51.497 | 70.00th=[ 9765], 80.00th=[10290], 90.00th=[11338], 95.00th=[12387], 00:26:51.497 | 99.00th=[14222], 99.50th=[14877], 99.90th=[15401], 99.95th=[15664], 00:26:51.497 | 99.99th=[15795] 00:26:51.497 bw ( KiB/s): min=54208, max=80480, per=50.67%, avg=67856.00, stdev=11649.01, samples=4 00:26:51.497 iops : min= 3388, max= 5030, avg=4241.00, stdev=728.06, samples=4 00:26:51.497 write: IOPS=4940, BW=77.2MiB/s (80.9MB/s)(139MiB/1802msec); 0 zone resets 00:26:51.497 slat (usec): min=30, max=205, avg=33.95, stdev= 5.68 00:26:51.497 clat (usec): min=6042, max=17881, avg=11336.32, stdev=1955.18 00:26:51.497 lat (usec): min=6073, max=17913, avg=11370.28, stdev=1955.43 00:26:51.497 clat percentiles (usec): 00:26:51.497 | 1.00th=[ 7570], 5.00th=[ 8455], 10.00th=[ 8979], 20.00th=[ 9634], 00:26:51.497 | 30.00th=[10159], 40.00th=[10552], 50.00th=[11076], 60.00th=[11600], 00:26:51.497 | 70.00th=[12256], 80.00th=[13042], 90.00th=[14091], 95.00th=[14746], 00:26:51.497 | 99.00th=[16057], 99.50th=[16581], 99.90th=[17695], 99.95th=[17695], 00:26:51.497 | 99.99th=[17957] 00:26:51.497 bw ( KiB/s): min=56992, max=83360, per=89.75%, avg=70944.00, stdev=12210.98, samples=4 00:26:51.497 iops : min= 3562, max= 5210, avg=4434.00, stdev=763.19, samples=4 00:26:51.497 lat (msec) : 4=0.16%, 10=57.79%, 20=42.05% 00:26:51.497 cpu : usr=74.99%, sys=22.37%, ctx=48, majf=0, minf=69 00:26:51.497 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:26:51.497 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:51.497 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:51.497 issued rwts: total=16805,8903,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:51.497 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:51.497 00:26:51.497 Run status group 0 (all jobs): 00:26:51.497 READ: bw=131MiB/s (137MB/s), 131MiB/s-131MiB/s (137MB/s-137MB/s), io=263MiB (275MB), run=2008-2008msec 00:26:51.497 WRITE: bw=77.2MiB/s (80.9MB/s), 77.2MiB/s-77.2MiB/s (80.9MB/s-80.9MB/s), io=139MiB (146MB), run=1802-1802msec 00:26:51.497 05:11:30 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:51.497 05:11:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:51.497 05:11:30 -- common/autotest_common.sh@10 -- # set +x 00:26:51.497 05:11:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:51.497 05:11:30 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:26:51.497 05:11:30 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:26:51.497 05:11:30 -- host/fio.sh@49 -- # get_nvme_bdfs 00:26:51.497 05:11:30 -- common/autotest_common.sh@1499 -- # bdfs=() 00:26:51.497 05:11:30 -- common/autotest_common.sh@1499 -- # local bdfs 00:26:51.497 05:11:30 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:26:51.497 05:11:30 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:51.497 05:11:30 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:26:51.497 05:11:30 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:26:51.497 05:11:30 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:88:00.0 00:26:51.497 05:11:30 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:26:51.497 05:11:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:51.497 05:11:30 -- common/autotest_common.sh@10 -- # set +x 00:26:54.063 Nvme0n1 00:26:54.063 05:11:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:54.063 05:11:33 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:26:54.063 05:11:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:54.063 05:11:33 -- common/autotest_common.sh@10 -- # set +x 00:26:57.356 05:11:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:57.356 05:11:35 -- host/fio.sh@51 -- # ls_guid=1ddb3585-55ad-4ccc-bb30-b515c7e2acb8 00:26:57.356 05:11:35 -- host/fio.sh@52 -- # get_lvs_free_mb 1ddb3585-55ad-4ccc-bb30-b515c7e2acb8 00:26:57.356 05:11:35 -- common/autotest_common.sh@1350 -- # local lvs_uuid=1ddb3585-55ad-4ccc-bb30-b515c7e2acb8 00:26:57.356 05:11:35 -- common/autotest_common.sh@1351 -- # local lvs_info 00:26:57.356 05:11:35 -- common/autotest_common.sh@1352 -- # local fc 00:26:57.356 05:11:35 -- common/autotest_common.sh@1353 -- # local cs 00:26:57.356 05:11:35 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:26:57.356 05:11:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:57.356 05:11:35 -- common/autotest_common.sh@10 -- # set +x 00:26:57.356 05:11:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:57.356 05:11:35 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:26:57.356 { 00:26:57.356 "uuid": "1ddb3585-55ad-4ccc-bb30-b515c7e2acb8", 00:26:57.356 "name": "lvs_0", 00:26:57.356 "base_bdev": "Nvme0n1", 00:26:57.356 "total_data_clusters": 930, 00:26:57.356 "free_clusters": 930, 00:26:57.356 "block_size": 512, 00:26:57.356 "cluster_size": 1073741824 00:26:57.356 } 00:26:57.356 ]' 00:26:57.356 05:11:35 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="1ddb3585-55ad-4ccc-bb30-b515c7e2acb8") .free_clusters' 00:26:57.356 05:11:35 -- common/autotest_common.sh@1355 -- # fc=930 00:26:57.356 05:11:35 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="1ddb3585-55ad-4ccc-bb30-b515c7e2acb8") .cluster_size' 00:26:57.356 05:11:35 -- common/autotest_common.sh@1356 -- # cs=1073741824 00:26:57.356 05:11:35 -- common/autotest_common.sh@1359 -- # free_mb=952320 00:26:57.356 05:11:35 -- common/autotest_common.sh@1360 -- # echo 952320 00:26:57.356 952320 00:26:57.356 05:11:35 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 952320 00:26:57.356 05:11:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:57.356 05:11:35 -- common/autotest_common.sh@10 -- # set +x 00:26:57.356 9965f6bc-279b-4dc6-af2a-e0b9d0c5b990 00:26:57.356 05:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:57.356 05:11:36 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:26:57.356 05:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:57.356 05:11:36 -- common/autotest_common.sh@10 -- # set +x 00:26:57.356 05:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:57.356 05:11:36 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:26:57.356 05:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:57.356 05:11:36 -- common/autotest_common.sh@10 -- # set +x 00:26:57.356 05:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:57.356 05:11:36 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:26:57.356 05:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:57.356 05:11:36 -- common/autotest_common.sh@10 -- # set +x 00:26:57.356 05:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:57.356 05:11:36 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:57.356 05:11:36 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:57.356 05:11:36 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:26:57.356 05:11:36 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:57.356 05:11:36 -- common/autotest_common.sh@1325 -- # local sanitizers 00:26:57.356 05:11:36 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:57.356 05:11:36 -- common/autotest_common.sh@1327 -- # shift 00:26:57.356 05:11:36 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:26:57.356 05:11:36 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # grep libasan 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # asan_lib= 00:26:57.356 05:11:36 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:26:57.356 05:11:36 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:26:57.356 05:11:36 -- common/autotest_common.sh@1331 -- # asan_lib= 00:26:57.356 05:11:36 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:26:57.356 05:11:36 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:57.356 05:11:36 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:57.356 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:26:57.356 fio-3.35 00:26:57.356 Starting 1 thread 00:26:57.356 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.885 00:26:59.885 test: (groupid=0, jobs=1): err= 0: pid=2487718: Tue Apr 23 05:11:38 2024 00:26:59.885 read: IOPS=5519, BW=21.6MiB/s (22.6MB/s)(43.3MiB/2008msec) 00:26:59.885 slat (nsec): min=1880, max=150529, avg=2431.27, stdev=2005.20 00:26:59.885 clat (usec): min=1197, max=172281, avg=12728.48, stdev=12081.47 00:26:59.885 lat (usec): min=1199, max=172312, avg=12730.91, stdev=12081.72 00:26:59.885 clat percentiles (msec): 00:26:59.885 | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 11], 00:26:59.885 | 30.00th=[ 12], 40.00th=[ 12], 50.00th=[ 12], 60.00th=[ 12], 00:26:59.885 | 70.00th=[ 13], 80.00th=[ 13], 90.00th=[ 14], 95.00th=[ 14], 00:26:59.885 | 99.00th=[ 15], 99.50th=[ 157], 99.90th=[ 174], 99.95th=[ 174], 00:26:59.885 | 99.99th=[ 174] 00:26:59.885 bw ( KiB/s): min=15352, max=24416, per=99.79%, avg=22032.00, stdev=4454.78, samples=4 00:26:59.885 iops : min= 3838, max= 6104, avg=5508.00, stdev=1113.70, samples=4 00:26:59.885 write: IOPS=5483, BW=21.4MiB/s (22.5MB/s)(43.0MiB/2008msec); 0 zone resets 00:26:59.885 slat (nsec): min=1989, max=104736, avg=2550.37, stdev=1503.95 00:26:59.885 clat (usec): min=354, max=169980, avg=10352.33, stdev=11364.59 00:26:59.885 lat (usec): min=357, max=170010, avg=10354.88, stdev=11364.81 00:26:59.885 clat percentiles (msec): 00:26:59.885 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 9], 00:26:59.885 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 10], 00:26:59.885 | 70.00th=[ 10], 80.00th=[ 11], 90.00th=[ 11], 95.00th=[ 11], 00:26:59.885 | 99.00th=[ 12], 99.50th=[ 155], 99.90th=[ 169], 99.95th=[ 171], 00:26:59.885 | 99.99th=[ 171] 00:26:59.885 bw ( KiB/s): min=16296, max=24064, per=99.85%, avg=21902.00, stdev=3743.36, samples=4 00:26:59.885 iops : min= 4074, max= 6016, avg=5475.50, stdev=935.84, samples=4 00:26:59.885 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:26:59.885 lat (msec) : 2=0.02%, 4=0.09%, 10=37.59%, 20=61.69%, 250=0.58% 00:26:59.885 cpu : usr=59.94%, sys=37.12%, ctx=102, majf=0, minf=39 00:26:59.885 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:26:59.885 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:59.885 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:59.885 issued rwts: total=11083,11011,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:59.885 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:59.885 00:26:59.885 Run status group 0 (all jobs): 00:26:59.885 READ: bw=21.6MiB/s (22.6MB/s), 21.6MiB/s-21.6MiB/s (22.6MB/s-22.6MB/s), io=43.3MiB (45.4MB), run=2008-2008msec 00:26:59.885 WRITE: bw=21.4MiB/s (22.5MB/s), 21.4MiB/s-21.4MiB/s (22.5MB/s-22.5MB/s), io=43.0MiB (45.1MB), run=2008-2008msec 00:26:59.885 05:11:38 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:59.885 05:11:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.885 05:11:38 -- common/autotest_common.sh@10 -- # set +x 00:26:59.885 05:11:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.885 05:11:38 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:26:59.885 05:11:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.885 05:11:38 -- common/autotest_common.sh@10 -- # set +x 00:27:00.452 05:11:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.452 05:11:39 -- host/fio.sh@62 -- # ls_nested_guid=7c5b9a5a-3e79-4ce6-b4a4-638b033cf5c6 00:27:00.452 05:11:39 -- host/fio.sh@63 -- # get_lvs_free_mb 7c5b9a5a-3e79-4ce6-b4a4-638b033cf5c6 00:27:00.452 05:11:39 -- common/autotest_common.sh@1350 -- # local lvs_uuid=7c5b9a5a-3e79-4ce6-b4a4-638b033cf5c6 00:27:00.452 05:11:39 -- common/autotest_common.sh@1351 -- # local lvs_info 00:27:00.452 05:11:39 -- common/autotest_common.sh@1352 -- # local fc 00:27:00.452 05:11:39 -- common/autotest_common.sh@1353 -- # local cs 00:27:00.452 05:11:39 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:27:00.452 05:11:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.452 05:11:39 -- common/autotest_common.sh@10 -- # set +x 00:27:00.452 05:11:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.452 05:11:39 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:27:00.452 { 00:27:00.452 "uuid": "1ddb3585-55ad-4ccc-bb30-b515c7e2acb8", 00:27:00.452 "name": "lvs_0", 00:27:00.452 "base_bdev": "Nvme0n1", 00:27:00.452 "total_data_clusters": 930, 00:27:00.452 "free_clusters": 0, 00:27:00.452 "block_size": 512, 00:27:00.452 "cluster_size": 1073741824 00:27:00.452 }, 00:27:00.452 { 00:27:00.452 "uuid": "7c5b9a5a-3e79-4ce6-b4a4-638b033cf5c6", 00:27:00.452 "name": "lvs_n_0", 00:27:00.452 "base_bdev": "9965f6bc-279b-4dc6-af2a-e0b9d0c5b990", 00:27:00.452 "total_data_clusters": 237847, 00:27:00.452 "free_clusters": 237847, 00:27:00.452 "block_size": 512, 00:27:00.452 "cluster_size": 4194304 00:27:00.452 } 00:27:00.452 ]' 00:27:00.452 05:11:39 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="7c5b9a5a-3e79-4ce6-b4a4-638b033cf5c6") .free_clusters' 00:27:00.452 05:11:39 -- common/autotest_common.sh@1355 -- # fc=237847 00:27:00.452 05:11:39 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="7c5b9a5a-3e79-4ce6-b4a4-638b033cf5c6") .cluster_size' 00:27:00.710 05:11:39 -- common/autotest_common.sh@1356 -- # cs=4194304 00:27:00.710 05:11:39 -- common/autotest_common.sh@1359 -- # free_mb=951388 00:27:00.710 05:11:39 -- common/autotest_common.sh@1360 -- # echo 951388 00:27:00.710 951388 00:27:00.710 05:11:39 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:00.711 05:11:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.711 05:11:39 -- common/autotest_common.sh@10 -- # set +x 00:27:00.969 391c1ab7-85fc-45a3-8d0d-61d1f2ee6953 00:27:00.969 05:11:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.969 05:11:40 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:00.969 05:11:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.969 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:27:00.969 05:11:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.969 05:11:40 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:00.969 05:11:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.969 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:27:00.969 05:11:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.969 05:11:40 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:00.969 05:11:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.969 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:27:00.969 05:11:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.969 05:11:40 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:00.969 05:11:40 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:00.969 05:11:40 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:27:00.969 05:11:40 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:00.969 05:11:40 -- common/autotest_common.sh@1325 -- # local sanitizers 00:27:00.969 05:11:40 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:00.969 05:11:40 -- common/autotest_common.sh@1327 -- # shift 00:27:00.969 05:11:40 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:27:00.969 05:11:40 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # grep libasan 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:00.969 05:11:40 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:00.969 05:11:40 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:00.969 05:11:40 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:00.969 05:11:40 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:00.969 05:11:40 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:00.969 05:11:40 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:01.228 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:01.228 fio-3.35 00:27:01.228 Starting 1 thread 00:27:01.228 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.759 00:27:03.759 test: (groupid=0, jobs=1): err= 0: pid=2488306: Tue Apr 23 05:11:42 2024 00:27:03.759 read: IOPS=5816, BW=22.7MiB/s (23.8MB/s)(45.6MiB/2009msec) 00:27:03.759 slat (nsec): min=1863, max=176895, avg=2470.95, stdev=2515.40 00:27:03.759 clat (usec): min=4462, max=19723, avg=12125.56, stdev=1071.03 00:27:03.759 lat (usec): min=4476, max=19725, avg=12128.03, stdev=1070.91 00:27:03.759 clat percentiles (usec): 00:27:03.759 | 1.00th=[ 9634], 5.00th=[10421], 10.00th=[10814], 20.00th=[11338], 00:27:03.759 | 30.00th=[11600], 40.00th=[11863], 50.00th=[12125], 60.00th=[12387], 00:27:03.759 | 70.00th=[12649], 80.00th=[13042], 90.00th=[13435], 95.00th=[13698], 00:27:03.759 | 99.00th=[14484], 99.50th=[14746], 99.90th=[17957], 99.95th=[19530], 00:27:03.759 | 99.99th=[19792] 00:27:03.759 bw ( KiB/s): min=21624, max=23816, per=99.86%, avg=23232.00, stdev=1072.62, samples=4 00:27:03.759 iops : min= 5406, max= 5954, avg=5808.00, stdev=268.15, samples=4 00:27:03.759 write: IOPS=5799, BW=22.7MiB/s (23.8MB/s)(45.5MiB/2009msec); 0 zone resets 00:27:03.759 slat (usec): min=2, max=131, avg= 2.60, stdev= 1.71 00:27:03.759 clat (usec): min=2209, max=17558, avg=9704.78, stdev=908.62 00:27:03.759 lat (usec): min=2214, max=17561, avg=9707.38, stdev=908.56 00:27:03.759 clat percentiles (usec): 00:27:03.759 | 1.00th=[ 7570], 5.00th=[ 8291], 10.00th=[ 8586], 20.00th=[ 9110], 00:27:03.759 | 30.00th=[ 9241], 40.00th=[ 9503], 50.00th=[ 9634], 60.00th=[ 9896], 00:27:03.759 | 70.00th=[10159], 80.00th=[10421], 90.00th=[10814], 95.00th=[11076], 00:27:03.759 | 99.00th=[11731], 99.50th=[11994], 99.90th=[15008], 99.95th=[16450], 00:27:03.759 | 99.99th=[17433] 00:27:03.759 bw ( KiB/s): min=22704, max=23592, per=99.95%, avg=23188.00, stdev=422.64, samples=4 00:27:03.759 iops : min= 5676, max= 5898, avg=5797.00, stdev=105.66, samples=4 00:27:03.759 lat (msec) : 4=0.04%, 10=32.54%, 20=67.42% 00:27:03.759 cpu : usr=59.91%, sys=37.25%, ctx=126, majf=0, minf=39 00:27:03.759 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:03.759 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:03.759 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:03.759 issued rwts: total=11685,11652,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:03.759 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:03.759 00:27:03.759 Run status group 0 (all jobs): 00:27:03.759 READ: bw=22.7MiB/s (23.8MB/s), 22.7MiB/s-22.7MiB/s (23.8MB/s-23.8MB/s), io=45.6MiB (47.9MB), run=2009-2009msec 00:27:03.759 WRITE: bw=22.7MiB/s (23.8MB/s), 22.7MiB/s-22.7MiB/s (23.8MB/s-23.8MB/s), io=45.5MiB (47.7MB), run=2009-2009msec 00:27:03.759 05:11:42 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:03.759 05:11:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:03.759 05:11:42 -- common/autotest_common.sh@10 -- # set +x 00:27:03.759 05:11:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:03.759 05:11:42 -- host/fio.sh@72 -- # sync 00:27:03.759 05:11:42 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:03.759 05:11:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:03.759 05:11:42 -- common/autotest_common.sh@10 -- # set +x 00:27:07.946 05:11:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:07.946 05:11:46 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:27:07.946 05:11:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:07.946 05:11:46 -- common/autotest_common.sh@10 -- # set +x 00:27:07.946 05:11:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:07.946 05:11:46 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:27:07.946 05:11:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:07.946 05:11:46 -- common/autotest_common.sh@10 -- # set +x 00:27:09.852 05:11:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:09.852 05:11:48 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:27:09.852 05:11:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:09.852 05:11:48 -- common/autotest_common.sh@10 -- # set +x 00:27:09.852 05:11:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:09.852 05:11:48 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:27:09.852 05:11:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:09.852 05:11:48 -- common/autotest_common.sh@10 -- # set +x 00:27:11.757 05:11:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:11.757 05:11:50 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:27:11.757 05:11:50 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:27:11.757 05:11:50 -- host/fio.sh@84 -- # nvmftestfini 00:27:11.757 05:11:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:11.757 05:11:50 -- nvmf/common.sh@117 -- # sync 00:27:11.757 05:11:50 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:27:11.757 05:11:50 -- nvmf/common.sh@120 -- # set +e 00:27:11.757 05:11:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:11.757 05:11:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:27:11.757 rmmod nvme_tcp 00:27:11.757 rmmod nvme_fabrics 00:27:11.757 rmmod nvme_keyring 00:27:11.757 05:11:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:11.757 05:11:50 -- nvmf/common.sh@124 -- # set -e 00:27:11.757 05:11:50 -- nvmf/common.sh@125 -- # return 0 00:27:11.757 05:11:50 -- nvmf/common.sh@478 -- # '[' -n 2486028 ']' 00:27:11.757 05:11:50 -- nvmf/common.sh@479 -- # killprocess 2486028 00:27:11.757 05:11:50 -- common/autotest_common.sh@936 -- # '[' -z 2486028 ']' 00:27:11.757 05:11:50 -- common/autotest_common.sh@940 -- # kill -0 2486028 00:27:11.757 05:11:50 -- common/autotest_common.sh@941 -- # uname 00:27:11.757 05:11:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:11.757 05:11:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486028 00:27:11.757 05:11:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:11.757 05:11:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:11.757 05:11:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486028' 00:27:11.757 killing process with pid 2486028 00:27:11.757 05:11:50 -- common/autotest_common.sh@955 -- # kill 2486028 00:27:11.757 05:11:50 -- common/autotest_common.sh@960 -- # wait 2486028 00:27:11.757 05:11:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:11.757 05:11:50 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:27:11.757 05:11:50 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:27:11.757 05:11:50 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:11.757 05:11:50 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:27:11.757 05:11:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:11.757 05:11:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:11.757 05:11:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:14.294 05:11:52 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:27:14.294 00:27:14.294 real 0m30.438s 00:27:14.294 user 1m50.239s 00:27:14.294 sys 0m6.036s 00:27:14.294 05:11:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:14.294 05:11:52 -- common/autotest_common.sh@10 -- # set +x 00:27:14.294 ************************************ 00:27:14.294 END TEST nvmf_fio_host 00:27:14.294 ************************************ 00:27:14.294 05:11:52 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:14.294 05:11:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:14.294 05:11:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:14.294 05:11:52 -- common/autotest_common.sh@10 -- # set +x 00:27:14.295 ************************************ 00:27:14.295 START TEST nvmf_failover 00:27:14.295 ************************************ 00:27:14.295 05:11:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:14.295 * Looking for test storage... 00:27:14.295 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:14.295 05:11:53 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:14.295 05:11:53 -- nvmf/common.sh@7 -- # uname -s 00:27:14.295 05:11:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:14.295 05:11:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:14.295 05:11:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:14.295 05:11:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:14.295 05:11:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:14.295 05:11:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:14.295 05:11:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:14.295 05:11:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:14.295 05:11:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:14.295 05:11:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:14.295 05:11:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:14.295 05:11:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:14.295 05:11:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:14.295 05:11:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:14.295 05:11:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:14.295 05:11:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:14.295 05:11:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:14.295 05:11:53 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:14.295 05:11:53 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:14.295 05:11:53 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:14.295 05:11:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.295 05:11:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.295 05:11:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.295 05:11:53 -- paths/export.sh@5 -- # export PATH 00:27:14.295 05:11:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.295 05:11:53 -- nvmf/common.sh@47 -- # : 0 00:27:14.295 05:11:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:14.295 05:11:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:14.295 05:11:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:14.295 05:11:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:14.295 05:11:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:14.295 05:11:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:14.295 05:11:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:14.295 05:11:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:14.295 05:11:53 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:14.295 05:11:53 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:14.295 05:11:53 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:14.295 05:11:53 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:14.295 05:11:53 -- host/failover.sh@18 -- # nvmftestinit 00:27:14.295 05:11:53 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:27:14.295 05:11:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:14.295 05:11:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:14.295 05:11:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:14.295 05:11:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:14.295 05:11:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:14.295 05:11:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:14.295 05:11:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:14.295 05:11:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:14.295 05:11:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:14.295 05:11:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:14.295 05:11:53 -- common/autotest_common.sh@10 -- # set +x 00:27:16.235 05:11:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:16.235 05:11:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:16.235 05:11:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:16.235 05:11:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:16.235 05:11:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:16.235 05:11:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:16.235 05:11:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:16.235 05:11:55 -- nvmf/common.sh@295 -- # net_devs=() 00:27:16.235 05:11:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:16.235 05:11:55 -- nvmf/common.sh@296 -- # e810=() 00:27:16.235 05:11:55 -- nvmf/common.sh@296 -- # local -ga e810 00:27:16.235 05:11:55 -- nvmf/common.sh@297 -- # x722=() 00:27:16.235 05:11:55 -- nvmf/common.sh@297 -- # local -ga x722 00:27:16.235 05:11:55 -- nvmf/common.sh@298 -- # mlx=() 00:27:16.235 05:11:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:16.235 05:11:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:16.235 05:11:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:16.235 05:11:55 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:27:16.235 05:11:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:16.235 05:11:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:16.235 05:11:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:16.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:16.235 05:11:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:16.235 05:11:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:16.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:16.235 05:11:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:16.235 05:11:55 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:16.235 05:11:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:16.235 05:11:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:16.235 05:11:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:16.235 05:11:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:16.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:16.235 05:11:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:16.235 05:11:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:16.235 05:11:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:16.235 05:11:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:16.235 05:11:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:16.235 05:11:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:16.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:16.235 05:11:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:16.235 05:11:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:16.235 05:11:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:16.235 05:11:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:27:16.235 05:11:55 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:27:16.235 05:11:55 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:16.235 05:11:55 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:16.235 05:11:55 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:16.235 05:11:55 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:27:16.235 05:11:55 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:16.235 05:11:55 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:16.235 05:11:55 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:27:16.235 05:11:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:16.235 05:11:55 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:16.235 05:11:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:27:16.235 05:11:55 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:27:16.235 05:11:55 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:27:16.235 05:11:55 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:16.235 05:11:55 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:16.235 05:11:55 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:16.235 05:11:55 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:27:16.235 05:11:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:16.235 05:11:55 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:16.235 05:11:55 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:16.235 05:11:55 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:27:16.235 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:16.235 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:27:16.235 00:27:16.235 --- 10.0.0.2 ping statistics --- 00:27:16.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:16.235 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:27:16.235 05:11:55 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:16.235 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:16.235 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.057 ms 00:27:16.235 00:27:16.236 --- 10.0.0.1 ping statistics --- 00:27:16.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:16.236 rtt min/avg/max/mdev = 0.057/0.057/0.057/0.000 ms 00:27:16.236 05:11:55 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:16.236 05:11:55 -- nvmf/common.sh@411 -- # return 0 00:27:16.236 05:11:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:16.236 05:11:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:16.236 05:11:55 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:27:16.236 05:11:55 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:27:16.236 05:11:55 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:16.236 05:11:55 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:27:16.236 05:11:55 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:27:16.236 05:11:55 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:16.236 05:11:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:16.236 05:11:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:16.236 05:11:55 -- common/autotest_common.sh@10 -- # set +x 00:27:16.236 05:11:55 -- nvmf/common.sh@470 -- # nvmfpid=2491416 00:27:16.236 05:11:55 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:16.236 05:11:55 -- nvmf/common.sh@471 -- # waitforlisten 2491416 00:27:16.236 05:11:55 -- common/autotest_common.sh@817 -- # '[' -z 2491416 ']' 00:27:16.236 05:11:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:16.236 05:11:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:16.236 05:11:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:16.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:16.236 05:11:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:16.236 05:11:55 -- common/autotest_common.sh@10 -- # set +x 00:27:16.236 [2024-04-23 05:11:55.250612] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:27:16.236 [2024-04-23 05:11:55.250690] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:16.236 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.236 [2024-04-23 05:11:55.287509] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:27:16.236 [2024-04-23 05:11:55.313305] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:16.236 [2024-04-23 05:11:55.399587] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:16.236 [2024-04-23 05:11:55.399675] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:16.236 [2024-04-23 05:11:55.399689] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:16.236 [2024-04-23 05:11:55.399701] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:16.236 [2024-04-23 05:11:55.399719] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:16.236 [2024-04-23 05:11:55.399821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:16.236 [2024-04-23 05:11:55.399890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:16.236 [2024-04-23 05:11:55.399893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:16.494 05:11:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:16.494 05:11:55 -- common/autotest_common.sh@850 -- # return 0 00:27:16.494 05:11:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:16.494 05:11:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:16.494 05:11:55 -- common/autotest_common.sh@10 -- # set +x 00:27:16.494 05:11:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:16.494 05:11:55 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:16.752 [2024-04-23 05:11:55.804607] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:16.752 05:11:55 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:27:17.009 Malloc0 00:27:17.009 05:11:56 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:17.267 05:11:56 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:17.525 05:11:56 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:17.783 [2024-04-23 05:11:56.930663] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:18.041 05:11:56 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:18.041 [2024-04-23 05:11:57.175372] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:18.041 05:11:57 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:18.300 [2024-04-23 05:11:57.460312] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:18.560 05:11:57 -- host/failover.sh@31 -- # bdevperf_pid=2491710 00:27:18.560 05:11:57 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:27:18.560 05:11:57 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:18.560 05:11:57 -- host/failover.sh@34 -- # waitforlisten 2491710 /var/tmp/bdevperf.sock 00:27:18.560 05:11:57 -- common/autotest_common.sh@817 -- # '[' -z 2491710 ']' 00:27:18.560 05:11:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:18.560 05:11:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:18.560 05:11:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:18.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:18.560 05:11:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:18.560 05:11:57 -- common/autotest_common.sh@10 -- # set +x 00:27:18.818 05:11:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:18.818 05:11:57 -- common/autotest_common.sh@850 -- # return 0 00:27:18.818 05:11:57 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:19.076 NVMe0n1 00:27:19.076 05:11:58 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:19.642 00:27:19.642 05:11:58 -- host/failover.sh@39 -- # run_test_pid=2491845 00:27:19.642 05:11:58 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:19.642 05:11:58 -- host/failover.sh@41 -- # sleep 1 00:27:20.577 05:11:59 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:20.836 [2024-04-23 05:11:59.985054] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985138] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985153] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985165] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985177] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985188] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985201] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985212] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985224] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985236] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985247] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985259] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985271] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985283] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985294] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985306] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985318] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985330] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985342] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985354] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.836 [2024-04-23 05:11:59.985365] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985377] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985388] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985400] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985422] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985435] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985447] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985458] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985469] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985481] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985492] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985526] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985539] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985552] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985564] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985576] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985587] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985599] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985610] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985622] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985634] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985646] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985657] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985668] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985679] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985691] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985702] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985714] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985725] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985736] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985748] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985764] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985776] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:20.837 [2024-04-23 05:11:59.985788] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0fe40 is same with the state(5) to be set 00:27:21.095 05:12:00 -- host/failover.sh@45 -- # sleep 3 00:27:24.376 05:12:03 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:24.376 00:27:24.376 05:12:03 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:24.635 [2024-04-23 05:12:03.592500] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592571] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592588] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592601] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592614] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592626] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592638] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592651] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592664] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.635 [2024-04-23 05:12:03.592677] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592690] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592702] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592714] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592729] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592750] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592762] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592775] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592788] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592811] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592823] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592835] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592857] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592871] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592883] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592894] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592907] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592919] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592931] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592943] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592954] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592967] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592979] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.592990] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593002] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593015] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593028] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593040] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593052] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593064] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593076] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593088] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593100] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593112] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593134] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593146] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593158] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593170] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593182] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593194] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593209] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593222] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593250] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593262] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593273] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593284] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593295] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593307] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593318] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593329] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593341] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593352] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593364] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593375] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593386] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593398] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593410] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593421] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593432] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593443] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593456] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 [2024-04-23 05:12:03.593467] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc10cd0 is same with the state(5) to be set 00:27:24.636 05:12:03 -- host/failover.sh@50 -- # sleep 3 00:27:27.922 05:12:06 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:27.922 [2024-04-23 05:12:06.846297] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:27.922 05:12:06 -- host/failover.sh@55 -- # sleep 1 00:27:28.857 05:12:07 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:29.114 [2024-04-23 05:12:08.124245] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc11830 is same with the state(5) to be set 00:27:29.115 [2024-04-23 05:12:08.124312] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc11830 is same with the state(5) to be set 00:27:29.115 [2024-04-23 05:12:08.124336] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc11830 is same with the state(5) to be set 00:27:29.115 [2024-04-23 05:12:08.124349] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc11830 is same with the state(5) to be set 00:27:29.115 [2024-04-23 05:12:08.124360] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc11830 is same with the state(5) to be set 00:27:29.115 [2024-04-23 05:12:08.124372] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc11830 is same with the state(5) to be set 00:27:29.115 [2024-04-23 05:12:08.124383] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc11830 is same with the state(5) to be set 00:27:29.115 05:12:08 -- host/failover.sh@59 -- # wait 2491845 00:27:35.687 0 00:27:35.687 05:12:13 -- host/failover.sh@61 -- # killprocess 2491710 00:27:35.687 05:12:13 -- common/autotest_common.sh@936 -- # '[' -z 2491710 ']' 00:27:35.687 05:12:13 -- common/autotest_common.sh@940 -- # kill -0 2491710 00:27:35.687 05:12:13 -- common/autotest_common.sh@941 -- # uname 00:27:35.687 05:12:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:35.687 05:12:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2491710 00:27:35.687 05:12:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:35.687 05:12:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:35.687 05:12:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2491710' 00:27:35.687 killing process with pid 2491710 00:27:35.687 05:12:13 -- common/autotest_common.sh@955 -- # kill 2491710 00:27:35.687 05:12:13 -- common/autotest_common.sh@960 -- # wait 2491710 00:27:35.687 05:12:14 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:35.687 [2024-04-23 05:11:57.523723] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:27:35.687 [2024-04-23 05:11:57.523813] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2491710 ] 00:27:35.687 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.688 [2024-04-23 05:11:57.555153] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:27:35.688 [2024-04-23 05:11:57.583332] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:35.688 [2024-04-23 05:11:57.667255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:35.688 Running I/O for 15 seconds... 00:27:35.688 [2024-04-23 05:11:59.986699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:81720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.986784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:81728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.986817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:81736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.986862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:81744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.986891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:81752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.986919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:81760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.986947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:81768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.986976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:81776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.986990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:81784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:81792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:81800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:81808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:81816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:81824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:81832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:81840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:81848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:81856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:81864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:81872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:81880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:81888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:81896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:81904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:81912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:81920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:81928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:81936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:81944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:81952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:81960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:81968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:81976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:81984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:81992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:82000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:82008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:82016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.688 [2024-04-23 05:11:59.987885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.688 [2024-04-23 05:11:59.987899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:82024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.987913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.987926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:82032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.987939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.987954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:82040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.987966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.987981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:82048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.987993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:82056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:82064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:82072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:82080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:82088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:82096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:82104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:82112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:82120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:82128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:82136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:82144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:82152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:82160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.689 [2024-04-23 05:11:59.988393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:82176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:82184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:82192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:82200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:82208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:82216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:82224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:82232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:82240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:82248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:82256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:82264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:82272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:82280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:82288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:82296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:82304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.988969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:82312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.988986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.989002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:82320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.989016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.989030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:82328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.989044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.989058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:82336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.989072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.989088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:82344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.689 [2024-04-23 05:11:59.989102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.689 [2024-04-23 05:11:59.989116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:82352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:82360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:82368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:82376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:82384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:82392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:82408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:82416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:82424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:82432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:82440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:82448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:82456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:82464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:82472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:82480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:82488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:82496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:82504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:82512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:82520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:82528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:82536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:82544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:82552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:82560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:82568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.989979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.989994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:82576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:82584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:82592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:82600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:82608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:82616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:82624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:82632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:82640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:82648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:82656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:82664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.690 [2024-04-23 05:11:59.990333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.690 [2024-04-23 05:11:59.990348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:82672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:82680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:82688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:82696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:82704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:82712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:82720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:82728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:82736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.691 [2024-04-23 05:11:59.990622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990652] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.691 [2024-04-23 05:11:59.990667] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.691 [2024-04-23 05:11:59.990687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:82168 len:8 PRP1 0x0 PRP2 0x0 00:27:35.691 [2024-04-23 05:11:59.990701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990771] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x16eb1e0 was disconnected and freed. reset controller. 00:27:35.691 [2024-04-23 05:11:59.990790] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:27:35.691 [2024-04-23 05:11:59.990839] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.691 [2024-04-23 05:11:59.990858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.691 [2024-04-23 05:11:59.990886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990916] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.691 [2024-04-23 05:11:59.990930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990950] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.691 [2024-04-23 05:11:59.990965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:11:59.990979] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.691 [2024-04-23 05:11:59.991029] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16cc290 (9): Bad file descriptor 00:27:35.691 [2024-04-23 05:11:59.994289] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.691 [2024-04-23 05:12:00.023734] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:35.691 [2024-04-23 05:12:03.594508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:68544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:68552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:68560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:68568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:68576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:68584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:68592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:68600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:68608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:68616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:68624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:68632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.691 [2024-04-23 05:12:03.594900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.691 [2024-04-23 05:12:03.594915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:68640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.594929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.594944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:68648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.594957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.594976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:68656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.594990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:68664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:68672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:68680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:68688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:68696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:68704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:68712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:68720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:68728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:68736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:68744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:68752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:68760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.723 [2024-04-23 05:12:03.595381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:68776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:68784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:68792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:68800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:68816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:68824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:68832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:68840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:68848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:68856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.723 [2024-04-23 05:12:03.595734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.723 [2024-04-23 05:12:03.595749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:68864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:68872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:68880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:68888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:68896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:68904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:68912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:68920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.595983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.595997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:68928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:68936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:68944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:68952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:68960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:68968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:68976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:68984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:68992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:69000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:69008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:69016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:69024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:69032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:69040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:69048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:69056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:69064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:69072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:69080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:69088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:69096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:69104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:69112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:69120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:69128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:69136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:69144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:69152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:69160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:69168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:69176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.724 [2024-04-23 05:12:03.596965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.724 [2024-04-23 05:12:03.596980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:69184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.596993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:69192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:69200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:69208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:69216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:69224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:69232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:69240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:69248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:69256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:69264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:69272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:69280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:69288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:69296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:69304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:69312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:69320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:69328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:69336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:68768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.725 [2024-04-23 05:12:03.597610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:69344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:69352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:69360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:69368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:69376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:69384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:69392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:69400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:69408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.725 [2024-04-23 05:12:03.597893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.597924] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.725 [2024-04-23 05:12:03.597941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69416 len:8 PRP1 0x0 PRP2 0x0 00:27:35.725 [2024-04-23 05:12:03.597954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.598013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.725 [2024-04-23 05:12:03.598049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.598064] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.725 [2024-04-23 05:12:03.598078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.598093] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.725 [2024-04-23 05:12:03.598107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.598121] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.725 [2024-04-23 05:12:03.598134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.598148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16cc290 is same with the state(5) to be set 00:27:35.725 [2024-04-23 05:12:03.598380] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.725 [2024-04-23 05:12:03.598418] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.725 [2024-04-23 05:12:03.598431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69424 len:8 PRP1 0x0 PRP2 0x0 00:27:35.725 [2024-04-23 05:12:03.598444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.725 [2024-04-23 05:12:03.598461] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598473] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69432 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598536] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598548] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69440 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598587] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598597] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69448 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598635] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598646] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69456 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598684] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598696] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69464 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598734] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598745] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69472 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598783] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598809] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69480 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598851] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598862] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69488 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598899] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598909] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69496 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598946] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.598956] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.598968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69504 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.598980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.598992] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599003] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69512 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599040] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599050] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69520 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599087] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599098] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69528 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599135] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599145] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69536 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599187] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599198] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69544 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599238] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599248] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69552 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599285] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599295] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69560 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599331] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599342] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68544 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599377] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599387] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68552 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599423] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599434] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68560 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599470] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599480] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68568 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599540] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599551] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68576 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599594] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599605] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68584 len:8 PRP1 0x0 PRP2 0x0 00:27:35.726 [2024-04-23 05:12:03.599638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.726 [2024-04-23 05:12:03.599651] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.726 [2024-04-23 05:12:03.599662] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.726 [2024-04-23 05:12:03.599674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68592 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.599687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.599700] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.599711] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.599722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68600 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.599735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.599748] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.599759] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.599770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68608 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.599783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.599811] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.599822] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.599833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68616 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.599845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.599858] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.599868] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.599879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68624 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.599892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.599905] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.599915] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.599926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68632 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.599938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.599951] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.599962] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.599973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68640 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.599990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600006] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600017] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68648 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600058] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600069] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68656 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600105] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600115] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68664 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600150] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600161] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68672 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600197] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600207] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68680 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600243] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600253] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68688 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600290] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600300] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68696 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600335] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600346] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68704 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600392] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600403] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68712 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600445] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600455] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68720 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600491] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600524] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68728 len:8 PRP1 0x0 PRP2 0x0 00:27:35.727 [2024-04-23 05:12:03.600550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.727 [2024-04-23 05:12:03.600564] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.727 [2024-04-23 05:12:03.600575] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.727 [2024-04-23 05:12:03.600586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68736 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.600598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.600612] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.600623] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.600634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68744 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.600646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.600659] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.600671] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.600682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68752 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.600694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.600708] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.600719] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.600730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68760 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.600743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.600756] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.600767] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.600781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68776 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.600800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.600829] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.600840] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68784 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608608] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608621] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68792 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608659] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608670] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68800 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608707] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608718] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68808 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608756] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608767] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68816 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608804] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608829] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68824 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608867] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608878] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68832 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608914] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608930] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.728 [2024-04-23 05:12:03.608942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68840 len:8 PRP1 0x0 PRP2 0x0 00:27:35.728 [2024-04-23 05:12:03.608956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.728 [2024-04-23 05:12:03.608970] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.728 [2024-04-23 05:12:03.608981] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.608992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68848 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609017] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609028] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68856 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609065] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609076] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68864 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609113] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609124] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68872 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609161] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609172] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68880 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609209] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609219] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68888 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609271] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609282] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68896 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609321] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609332] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68904 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609368] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609380] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68912 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609418] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609429] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68920 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609465] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609476] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68928 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609545] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609557] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68936 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609595] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609606] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68944 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609651] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609662] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68952 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609700] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609712] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68960 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609754] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609766] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68968 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609807] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609819] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68976 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609857] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609876] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68984 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609914] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609951] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.609962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:68992 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.609974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.609987] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.609998] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.610009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69000 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.610022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.610035] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.610045] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.610056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69008 len:8 PRP1 0x0 PRP2 0x0 00:27:35.729 [2024-04-23 05:12:03.610068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.729 [2024-04-23 05:12:03.610080] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.729 [2024-04-23 05:12:03.610090] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.729 [2024-04-23 05:12:03.610101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69016 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610131] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610141] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69024 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610182] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610192] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69032 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610228] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610238] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69040 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610275] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610287] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69048 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610323] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610334] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69056 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610369] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610380] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69064 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610416] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610426] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69072 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610462] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610472] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69080 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610548] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610561] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69088 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610611] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610622] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69096 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610663] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610674] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69104 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610714] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610726] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69112 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610765] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610776] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69120 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610831] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610843] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69128 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610896] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610909] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69136 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610945] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.610955] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.610966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69144 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.610983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.610996] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.611006] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.611017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69152 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.611029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.611042] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.611052] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.611063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69160 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.611077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.611091] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.611101] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.611112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69168 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.611124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.611137] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.611148] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.611158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69176 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.611170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.611183] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.611194] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.611205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69184 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.611217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.611229] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.611240] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.611251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69192 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.611263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.611276] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.730 [2024-04-23 05:12:03.611286] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.730 [2024-04-23 05:12:03.611297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69200 len:8 PRP1 0x0 PRP2 0x0 00:27:35.730 [2024-04-23 05:12:03.611309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.730 [2024-04-23 05:12:03.611322] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611332] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69208 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611371] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611382] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69216 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611417] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611427] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69224 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611464] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611474] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69232 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611535] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611547] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69240 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611586] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611597] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69248 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611634] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611645] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69256 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611683] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611694] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69264 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611731] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611745] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69272 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611784] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611795] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69280 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611847] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611857] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69288 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611893] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611904] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69296 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611939] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611949] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.611960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69304 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.611972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.611984] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.611995] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69312 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612030] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612041] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69320 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612076] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612086] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69328 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612124] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612135] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69336 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612171] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612182] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68768 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612217] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612233] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69344 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612270] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612281] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69352 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612317] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612327] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69360 len:8 PRP1 0x0 PRP2 0x0 00:27:35.731 [2024-04-23 05:12:03.612350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.731 [2024-04-23 05:12:03.612363] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.731 [2024-04-23 05:12:03.612374] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.731 [2024-04-23 05:12:03.612384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69368 len:8 PRP1 0x0 PRP2 0x0 00:27:35.732 [2024-04-23 05:12:03.612397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:03.612410] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.732 [2024-04-23 05:12:03.612420] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.732 [2024-04-23 05:12:03.612431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69376 len:8 PRP1 0x0 PRP2 0x0 00:27:35.732 [2024-04-23 05:12:03.612443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:03.612456] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.732 [2024-04-23 05:12:03.612466] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.732 [2024-04-23 05:12:03.612477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69384 len:8 PRP1 0x0 PRP2 0x0 00:27:35.732 [2024-04-23 05:12:03.612492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:03.612528] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.732 [2024-04-23 05:12:03.612540] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.732 [2024-04-23 05:12:03.612552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69392 len:8 PRP1 0x0 PRP2 0x0 00:27:35.732 [2024-04-23 05:12:03.612565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:03.612579] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.732 [2024-04-23 05:12:03.612590] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.732 [2024-04-23 05:12:03.612602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69400 len:8 PRP1 0x0 PRP2 0x0 00:27:35.732 [2024-04-23 05:12:03.612614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:03.612628] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.732 [2024-04-23 05:12:03.612640] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.732 [2024-04-23 05:12:03.612652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69408 len:8 PRP1 0x0 PRP2 0x0 00:27:35.732 [2024-04-23 05:12:03.612669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:03.612683] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.732 [2024-04-23 05:12:03.612694] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.732 [2024-04-23 05:12:03.612706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:69416 len:8 PRP1 0x0 PRP2 0x0 00:27:35.732 [2024-04-23 05:12:03.612719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:03.612781] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x16d87f0 was disconnected and freed. reset controller. 00:27:35.732 [2024-04-23 05:12:03.612799] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:27:35.732 [2024-04-23 05:12:03.612829] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.732 [2024-04-23 05:12:03.612879] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16cc290 (9): Bad file descriptor 00:27:35.732 [2024-04-23 05:12:03.616077] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.732 [2024-04-23 05:12:03.657698] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:35.732 [2024-04-23 05:12:08.124554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:125480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.124595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:125488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.124640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:125496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.124672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:125504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.124708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:124720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:124728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:124736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:124744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:124752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:124760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:124768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:124776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.124970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.124986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:124784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:124792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:124800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:124808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:124816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:124824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:124832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:124840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.732 [2024-04-23 05:12:08.125207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:125512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.125234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:125520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.125262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:125528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.125290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:125536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.125318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:125544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.125345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:125552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.732 [2024-04-23 05:12:08.125373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.732 [2024-04-23 05:12:08.125388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:125560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:125568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:125576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:125584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:125592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:125600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:125608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:125616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:125624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:125632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:125640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:125648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:125656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:125664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:125672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:125680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:125688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:125696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:125704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.125982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.125996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:125712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.126009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:125720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.126037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:125728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.733 [2024-04-23 05:12:08.126079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:124848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:124856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:124864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:124872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:124880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:124888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:124896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:124904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:124912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:124920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:124928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.733 [2024-04-23 05:12:08.126398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.733 [2024-04-23 05:12:08.126413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:124936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:124944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:124952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:124960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:124968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:124976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:124984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:124992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:125000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:125008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:125016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:125024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:125032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:125040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:125048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:125056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:125064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.126977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:125072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.126992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:125080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:125088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:125096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:125104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:125112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:125120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:125128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:125136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:125144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:125152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:125160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:125168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:125176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:125184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:125192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:125200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:125208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:125216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:125224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:125232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:125240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:125248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.734 [2024-04-23 05:12:08.127683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:125256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.734 [2024-04-23 05:12:08.127697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:125264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:125272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:125280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:125736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.735 [2024-04-23 05:12:08.127836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:125288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:125296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:125304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:125312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.127970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:125320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.127984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:125328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:125336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:125344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:125352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:125360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:125368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:125376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:125384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:125392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:125400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:125408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:125416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:125424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:125432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:125440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:125448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:125456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:125464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.735 [2024-04-23 05:12:08.128522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ef070 is same with the state(5) to be set 00:27:35.735 [2024-04-23 05:12:08.128579] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.735 [2024-04-23 05:12:08.128591] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.735 [2024-04-23 05:12:08.128603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:125472 len:8 PRP1 0x0 PRP2 0x0 00:27:35.735 [2024-04-23 05:12:08.128623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128683] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x16ef070 was disconnected and freed. reset controller. 00:27:35.735 [2024-04-23 05:12:08.128701] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:27:35.735 [2024-04-23 05:12:08.128734] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.735 [2024-04-23 05:12:08.128753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.735 [2024-04-23 05:12:08.128781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128796] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.735 [2024-04-23 05:12:08.128809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128824] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:35.735 [2024-04-23 05:12:08.128838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.735 [2024-04-23 05:12:08.128851] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.735 [2024-04-23 05:12:08.128898] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16cc290 (9): Bad file descriptor 00:27:35.735 [2024-04-23 05:12:08.132182] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.735 [2024-04-23 05:12:08.290497] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:35.735 00:27:35.735 Latency(us) 00:27:35.735 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:35.735 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:35.735 Verification LBA range: start 0x0 length 0x4000 00:27:35.735 NVMe0n1 : 15.02 8423.10 32.90 593.84 0.00 14168.50 807.06 28932.93 00:27:35.735 =================================================================================================================== 00:27:35.735 Total : 8423.10 32.90 593.84 0.00 14168.50 807.06 28932.93 00:27:35.735 Received shutdown signal, test time was about 15.000000 seconds 00:27:35.735 00:27:35.735 Latency(us) 00:27:35.735 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:35.735 =================================================================================================================== 00:27:35.735 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:35.736 05:12:14 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:27:35.736 05:12:14 -- host/failover.sh@65 -- # count=3 00:27:35.736 05:12:14 -- host/failover.sh@67 -- # (( count != 3 )) 00:27:35.736 05:12:14 -- host/failover.sh@73 -- # bdevperf_pid=2494182 00:27:35.736 05:12:14 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:27:35.736 05:12:14 -- host/failover.sh@75 -- # waitforlisten 2494182 /var/tmp/bdevperf.sock 00:27:35.736 05:12:14 -- common/autotest_common.sh@817 -- # '[' -z 2494182 ']' 00:27:35.736 05:12:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:35.736 05:12:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:35.736 05:12:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:35.736 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:35.736 05:12:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:35.736 05:12:14 -- common/autotest_common.sh@10 -- # set +x 00:27:35.736 05:12:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:35.736 05:12:14 -- common/autotest_common.sh@850 -- # return 0 00:27:35.736 05:12:14 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:35.736 [2024-04-23 05:12:14.603447] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:35.736 05:12:14 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:36.012 [2024-04-23 05:12:14.844128] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:36.012 05:12:14 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:36.271 NVMe0n1 00:27:36.271 05:12:15 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:36.530 00:27:36.530 05:12:15 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:37.096 00:27:37.096 05:12:16 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:37.096 05:12:16 -- host/failover.sh@82 -- # grep -q NVMe0 00:27:37.354 05:12:16 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:37.354 05:12:16 -- host/failover.sh@87 -- # sleep 3 00:27:40.646 05:12:19 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:40.646 05:12:19 -- host/failover.sh@88 -- # grep -q NVMe0 00:27:40.646 05:12:19 -- host/failover.sh@90 -- # run_test_pid=2494853 00:27:40.646 05:12:19 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:40.646 05:12:19 -- host/failover.sh@92 -- # wait 2494853 00:27:42.022 0 00:27:42.022 05:12:20 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:42.022 [2024-04-23 05:12:14.139725] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:27:42.022 [2024-04-23 05:12:14.139823] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2494182 ] 00:27:42.022 EAL: No free 2048 kB hugepages reported on node 1 00:27:42.022 [2024-04-23 05:12:14.172350] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:27:42.022 [2024-04-23 05:12:14.200730] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:42.022 [2024-04-23 05:12:14.281917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:42.023 [2024-04-23 05:12:16.479023] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:27:42.023 [2024-04-23 05:12:16.479109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:42.023 [2024-04-23 05:12:16.479133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:42.023 [2024-04-23 05:12:16.479162] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:42.023 [2024-04-23 05:12:16.479190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:42.023 [2024-04-23 05:12:16.479205] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:42.023 [2024-04-23 05:12:16.479220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:42.023 [2024-04-23 05:12:16.479234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:42.023 [2024-04-23 05:12:16.479247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:42.023 [2024-04-23 05:12:16.479261] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.023 [2024-04-23 05:12:16.479306] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.023 [2024-04-23 05:12:16.479339] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa8290 (9): Bad file descriptor 00:27:42.023 [2024-04-23 05:12:16.530651] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:42.023 Running I/O for 1 seconds... 00:27:42.023 00:27:42.023 Latency(us) 00:27:42.023 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:42.023 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:42.023 Verification LBA range: start 0x0 length 0x4000 00:27:42.023 NVMe0n1 : 1.00 8595.04 33.57 0.00 0.00 14830.74 1116.54 12815.93 00:27:42.023 =================================================================================================================== 00:27:42.023 Total : 8595.04 33.57 0.00 0.00 14830.74 1116.54 12815.93 00:27:42.023 05:12:20 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:42.023 05:12:20 -- host/failover.sh@95 -- # grep -q NVMe0 00:27:42.023 05:12:21 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:42.281 05:12:21 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:42.281 05:12:21 -- host/failover.sh@99 -- # grep -q NVMe0 00:27:42.539 05:12:21 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:42.797 05:12:21 -- host/failover.sh@101 -- # sleep 3 00:27:46.085 05:12:24 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:46.085 05:12:24 -- host/failover.sh@103 -- # grep -q NVMe0 00:27:46.085 05:12:25 -- host/failover.sh@108 -- # killprocess 2494182 00:27:46.085 05:12:25 -- common/autotest_common.sh@936 -- # '[' -z 2494182 ']' 00:27:46.085 05:12:25 -- common/autotest_common.sh@940 -- # kill -0 2494182 00:27:46.085 05:12:25 -- common/autotest_common.sh@941 -- # uname 00:27:46.085 05:12:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:46.085 05:12:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2494182 00:27:46.085 05:12:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:46.085 05:12:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:46.085 05:12:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2494182' 00:27:46.085 killing process with pid 2494182 00:27:46.085 05:12:25 -- common/autotest_common.sh@955 -- # kill 2494182 00:27:46.085 05:12:25 -- common/autotest_common.sh@960 -- # wait 2494182 00:27:46.343 05:12:25 -- host/failover.sh@110 -- # sync 00:27:46.343 05:12:25 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:46.605 05:12:25 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:27:46.605 05:12:25 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:46.605 05:12:25 -- host/failover.sh@116 -- # nvmftestfini 00:27:46.605 05:12:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:46.605 05:12:25 -- nvmf/common.sh@117 -- # sync 00:27:46.605 05:12:25 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:27:46.605 05:12:25 -- nvmf/common.sh@120 -- # set +e 00:27:46.605 05:12:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:46.605 05:12:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:27:46.605 rmmod nvme_tcp 00:27:46.605 rmmod nvme_fabrics 00:27:46.605 rmmod nvme_keyring 00:27:46.605 05:12:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:46.605 05:12:25 -- nvmf/common.sh@124 -- # set -e 00:27:46.605 05:12:25 -- nvmf/common.sh@125 -- # return 0 00:27:46.605 05:12:25 -- nvmf/common.sh@478 -- # '[' -n 2491416 ']' 00:27:46.605 05:12:25 -- nvmf/common.sh@479 -- # killprocess 2491416 00:27:46.605 05:12:25 -- common/autotest_common.sh@936 -- # '[' -z 2491416 ']' 00:27:46.605 05:12:25 -- common/autotest_common.sh@940 -- # kill -0 2491416 00:27:46.605 05:12:25 -- common/autotest_common.sh@941 -- # uname 00:27:46.605 05:12:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:46.605 05:12:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2491416 00:27:46.605 05:12:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:46.605 05:12:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:46.605 05:12:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2491416' 00:27:46.605 killing process with pid 2491416 00:27:46.605 05:12:25 -- common/autotest_common.sh@955 -- # kill 2491416 00:27:46.605 05:12:25 -- common/autotest_common.sh@960 -- # wait 2491416 00:27:46.862 05:12:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:46.862 05:12:25 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:27:46.862 05:12:25 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:27:46.862 05:12:25 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:46.862 05:12:25 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:27:46.862 05:12:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:46.862 05:12:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:46.862 05:12:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.399 05:12:28 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:27:49.399 00:27:49.399 real 0m34.952s 00:27:49.399 user 2m3.605s 00:27:49.399 sys 0m5.696s 00:27:49.399 05:12:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:49.399 05:12:28 -- common/autotest_common.sh@10 -- # set +x 00:27:49.399 ************************************ 00:27:49.399 END TEST nvmf_failover 00:27:49.399 ************************************ 00:27:49.399 05:12:28 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:27:49.399 05:12:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:49.399 05:12:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:49.399 05:12:28 -- common/autotest_common.sh@10 -- # set +x 00:27:49.399 ************************************ 00:27:49.399 START TEST nvmf_discovery 00:27:49.399 ************************************ 00:27:49.399 05:12:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:27:49.399 * Looking for test storage... 00:27:49.399 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:49.399 05:12:28 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:49.399 05:12:28 -- nvmf/common.sh@7 -- # uname -s 00:27:49.399 05:12:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:49.399 05:12:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:49.399 05:12:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:49.399 05:12:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:49.399 05:12:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:49.399 05:12:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:49.399 05:12:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:49.399 05:12:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:49.399 05:12:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:49.399 05:12:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:49.399 05:12:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.399 05:12:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.399 05:12:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:49.399 05:12:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:49.399 05:12:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:49.399 05:12:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:49.399 05:12:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:49.399 05:12:28 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:49.399 05:12:28 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:49.399 05:12:28 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:49.399 05:12:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.399 05:12:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.399 05:12:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.399 05:12:28 -- paths/export.sh@5 -- # export PATH 00:27:49.399 05:12:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.399 05:12:28 -- nvmf/common.sh@47 -- # : 0 00:27:49.399 05:12:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:49.399 05:12:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:49.399 05:12:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:49.399 05:12:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:49.399 05:12:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:49.399 05:12:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:49.399 05:12:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:49.399 05:12:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:49.399 05:12:28 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:27:49.399 05:12:28 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:27:49.399 05:12:28 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:27:49.399 05:12:28 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:27:49.399 05:12:28 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:27:49.399 05:12:28 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:27:49.400 05:12:28 -- host/discovery.sh@25 -- # nvmftestinit 00:27:49.400 05:12:28 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:27:49.400 05:12:28 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:49.400 05:12:28 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:49.400 05:12:28 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:49.400 05:12:28 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:49.400 05:12:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.400 05:12:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:49.400 05:12:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.400 05:12:28 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:49.400 05:12:28 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:49.400 05:12:28 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:49.400 05:12:28 -- common/autotest_common.sh@10 -- # set +x 00:27:51.306 05:12:30 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:51.306 05:12:30 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:51.306 05:12:30 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:51.306 05:12:30 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:51.306 05:12:30 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:51.306 05:12:30 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:51.306 05:12:30 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:51.306 05:12:30 -- nvmf/common.sh@295 -- # net_devs=() 00:27:51.306 05:12:30 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:51.306 05:12:30 -- nvmf/common.sh@296 -- # e810=() 00:27:51.306 05:12:30 -- nvmf/common.sh@296 -- # local -ga e810 00:27:51.306 05:12:30 -- nvmf/common.sh@297 -- # x722=() 00:27:51.306 05:12:30 -- nvmf/common.sh@297 -- # local -ga x722 00:27:51.306 05:12:30 -- nvmf/common.sh@298 -- # mlx=() 00:27:51.306 05:12:30 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:51.306 05:12:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:51.306 05:12:30 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:51.306 05:12:30 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:27:51.306 05:12:30 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:51.306 05:12:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:51.306 05:12:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:51.306 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:51.306 05:12:30 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:51.306 05:12:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:51.306 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:51.306 05:12:30 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:51.306 05:12:30 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:51.306 05:12:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.306 05:12:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:51.306 05:12:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.306 05:12:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:51.306 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:51.306 05:12:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.306 05:12:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:51.306 05:12:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.306 05:12:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:51.306 05:12:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.306 05:12:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:51.306 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:51.306 05:12:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.306 05:12:30 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:51.306 05:12:30 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:51.306 05:12:30 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:27:51.306 05:12:30 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:27:51.306 05:12:30 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:51.306 05:12:30 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:51.306 05:12:30 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:51.306 05:12:30 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:27:51.306 05:12:30 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:51.306 05:12:30 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:51.306 05:12:30 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:27:51.306 05:12:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:51.306 05:12:30 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:51.306 05:12:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:27:51.306 05:12:30 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:27:51.306 05:12:30 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:27:51.306 05:12:30 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:51.306 05:12:30 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:51.306 05:12:30 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:51.306 05:12:30 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:27:51.306 05:12:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:51.306 05:12:30 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:51.306 05:12:30 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:51.306 05:12:30 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:27:51.306 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:51.306 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:27:51.307 00:27:51.307 --- 10.0.0.2 ping statistics --- 00:27:51.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.307 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:27:51.307 05:12:30 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:51.307 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:51.307 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:27:51.307 00:27:51.307 --- 10.0.0.1 ping statistics --- 00:27:51.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.307 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:27:51.307 05:12:30 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:51.307 05:12:30 -- nvmf/common.sh@411 -- # return 0 00:27:51.307 05:12:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:51.307 05:12:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:51.307 05:12:30 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:27:51.307 05:12:30 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:27:51.307 05:12:30 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:51.307 05:12:30 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:27:51.307 05:12:30 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:27:51.307 05:12:30 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:27:51.307 05:12:30 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:51.307 05:12:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:51.307 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.307 05:12:30 -- nvmf/common.sh@470 -- # nvmfpid=2497573 00:27:51.307 05:12:30 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:27:51.307 05:12:30 -- nvmf/common.sh@471 -- # waitforlisten 2497573 00:27:51.307 05:12:30 -- common/autotest_common.sh@817 -- # '[' -z 2497573 ']' 00:27:51.307 05:12:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:51.307 05:12:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:51.307 05:12:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:51.307 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:51.307 05:12:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:51.307 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.307 [2024-04-23 05:12:30.335550] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:27:51.307 [2024-04-23 05:12:30.335628] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:51.307 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.307 [2024-04-23 05:12:30.373642] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:27:51.307 [2024-04-23 05:12:30.400172] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:51.566 [2024-04-23 05:12:30.486892] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:51.566 [2024-04-23 05:12:30.486962] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:51.566 [2024-04-23 05:12:30.486976] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:51.566 [2024-04-23 05:12:30.486987] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:51.566 [2024-04-23 05:12:30.486997] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:51.566 [2024-04-23 05:12:30.487033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:51.566 05:12:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:51.566 05:12:30 -- common/autotest_common.sh@850 -- # return 0 00:27:51.566 05:12:30 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:51.566 05:12:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:51.566 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.566 05:12:30 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:51.566 05:12:30 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:51.566 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:51.566 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.566 [2024-04-23 05:12:30.630963] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:51.566 05:12:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:51.566 05:12:30 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:27:51.566 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:51.566 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.566 [2024-04-23 05:12:30.639192] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:27:51.566 05:12:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:51.566 05:12:30 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:27:51.566 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:51.566 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.566 null0 00:27:51.566 05:12:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:51.566 05:12:30 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:27:51.566 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:51.566 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.566 null1 00:27:51.566 05:12:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:51.566 05:12:30 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:27:51.566 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:51.566 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.566 05:12:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:51.566 05:12:30 -- host/discovery.sh@45 -- # hostpid=2497593 00:27:51.566 05:12:30 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:27:51.566 05:12:30 -- host/discovery.sh@46 -- # waitforlisten 2497593 /tmp/host.sock 00:27:51.566 05:12:30 -- common/autotest_common.sh@817 -- # '[' -z 2497593 ']' 00:27:51.566 05:12:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/tmp/host.sock 00:27:51.566 05:12:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:51.566 05:12:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:27:51.566 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:27:51.566 05:12:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:51.566 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.566 [2024-04-23 05:12:30.711255] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:27:51.566 [2024-04-23 05:12:30.711321] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2497593 ] 00:27:51.826 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.826 [2024-04-23 05:12:30.744471] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:27:51.826 [2024-04-23 05:12:30.774701] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:51.826 [2024-04-23 05:12:30.864932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:51.826 05:12:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:51.826 05:12:30 -- common/autotest_common.sh@850 -- # return 0 00:27:51.826 05:12:30 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:51.826 05:12:30 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:27:51.826 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:51.826 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.826 05:12:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:51.827 05:12:30 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:27:51.827 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:51.827 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:30 -- host/discovery.sh@72 -- # notify_id=0 00:27:52.086 05:12:30 -- host/discovery.sh@83 -- # get_subsystem_names 00:27:52.086 05:12:30 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:52.086 05:12:30 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:52.086 05:12:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:30 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:30 -- host/discovery.sh@59 -- # sort 00:27:52.086 05:12:30 -- host/discovery.sh@59 -- # xargs 00:27:52.086 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:31 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:27:52.086 05:12:31 -- host/discovery.sh@84 -- # get_bdev_list 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:52.086 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:52.086 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # sort 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # xargs 00:27:52.086 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:31 -- host/discovery.sh@84 -- # [[ '' == '' ]] 00:27:52.086 05:12:31 -- host/discovery.sh@86 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:27:52.086 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:31 -- host/discovery.sh@87 -- # get_subsystem_names 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:52.086 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # sort 00:27:52.086 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # xargs 00:27:52.086 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:31 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:27:52.086 05:12:31 -- host/discovery.sh@88 -- # get_bdev_list 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:52.086 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # sort 00:27:52.086 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # xargs 00:27:52.086 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:31 -- host/discovery.sh@88 -- # [[ '' == '' ]] 00:27:52.086 05:12:31 -- host/discovery.sh@90 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:27:52.086 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:31 -- host/discovery.sh@91 -- # get_subsystem_names 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:52.086 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # sort 00:27:52.086 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:31 -- host/discovery.sh@59 -- # xargs 00:27:52.086 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.086 05:12:31 -- host/discovery.sh@91 -- # [[ '' == '' ]] 00:27:52.086 05:12:31 -- host/discovery.sh@92 -- # get_bdev_list 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:52.086 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.086 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # sort 00:27:52.086 05:12:31 -- host/discovery.sh@55 -- # xargs 00:27:52.345 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.345 05:12:31 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:27:52.345 05:12:31 -- host/discovery.sh@96 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:52.345 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.345 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.345 [2024-04-23 05:12:31.284860] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:52.345 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.345 05:12:31 -- host/discovery.sh@97 -- # get_subsystem_names 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:52.345 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:52.345 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # sort 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # xargs 00:27:52.345 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.345 05:12:31 -- host/discovery.sh@97 -- # [[ '' == '' ]] 00:27:52.345 05:12:31 -- host/discovery.sh@98 -- # get_bdev_list 00:27:52.345 05:12:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:52.345 05:12:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:52.345 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.345 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.345 05:12:31 -- host/discovery.sh@55 -- # sort 00:27:52.345 05:12:31 -- host/discovery.sh@55 -- # xargs 00:27:52.345 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.345 05:12:31 -- host/discovery.sh@98 -- # [[ '' == '' ]] 00:27:52.345 05:12:31 -- host/discovery.sh@99 -- # is_notification_count_eq 0 00:27:52.345 05:12:31 -- host/discovery.sh@79 -- # expected_count=0 00:27:52.345 05:12:31 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:27:52.345 05:12:31 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:27:52.345 05:12:31 -- common/autotest_common.sh@901 -- # local max=10 00:27:52.345 05:12:31 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:52.345 05:12:31 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:27:52.345 05:12:31 -- common/autotest_common.sh@903 -- # get_notification_count 00:27:52.345 05:12:31 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:27:52.345 05:12:31 -- host/discovery.sh@74 -- # jq '. | length' 00:27:52.345 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.345 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.345 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.345 05:12:31 -- host/discovery.sh@74 -- # notification_count=0 00:27:52.345 05:12:31 -- host/discovery.sh@75 -- # notify_id=0 00:27:52.345 05:12:31 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:27:52.345 05:12:31 -- common/autotest_common.sh@904 -- # return 0 00:27:52.345 05:12:31 -- host/discovery.sh@103 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:27:52.345 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.345 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.345 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.345 05:12:31 -- host/discovery.sh@105 -- # waitforcondition '[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:27:52.345 05:12:31 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:27:52.345 05:12:31 -- common/autotest_common.sh@901 -- # local max=10 00:27:52.345 05:12:31 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:52.345 05:12:31 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:27:52.345 05:12:31 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:52.345 05:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.345 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # sort 00:27:52.345 05:12:31 -- host/discovery.sh@59 -- # xargs 00:27:52.345 05:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.345 05:12:31 -- common/autotest_common.sh@903 -- # [[ '' == \n\v\m\e\0 ]] 00:27:52.345 05:12:31 -- common/autotest_common.sh@906 -- # sleep 1 00:27:52.911 [2024-04-23 05:12:32.049711] bdev_nvme.c:6919:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:27:52.911 [2024-04-23 05:12:32.049748] bdev_nvme.c:6999:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:27:52.911 [2024-04-23 05:12:32.049777] bdev_nvme.c:6882:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:53.169 [2024-04-23 05:12:32.137049] bdev_nvme.c:6848:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:27:53.169 [2024-04-23 05:12:32.199564] bdev_nvme.c:6738:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:27:53.169 [2024-04-23 05:12:32.199587] bdev_nvme.c:6697:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:27:53.428 05:12:32 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:27:53.428 05:12:32 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:53.428 05:12:32 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:53.428 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.428 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.428 05:12:32 -- host/discovery.sh@59 -- # sort 00:27:53.428 05:12:32 -- host/discovery.sh@59 -- # xargs 00:27:53.428 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:27:53.428 05:12:32 -- common/autotest_common.sh@904 -- # return 0 00:27:53.428 05:12:32 -- host/discovery.sh@106 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1" ]]' 00:27:53.428 05:12:32 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1" ]]' 00:27:53.428 05:12:32 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.428 05:12:32 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1"' ']]' 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # get_bdev_list 00:27:53.428 05:12:32 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:53.428 05:12:32 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:53.428 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.428 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.428 05:12:32 -- host/discovery.sh@55 -- # sort 00:27:53.428 05:12:32 -- host/discovery.sh@55 -- # xargs 00:27:53.428 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:27:53.428 05:12:32 -- common/autotest_common.sh@904 -- # return 0 00:27:53.428 05:12:32 -- host/discovery.sh@107 -- # waitforcondition '[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT" ]]' 00:27:53.428 05:12:32 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT" ]]' 00:27:53.428 05:12:32 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.428 05:12:32 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_PORT"' ']]' 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:27:53.428 05:12:32 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:53.428 05:12:32 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:53.428 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.428 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.428 05:12:32 -- host/discovery.sh@63 -- # sort -n 00:27:53.428 05:12:32 -- host/discovery.sh@63 -- # xargs 00:27:53.428 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # [[ 4420 == \4\4\2\0 ]] 00:27:53.428 05:12:32 -- common/autotest_common.sh@904 -- # return 0 00:27:53.428 05:12:32 -- host/discovery.sh@108 -- # is_notification_count_eq 1 00:27:53.428 05:12:32 -- host/discovery.sh@79 -- # expected_count=1 00:27:53.428 05:12:32 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:27:53.428 05:12:32 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:27:53.428 05:12:32 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.428 05:12:32 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:27:53.428 05:12:32 -- common/autotest_common.sh@903 -- # get_notification_count 00:27:53.688 05:12:32 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:27:53.688 05:12:32 -- host/discovery.sh@74 -- # jq '. | length' 00:27:53.688 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.688 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.688 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.688 05:12:32 -- host/discovery.sh@74 -- # notification_count=1 00:27:53.688 05:12:32 -- host/discovery.sh@75 -- # notify_id=1 00:27:53.688 05:12:32 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:27:53.688 05:12:32 -- common/autotest_common.sh@904 -- # return 0 00:27:53.688 05:12:32 -- host/discovery.sh@111 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:27:53.688 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.688 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.688 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.688 05:12:32 -- host/discovery.sh@113 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:27:53.688 05:12:32 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:27:53.688 05:12:32 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.688 05:12:32 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.688 05:12:32 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1' 'nvme0n2"' ']]' 00:27:53.688 05:12:32 -- common/autotest_common.sh@903 -- # get_bdev_list 00:27:53.688 05:12:32 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:53.688 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.688 05:12:32 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:53.688 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.688 05:12:32 -- host/discovery.sh@55 -- # sort 00:27:53.688 05:12:32 -- host/discovery.sh@55 -- # xargs 00:27:53.948 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.948 05:12:32 -- common/autotest_common.sh@903 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:53.948 05:12:32 -- common/autotest_common.sh@904 -- # return 0 00:27:53.948 05:12:32 -- host/discovery.sh@114 -- # is_notification_count_eq 1 00:27:53.948 05:12:32 -- host/discovery.sh@79 -- # expected_count=1 00:27:53.948 05:12:32 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:27:53.949 05:12:32 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:27:53.949 05:12:32 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.949 05:12:32 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.949 05:12:32 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:27:53.949 05:12:32 -- common/autotest_common.sh@903 -- # get_notification_count 00:27:53.949 05:12:32 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:27:53.949 05:12:32 -- host/discovery.sh@74 -- # jq '. | length' 00:27:53.949 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.949 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.949 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.949 05:12:32 -- host/discovery.sh@74 -- # notification_count=1 00:27:53.949 05:12:32 -- host/discovery.sh@75 -- # notify_id=2 00:27:53.949 05:12:32 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:27:53.949 05:12:32 -- common/autotest_common.sh@904 -- # return 0 00:27:53.949 05:12:32 -- host/discovery.sh@118 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:27:53.949 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.949 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.949 [2024-04-23 05:12:32.969952] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:53.949 [2024-04-23 05:12:32.971037] bdev_nvme.c:6901:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:27:53.949 [2024-04-23 05:12:32.971078] bdev_nvme.c:6882:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:53.949 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.949 05:12:32 -- host/discovery.sh@120 -- # waitforcondition '[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:27:53.949 05:12:32 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:27:53.949 05:12:32 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.949 05:12:32 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.949 05:12:32 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:27:53.949 05:12:32 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:27:53.949 05:12:32 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:53.949 05:12:32 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:53.949 05:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.949 05:12:32 -- common/autotest_common.sh@10 -- # set +x 00:27:53.949 05:12:32 -- host/discovery.sh@59 -- # sort 00:27:53.949 05:12:32 -- host/discovery.sh@59 -- # xargs 00:27:53.949 05:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.949 05:12:33 -- common/autotest_common.sh@903 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:27:53.949 05:12:33 -- common/autotest_common.sh@904 -- # return 0 00:27:53.949 05:12:33 -- host/discovery.sh@121 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:27:53.949 05:12:33 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:27:53.949 05:12:33 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.949 05:12:33 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.949 05:12:33 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1' 'nvme0n2"' ']]' 00:27:53.949 05:12:33 -- common/autotest_common.sh@903 -- # get_bdev_list 00:27:53.949 05:12:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:53.949 05:12:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.949 05:12:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:53.949 05:12:33 -- common/autotest_common.sh@10 -- # set +x 00:27:53.949 05:12:33 -- host/discovery.sh@55 -- # sort 00:27:53.949 05:12:33 -- host/discovery.sh@55 -- # xargs 00:27:53.949 05:12:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.949 [2024-04-23 05:12:33.057721] bdev_nvme.c:6843:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:27:53.949 05:12:33 -- common/autotest_common.sh@903 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:53.949 05:12:33 -- common/autotest_common.sh@904 -- # return 0 00:27:53.949 05:12:33 -- host/discovery.sh@122 -- # waitforcondition '[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT $NVMF_SECOND_PORT" ]]' 00:27:53.949 05:12:33 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT $NVMF_SECOND_PORT" ]]' 00:27:53.949 05:12:33 -- common/autotest_common.sh@901 -- # local max=10 00:27:53.949 05:12:33 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:53.949 05:12:33 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_PORT' '$NVMF_SECOND_PORT"' ']]' 00:27:53.949 05:12:33 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:27:53.949 05:12:33 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:53.949 05:12:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:53.949 05:12:33 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:53.949 05:12:33 -- common/autotest_common.sh@10 -- # set +x 00:27:53.949 05:12:33 -- host/discovery.sh@63 -- # sort -n 00:27:53.949 05:12:33 -- host/discovery.sh@63 -- # xargs 00:27:53.949 05:12:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:53.949 05:12:33 -- common/autotest_common.sh@903 -- # [[ 4420 == \4\4\2\0\ \4\4\2\1 ]] 00:27:53.949 05:12:33 -- common/autotest_common.sh@906 -- # sleep 1 00:27:54.230 [2024-04-23 05:12:33.162375] bdev_nvme.c:6738:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:27:54.230 [2024-04-23 05:12:33.162401] bdev_nvme.c:6697:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:27:54.230 [2024-04-23 05:12:33.162412] bdev_nvme.c:6697:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:27:55.171 05:12:34 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:55.171 05:12:34 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_PORT' '$NVMF_SECOND_PORT"' ']]' 00:27:55.171 05:12:34 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:27:55.171 05:12:34 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:55.171 05:12:34 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:55.171 05:12:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:55.171 05:12:34 -- common/autotest_common.sh@10 -- # set +x 00:27:55.171 05:12:34 -- host/discovery.sh@63 -- # sort -n 00:27:55.171 05:12:34 -- host/discovery.sh@63 -- # xargs 00:27:55.171 05:12:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:55.171 05:12:34 -- common/autotest_common.sh@903 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:27:55.171 05:12:34 -- common/autotest_common.sh@904 -- # return 0 00:27:55.171 05:12:34 -- host/discovery.sh@123 -- # is_notification_count_eq 0 00:27:55.171 05:12:34 -- host/discovery.sh@79 -- # expected_count=0 00:27:55.171 05:12:34 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:27:55.171 05:12:34 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:27:55.171 05:12:34 -- common/autotest_common.sh@901 -- # local max=10 00:27:55.171 05:12:34 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:55.171 05:12:34 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:27:55.171 05:12:34 -- common/autotest_common.sh@903 -- # get_notification_count 00:27:55.171 05:12:34 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:27:55.171 05:12:34 -- host/discovery.sh@74 -- # jq '. | length' 00:27:55.171 05:12:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:55.171 05:12:34 -- common/autotest_common.sh@10 -- # set +x 00:27:55.171 05:12:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:55.171 05:12:34 -- host/discovery.sh@74 -- # notification_count=0 00:27:55.171 05:12:34 -- host/discovery.sh@75 -- # notify_id=2 00:27:55.171 05:12:34 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:27:55.171 05:12:34 -- common/autotest_common.sh@904 -- # return 0 00:27:55.171 05:12:34 -- host/discovery.sh@127 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:55.171 05:12:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:55.171 05:12:34 -- common/autotest_common.sh@10 -- # set +x 00:27:55.171 [2024-04-23 05:12:34.197826] bdev_nvme.c:6901:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:27:55.171 [2024-04-23 05:12:34.197867] bdev_nvme.c:6882:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:55.171 [2024-04-23 05:12:34.200038] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.172 [2024-04-23 05:12:34.200071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.172 [2024-04-23 05:12:34.200103] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.172 [2024-04-23 05:12:34.200117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.172 [2024-04-23 05:12:34.200130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.172 [2024-04-23 05:12:34.200160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.172 [2024-04-23 05:12:34.200175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.172 [2024-04-23 05:12:34.200189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.172 [2024-04-23 05:12:34.200203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 05:12:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:55.172 05:12:34 -- host/discovery.sh@129 -- # waitforcondition '[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@901 -- # local max=10 00:27:55.172 05:12:34 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:27:55.172 05:12:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:55.172 05:12:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:55.172 05:12:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:55.172 05:12:34 -- common/autotest_common.sh@10 -- # set +x 00:27:55.172 05:12:34 -- host/discovery.sh@59 -- # sort 00:27:55.172 05:12:34 -- host/discovery.sh@59 -- # xargs 00:27:55.172 [2024-04-23 05:12:34.210041] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 05:12:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:55.172 [2024-04-23 05:12:34.220086] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 [2024-04-23 05:12:34.220346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.220498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.220538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.172 [2024-04-23 05:12:34.220567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 [2024-04-23 05:12:34.220591] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 [2024-04-23 05:12:34.220629] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.172 [2024-04-23 05:12:34.220648] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.172 [2024-04-23 05:12:34.220665] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.172 [2024-04-23 05:12:34.220686] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.172 [2024-04-23 05:12:34.230162] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 [2024-04-23 05:12:34.230327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.230481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.230507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.172 [2024-04-23 05:12:34.230537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 [2024-04-23 05:12:34.230567] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 [2024-04-23 05:12:34.230588] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.172 [2024-04-23 05:12:34.230602] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.172 [2024-04-23 05:12:34.230616] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.172 [2024-04-23 05:12:34.230635] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.172 [2024-04-23 05:12:34.240231] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 [2024-04-23 05:12:34.240446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.240635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.240674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.172 [2024-04-23 05:12:34.240691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 [2024-04-23 05:12:34.240713] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 [2024-04-23 05:12:34.240748] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.172 [2024-04-23 05:12:34.240768] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.172 [2024-04-23 05:12:34.240784] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.172 [2024-04-23 05:12:34.240818] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:27:55.172 05:12:34 -- common/autotest_common.sh@904 -- # return 0 00:27:55.172 05:12:34 -- host/discovery.sh@130 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@901 -- # local max=10 00:27:55.172 05:12:34 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1' 'nvme0n2"' ']]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # get_bdev_list 00:27:55.172 05:12:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:55.172 05:12:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:55.172 05:12:34 -- common/autotest_common.sh@10 -- # set +x 00:27:55.172 05:12:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:55.172 05:12:34 -- host/discovery.sh@55 -- # sort 00:27:55.172 05:12:34 -- host/discovery.sh@55 -- # xargs 00:27:55.172 [2024-04-23 05:12:34.250308] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 [2024-04-23 05:12:34.250531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.250667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.250693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.172 [2024-04-23 05:12:34.250710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 [2024-04-23 05:12:34.250733] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 [2024-04-23 05:12:34.250767] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.172 [2024-04-23 05:12:34.250786] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.172 [2024-04-23 05:12:34.250800] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.172 [2024-04-23 05:12:34.250820] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.172 [2024-04-23 05:12:34.260387] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 [2024-04-23 05:12:34.260587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.260750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.260775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.172 [2024-04-23 05:12:34.260793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 [2024-04-23 05:12:34.260823] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 [2024-04-23 05:12:34.260886] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.172 [2024-04-23 05:12:34.260906] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.172 [2024-04-23 05:12:34.260921] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.172 [2024-04-23 05:12:34.260940] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.172 [2024-04-23 05:12:34.270460] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 [2024-04-23 05:12:34.270678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.270821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.270847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.172 [2024-04-23 05:12:34.270864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 [2024-04-23 05:12:34.270887] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 [2024-04-23 05:12:34.270921] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.172 [2024-04-23 05:12:34.270939] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.172 [2024-04-23 05:12:34.270953] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.172 [2024-04-23 05:12:34.270972] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.172 05:12:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:55.172 [2024-04-23 05:12:34.280554] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 [2024-04-23 05:12:34.280729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.280865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.172 [2024-04-23 05:12:34.280891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.172 [2024-04-23 05:12:34.280908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.172 [2024-04-23 05:12:34.280941] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.172 [2024-04-23 05:12:34.280986] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.172 [2024-04-23 05:12:34.281021] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.172 [2024-04-23 05:12:34.281035] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.172 [2024-04-23 05:12:34.281054] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:55.172 05:12:34 -- common/autotest_common.sh@904 -- # return 0 00:27:55.172 05:12:34 -- host/discovery.sh@131 -- # waitforcondition '[[ "$(get_subsystem_paths nvme0)" == "$NVMF_SECOND_PORT" ]]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_paths nvme0)" == "$NVMF_SECOND_PORT" ]]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@901 -- # local max=10 00:27:55.172 05:12:34 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_SECOND_PORT"' ']]' 00:27:55.172 05:12:34 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:27:55.172 05:12:34 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:55.172 [2024-04-23 05:12:34.290642] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.172 05:12:34 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:55.173 05:12:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:55.173 [2024-04-23 05:12:34.290827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.290937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.290964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.173 05:12:34 -- common/autotest_common.sh@10 -- # set +x 00:27:55.173 [2024-04-23 05:12:34.290982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.173 [2024-04-23 05:12:34.291005] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.173 05:12:34 -- host/discovery.sh@63 -- # sort -n 00:27:55.173 [2024-04-23 05:12:34.291039] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.173 [2024-04-23 05:12:34.291062] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.173 [2024-04-23 05:12:34.291076] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.173 [2024-04-23 05:12:34.291096] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.173 05:12:34 -- host/discovery.sh@63 -- # xargs 00:27:55.173 05:12:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:55.173 [2024-04-23 05:12:34.300722] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.173 [2024-04-23 05:12:34.301159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.301313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.301340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.173 [2024-04-23 05:12:34.301357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.173 [2024-04-23 05:12:34.301379] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.173 [2024-04-23 05:12:34.301425] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.173 [2024-04-23 05:12:34.301445] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.173 [2024-04-23 05:12:34.301460] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.173 [2024-04-23 05:12:34.301479] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.173 [2024-04-23 05:12:34.310796] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.173 [2024-04-23 05:12:34.311012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.311182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.311207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.173 [2024-04-23 05:12:34.311223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.173 [2024-04-23 05:12:34.311245] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.173 [2024-04-23 05:12:34.311266] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.173 [2024-04-23 05:12:34.311280] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.173 [2024-04-23 05:12:34.311302] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.173 [2024-04-23 05:12:34.311322] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.173 [2024-04-23 05:12:34.320880] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:55.173 [2024-04-23 05:12:34.321088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.321206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.173 [2024-04-23 05:12:34.321232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b7d730 with addr=10.0.0.2, port=4420 00:27:55.173 [2024-04-23 05:12:34.321248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b7d730 is same with the state(5) to be set 00:27:55.173 [2024-04-23 05:12:34.321269] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b7d730 (9): Bad file descriptor 00:27:55.173 [2024-04-23 05:12:34.321290] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:55.173 [2024-04-23 05:12:34.321305] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:55.173 [2024-04-23 05:12:34.321318] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:55.173 [2024-04-23 05:12:34.321337] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:55.173 [2024-04-23 05:12:34.324524] bdev_nvme.c:6706:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:27:55.173 [2024-04-23 05:12:34.324553] bdev_nvme.c:6697:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:27:55.173 05:12:34 -- common/autotest_common.sh@903 -- # [[ 4420 4421 == \4\4\2\1 ]] 00:27:55.173 05:12:34 -- common/autotest_common.sh@906 -- # sleep 1 00:27:56.553 05:12:35 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_SECOND_PORT"' ']]' 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:27:56.553 05:12:35 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:56.553 05:12:35 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:56.553 05:12:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:56.553 05:12:35 -- common/autotest_common.sh@10 -- # set +x 00:27:56.553 05:12:35 -- host/discovery.sh@63 -- # sort -n 00:27:56.553 05:12:35 -- host/discovery.sh@63 -- # xargs 00:27:56.553 05:12:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # [[ 4421 == \4\4\2\1 ]] 00:27:56.553 05:12:35 -- common/autotest_common.sh@904 -- # return 0 00:27:56.553 05:12:35 -- host/discovery.sh@132 -- # is_notification_count_eq 0 00:27:56.553 05:12:35 -- host/discovery.sh@79 -- # expected_count=0 00:27:56.553 05:12:35 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:27:56.553 05:12:35 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:27:56.553 05:12:35 -- common/autotest_common.sh@901 -- # local max=10 00:27:56.553 05:12:35 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # get_notification_count 00:27:56.553 05:12:35 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:27:56.553 05:12:35 -- host/discovery.sh@74 -- # jq '. | length' 00:27:56.553 05:12:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:56.553 05:12:35 -- common/autotest_common.sh@10 -- # set +x 00:27:56.553 05:12:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:56.553 05:12:35 -- host/discovery.sh@74 -- # notification_count=0 00:27:56.553 05:12:35 -- host/discovery.sh@75 -- # notify_id=2 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:27:56.553 05:12:35 -- common/autotest_common.sh@904 -- # return 0 00:27:56.553 05:12:35 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:27:56.553 05:12:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:56.553 05:12:35 -- common/autotest_common.sh@10 -- # set +x 00:27:56.553 05:12:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:56.553 05:12:35 -- host/discovery.sh@136 -- # waitforcondition '[[ "$(get_subsystem_names)" == "" ]]' 00:27:56.553 05:12:35 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "" ]]' 00:27:56.553 05:12:35 -- common/autotest_common.sh@901 -- # local max=10 00:27:56.553 05:12:35 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '""' ']]' 00:27:56.553 05:12:35 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:27:56.554 05:12:35 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:56.554 05:12:35 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:56.554 05:12:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:56.554 05:12:35 -- host/discovery.sh@59 -- # sort 00:27:56.554 05:12:35 -- common/autotest_common.sh@10 -- # set +x 00:27:56.554 05:12:35 -- host/discovery.sh@59 -- # xargs 00:27:56.554 05:12:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:56.554 05:12:35 -- common/autotest_common.sh@903 -- # [[ '' == '' ]] 00:27:56.554 05:12:35 -- common/autotest_common.sh@904 -- # return 0 00:27:56.554 05:12:35 -- host/discovery.sh@137 -- # waitforcondition '[[ "$(get_bdev_list)" == "" ]]' 00:27:56.554 05:12:35 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "" ]]' 00:27:56.554 05:12:35 -- common/autotest_common.sh@901 -- # local max=10 00:27:56.554 05:12:35 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:56.554 05:12:35 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '""' ']]' 00:27:56.554 05:12:35 -- common/autotest_common.sh@903 -- # get_bdev_list 00:27:56.554 05:12:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:56.554 05:12:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:56.554 05:12:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:56.554 05:12:35 -- common/autotest_common.sh@10 -- # set +x 00:27:56.554 05:12:35 -- host/discovery.sh@55 -- # sort 00:27:56.554 05:12:35 -- host/discovery.sh@55 -- # xargs 00:27:56.554 05:12:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:56.554 05:12:35 -- common/autotest_common.sh@903 -- # [[ '' == '' ]] 00:27:56.554 05:12:35 -- common/autotest_common.sh@904 -- # return 0 00:27:56.554 05:12:35 -- host/discovery.sh@138 -- # is_notification_count_eq 2 00:27:56.554 05:12:35 -- host/discovery.sh@79 -- # expected_count=2 00:27:56.554 05:12:35 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:27:56.554 05:12:35 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:27:56.554 05:12:35 -- common/autotest_common.sh@901 -- # local max=10 00:27:56.554 05:12:35 -- common/autotest_common.sh@902 -- # (( max-- )) 00:27:56.554 05:12:35 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:27:56.554 05:12:35 -- common/autotest_common.sh@903 -- # get_notification_count 00:27:56.554 05:12:35 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:27:56.554 05:12:35 -- host/discovery.sh@74 -- # jq '. | length' 00:27:56.554 05:12:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:56.554 05:12:35 -- common/autotest_common.sh@10 -- # set +x 00:27:56.554 05:12:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:56.554 05:12:35 -- host/discovery.sh@74 -- # notification_count=2 00:27:56.554 05:12:35 -- host/discovery.sh@75 -- # notify_id=4 00:27:56.554 05:12:35 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:27:56.554 05:12:35 -- common/autotest_common.sh@904 -- # return 0 00:27:56.554 05:12:35 -- host/discovery.sh@141 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:56.554 05:12:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:56.554 05:12:35 -- common/autotest_common.sh@10 -- # set +x 00:27:57.493 [2024-04-23 05:12:36.621682] bdev_nvme.c:6919:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:27:57.493 [2024-04-23 05:12:36.621732] bdev_nvme.c:6999:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:27:57.493 [2024-04-23 05:12:36.621757] bdev_nvme.c:6882:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:57.752 [2024-04-23 05:12:36.709007] bdev_nvme.c:6848:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:27:57.752 [2024-04-23 05:12:36.775438] bdev_nvme.c:6738:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:27:57.752 [2024-04-23 05:12:36.775489] bdev_nvme.c:6697:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:27:57.752 05:12:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:57.752 05:12:36 -- host/discovery.sh@143 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:57.752 05:12:36 -- common/autotest_common.sh@638 -- # local es=0 00:27:57.752 05:12:36 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:57.752 05:12:36 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:27:57.752 05:12:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:27:57.752 05:12:36 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:27:57.752 05:12:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:27:57.752 05:12:36 -- common/autotest_common.sh@641 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:57.752 05:12:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:57.752 05:12:36 -- common/autotest_common.sh@10 -- # set +x 00:27:57.752 request: 00:27:57.752 { 00:27:57.752 "name": "nvme", 00:27:57.752 "trtype": "tcp", 00:27:57.752 "traddr": "10.0.0.2", 00:27:57.752 "hostnqn": "nqn.2021-12.io.spdk:test", 00:27:57.752 "adrfam": "ipv4", 00:27:57.752 "trsvcid": "8009", 00:27:57.752 "wait_for_attach": true, 00:27:57.752 "method": "bdev_nvme_start_discovery", 00:27:57.752 "req_id": 1 00:27:57.752 } 00:27:57.752 Got JSON-RPC error response 00:27:57.752 response: 00:27:57.752 { 00:27:57.752 "code": -17, 00:27:57.752 "message": "File exists" 00:27:57.752 } 00:27:57.752 05:12:36 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:27:57.752 05:12:36 -- common/autotest_common.sh@641 -- # es=1 00:27:57.752 05:12:36 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:27:57.752 05:12:36 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:27:57.752 05:12:36 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:27:57.752 05:12:36 -- host/discovery.sh@145 -- # get_discovery_ctrlrs 00:27:57.752 05:12:36 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:27:57.752 05:12:36 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:27:57.752 05:12:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:57.752 05:12:36 -- host/discovery.sh@67 -- # sort 00:27:57.752 05:12:36 -- common/autotest_common.sh@10 -- # set +x 00:27:57.752 05:12:36 -- host/discovery.sh@67 -- # xargs 00:27:57.752 05:12:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:57.752 05:12:36 -- host/discovery.sh@145 -- # [[ nvme == \n\v\m\e ]] 00:27:57.752 05:12:36 -- host/discovery.sh@146 -- # get_bdev_list 00:27:57.752 05:12:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:57.752 05:12:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:57.752 05:12:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:57.752 05:12:36 -- host/discovery.sh@55 -- # sort 00:27:57.752 05:12:36 -- common/autotest_common.sh@10 -- # set +x 00:27:57.752 05:12:36 -- host/discovery.sh@55 -- # xargs 00:27:57.752 05:12:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:57.753 05:12:36 -- host/discovery.sh@146 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:57.753 05:12:36 -- host/discovery.sh@149 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:57.753 05:12:36 -- common/autotest_common.sh@638 -- # local es=0 00:27:57.753 05:12:36 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:57.753 05:12:36 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:27:57.753 05:12:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:27:57.753 05:12:36 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:27:57.753 05:12:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:27:57.753 05:12:36 -- common/autotest_common.sh@641 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:57.753 05:12:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:57.753 05:12:36 -- common/autotest_common.sh@10 -- # set +x 00:27:57.753 request: 00:27:57.753 { 00:27:57.753 "name": "nvme_second", 00:27:57.753 "trtype": "tcp", 00:27:57.753 "traddr": "10.0.0.2", 00:27:57.753 "hostnqn": "nqn.2021-12.io.spdk:test", 00:27:57.753 "adrfam": "ipv4", 00:27:57.753 "trsvcid": "8009", 00:27:57.753 "wait_for_attach": true, 00:27:57.753 "method": "bdev_nvme_start_discovery", 00:27:57.753 "req_id": 1 00:27:57.753 } 00:27:57.753 Got JSON-RPC error response 00:27:57.753 response: 00:27:57.753 { 00:27:57.753 "code": -17, 00:27:57.753 "message": "File exists" 00:27:57.753 } 00:27:57.753 05:12:36 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:27:57.753 05:12:36 -- common/autotest_common.sh@641 -- # es=1 00:27:57.753 05:12:36 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:27:57.753 05:12:36 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:27:57.753 05:12:36 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:27:57.753 05:12:36 -- host/discovery.sh@151 -- # get_discovery_ctrlrs 00:27:57.753 05:12:36 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:27:57.753 05:12:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:57.753 05:12:36 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:27:57.753 05:12:36 -- common/autotest_common.sh@10 -- # set +x 00:27:57.753 05:12:36 -- host/discovery.sh@67 -- # sort 00:27:57.753 05:12:36 -- host/discovery.sh@67 -- # xargs 00:27:57.753 05:12:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:58.013 05:12:36 -- host/discovery.sh@151 -- # [[ nvme == \n\v\m\e ]] 00:27:58.013 05:12:36 -- host/discovery.sh@152 -- # get_bdev_list 00:27:58.013 05:12:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:58.013 05:12:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:58.013 05:12:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:58.013 05:12:36 -- common/autotest_common.sh@10 -- # set +x 00:27:58.013 05:12:36 -- host/discovery.sh@55 -- # sort 00:27:58.013 05:12:36 -- host/discovery.sh@55 -- # xargs 00:27:58.013 05:12:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:58.013 05:12:36 -- host/discovery.sh@152 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:58.013 05:12:36 -- host/discovery.sh@155 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:27:58.013 05:12:36 -- common/autotest_common.sh@638 -- # local es=0 00:27:58.013 05:12:36 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:27:58.013 05:12:36 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:27:58.013 05:12:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:27:58.013 05:12:36 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:27:58.013 05:12:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:27:58.013 05:12:36 -- common/autotest_common.sh@641 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:27:58.013 05:12:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:58.013 05:12:36 -- common/autotest_common.sh@10 -- # set +x 00:27:58.952 [2024-04-23 05:12:37.995059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.952 [2024-04-23 05:12:37.995281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.952 [2024-04-23 05:12:37.995308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b98fa0 with addr=10.0.0.2, port=8010 00:27:58.952 [2024-04-23 05:12:37.995340] nvme_tcp.c:2699:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:58.952 [2024-04-23 05:12:37.995357] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:58.952 [2024-04-23 05:12:37.995371] bdev_nvme.c:6981:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:27:59.892 [2024-04-23 05:12:38.997382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-04-23 05:12:38.997601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-04-23 05:12:38.997629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b98fa0 with addr=10.0.0.2, port=8010 00:27:59.892 [2024-04-23 05:12:38.997660] nvme_tcp.c:2699:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:59.892 [2024-04-23 05:12:38.997675] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:59.892 [2024-04-23 05:12:38.997689] bdev_nvme.c:6981:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:01.267 [2024-04-23 05:12:39.999601] bdev_nvme.c:6962:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:01.267 request: 00:28:01.267 { 00:28:01.267 "name": "nvme_second", 00:28:01.267 "trtype": "tcp", 00:28:01.267 "traddr": "10.0.0.2", 00:28:01.267 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:01.267 "adrfam": "ipv4", 00:28:01.267 "trsvcid": "8010", 00:28:01.267 "attach_timeout_ms": 3000, 00:28:01.267 "method": "bdev_nvme_start_discovery", 00:28:01.267 "req_id": 1 00:28:01.267 } 00:28:01.267 Got JSON-RPC error response 00:28:01.267 response: 00:28:01.267 { 00:28:01.267 "code": -110, 00:28:01.267 "message": "Connection timed out" 00:28:01.267 } 00:28:01.267 05:12:40 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:28:01.267 05:12:40 -- common/autotest_common.sh@641 -- # es=1 00:28:01.267 05:12:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:28:01.267 05:12:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:28:01.267 05:12:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:28:01.267 05:12:40 -- host/discovery.sh@157 -- # get_discovery_ctrlrs 00:28:01.267 05:12:40 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:01.267 05:12:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.267 05:12:40 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:01.267 05:12:40 -- common/autotest_common.sh@10 -- # set +x 00:28:01.267 05:12:40 -- host/discovery.sh@67 -- # sort 00:28:01.267 05:12:40 -- host/discovery.sh@67 -- # xargs 00:28:01.267 05:12:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.267 05:12:40 -- host/discovery.sh@157 -- # [[ nvme == \n\v\m\e ]] 00:28:01.267 05:12:40 -- host/discovery.sh@159 -- # trap - SIGINT SIGTERM EXIT 00:28:01.267 05:12:40 -- host/discovery.sh@161 -- # kill 2497593 00:28:01.267 05:12:40 -- host/discovery.sh@162 -- # nvmftestfini 00:28:01.267 05:12:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:28:01.267 05:12:40 -- nvmf/common.sh@117 -- # sync 00:28:01.267 05:12:40 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:28:01.267 05:12:40 -- nvmf/common.sh@120 -- # set +e 00:28:01.267 05:12:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:28:01.267 05:12:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:28:01.267 rmmod nvme_tcp 00:28:01.267 rmmod nvme_fabrics 00:28:01.267 rmmod nvme_keyring 00:28:01.267 05:12:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:28:01.267 05:12:40 -- nvmf/common.sh@124 -- # set -e 00:28:01.267 05:12:40 -- nvmf/common.sh@125 -- # return 0 00:28:01.267 05:12:40 -- nvmf/common.sh@478 -- # '[' -n 2497573 ']' 00:28:01.267 05:12:40 -- nvmf/common.sh@479 -- # killprocess 2497573 00:28:01.267 05:12:40 -- common/autotest_common.sh@936 -- # '[' -z 2497573 ']' 00:28:01.267 05:12:40 -- common/autotest_common.sh@940 -- # kill -0 2497573 00:28:01.267 05:12:40 -- common/autotest_common.sh@941 -- # uname 00:28:01.267 05:12:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:01.267 05:12:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2497573 00:28:01.267 05:12:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:01.267 05:12:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:01.267 05:12:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2497573' 00:28:01.267 killing process with pid 2497573 00:28:01.267 05:12:40 -- common/autotest_common.sh@955 -- # kill 2497573 00:28:01.267 05:12:40 -- common/autotest_common.sh@960 -- # wait 2497573 00:28:01.267 05:12:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:28:01.267 05:12:40 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:28:01.267 05:12:40 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:28:01.267 05:12:40 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:01.267 05:12:40 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:28:01.267 05:12:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:01.267 05:12:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:01.267 05:12:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:03.809 05:12:42 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:28:03.809 00:28:03.809 real 0m14.237s 00:28:03.809 user 0m21.339s 00:28:03.809 sys 0m2.803s 00:28:03.809 05:12:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:03.809 05:12:42 -- common/autotest_common.sh@10 -- # set +x 00:28:03.809 ************************************ 00:28:03.809 END TEST nvmf_discovery 00:28:03.809 ************************************ 00:28:03.809 05:12:42 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:03.809 05:12:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:03.809 05:12:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:03.809 05:12:42 -- common/autotest_common.sh@10 -- # set +x 00:28:03.809 ************************************ 00:28:03.809 START TEST nvmf_discovery_remove_ifc 00:28:03.809 ************************************ 00:28:03.809 05:12:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:03.809 * Looking for test storage... 00:28:03.809 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:03.809 05:12:42 -- nvmf/common.sh@7 -- # uname -s 00:28:03.809 05:12:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:03.809 05:12:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:03.809 05:12:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:03.809 05:12:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:03.809 05:12:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:03.809 05:12:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:03.809 05:12:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:03.809 05:12:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:03.809 05:12:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:03.809 05:12:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:03.809 05:12:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:03.809 05:12:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:03.809 05:12:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:03.809 05:12:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:03.809 05:12:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:03.809 05:12:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:03.809 05:12:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:03.809 05:12:42 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:03.809 05:12:42 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:03.809 05:12:42 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:03.809 05:12:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:03.809 05:12:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:03.809 05:12:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:03.809 05:12:42 -- paths/export.sh@5 -- # export PATH 00:28:03.809 05:12:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:03.809 05:12:42 -- nvmf/common.sh@47 -- # : 0 00:28:03.809 05:12:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:03.809 05:12:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:03.809 05:12:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:03.809 05:12:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:03.809 05:12:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:03.809 05:12:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:03.809 05:12:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:03.809 05:12:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:03.809 05:12:42 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:03.809 05:12:42 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:28:03.809 05:12:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:03.809 05:12:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:28:03.809 05:12:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:28:03.809 05:12:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:28:03.809 05:12:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:03.809 05:12:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:03.809 05:12:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:03.809 05:12:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:28:03.809 05:12:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:28:03.809 05:12:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:28:03.809 05:12:42 -- common/autotest_common.sh@10 -- # set +x 00:28:05.713 05:12:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:05.713 05:12:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:05.713 05:12:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:05.713 05:12:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:05.713 05:12:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:05.713 05:12:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:05.713 05:12:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:05.713 05:12:44 -- nvmf/common.sh@295 -- # net_devs=() 00:28:05.713 05:12:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:05.713 05:12:44 -- nvmf/common.sh@296 -- # e810=() 00:28:05.713 05:12:44 -- nvmf/common.sh@296 -- # local -ga e810 00:28:05.713 05:12:44 -- nvmf/common.sh@297 -- # x722=() 00:28:05.713 05:12:44 -- nvmf/common.sh@297 -- # local -ga x722 00:28:05.713 05:12:44 -- nvmf/common.sh@298 -- # mlx=() 00:28:05.713 05:12:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:05.713 05:12:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:05.713 05:12:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:05.713 05:12:44 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:28:05.713 05:12:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:05.713 05:12:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:05.713 05:12:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:05.713 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:05.713 05:12:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:05.713 05:12:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:05.713 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:05.713 05:12:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:05.713 05:12:44 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:05.713 05:12:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:05.713 05:12:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:05.713 05:12:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:05.713 05:12:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:05.713 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:05.713 05:12:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:05.713 05:12:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:05.713 05:12:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:05.713 05:12:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:05.713 05:12:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:05.713 05:12:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:05.713 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:05.713 05:12:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:05.713 05:12:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:05.713 05:12:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:05.713 05:12:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:28:05.713 05:12:44 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:05.713 05:12:44 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:05.713 05:12:44 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:05.713 05:12:44 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:28:05.713 05:12:44 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:05.713 05:12:44 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:05.713 05:12:44 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:28:05.713 05:12:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:05.713 05:12:44 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:05.713 05:12:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:28:05.713 05:12:44 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:28:05.713 05:12:44 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:28:05.713 05:12:44 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:05.713 05:12:44 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:05.713 05:12:44 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:05.713 05:12:44 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:28:05.713 05:12:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:05.713 05:12:44 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:05.713 05:12:44 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:05.713 05:12:44 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:28:05.713 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:05.713 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:28:05.713 00:28:05.713 --- 10.0.0.2 ping statistics --- 00:28:05.713 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:05.713 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:28:05.713 05:12:44 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:05.713 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:05.713 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:28:05.713 00:28:05.713 --- 10.0.0.1 ping statistics --- 00:28:05.713 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:05.713 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:28:05.713 05:12:44 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:05.713 05:12:44 -- nvmf/common.sh@411 -- # return 0 00:28:05.713 05:12:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:05.713 05:12:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:05.713 05:12:44 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:28:05.713 05:12:44 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:05.713 05:12:44 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:28:05.713 05:12:44 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:28:05.713 05:12:44 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:05.713 05:12:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:28:05.713 05:12:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:28:05.713 05:12:44 -- common/autotest_common.sh@10 -- # set +x 00:28:05.713 05:12:44 -- nvmf/common.sh@470 -- # nvmfpid=2500772 00:28:05.713 05:12:44 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:05.713 05:12:44 -- nvmf/common.sh@471 -- # waitforlisten 2500772 00:28:05.713 05:12:44 -- common/autotest_common.sh@817 -- # '[' -z 2500772 ']' 00:28:05.713 05:12:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:05.713 05:12:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:05.713 05:12:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:05.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:05.713 05:12:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:05.713 05:12:44 -- common/autotest_common.sh@10 -- # set +x 00:28:05.714 [2024-04-23 05:12:44.723480] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:28:05.714 [2024-04-23 05:12:44.723588] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:05.714 EAL: No free 2048 kB hugepages reported on node 1 00:28:05.714 [2024-04-23 05:12:44.760849] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:28:05.714 [2024-04-23 05:12:44.786892] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:05.714 [2024-04-23 05:12:44.872313] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:05.714 [2024-04-23 05:12:44.872382] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:05.714 [2024-04-23 05:12:44.872397] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:28:05.714 [2024-04-23 05:12:44.872408] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:28:05.714 [2024-04-23 05:12:44.872418] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:05.714 [2024-04-23 05:12:44.872446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:05.972 05:12:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:05.972 05:12:44 -- common/autotest_common.sh@850 -- # return 0 00:28:05.972 05:12:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:28:05.972 05:12:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:28:05.972 05:12:44 -- common/autotest_common.sh@10 -- # set +x 00:28:05.972 05:12:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:05.972 05:12:45 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:05.972 05:12:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:05.972 05:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:05.972 [2024-04-23 05:12:45.018978] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:05.972 [2024-04-23 05:12:45.027188] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:05.972 null0 00:28:05.972 [2024-04-23 05:12:45.059086] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:05.972 05:12:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:05.972 05:12:45 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2500916 00:28:05.972 05:12:45 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2500916 /tmp/host.sock 00:28:05.972 05:12:45 -- common/autotest_common.sh@817 -- # '[' -z 2500916 ']' 00:28:05.972 05:12:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/tmp/host.sock 00:28:05.972 05:12:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:05.972 05:12:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:05.972 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:05.972 05:12:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:05.972 05:12:45 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:05.972 05:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:05.972 [2024-04-23 05:12:45.126201] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:28:05.972 [2024-04-23 05:12:45.126275] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2500916 ] 00:28:06.232 EAL: No free 2048 kB hugepages reported on node 1 00:28:06.232 [2024-04-23 05:12:45.159869] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:28:06.232 [2024-04-23 05:12:45.187058] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:06.232 [2024-04-23 05:12:45.274773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:06.232 05:12:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:06.232 05:12:45 -- common/autotest_common.sh@850 -- # return 0 00:28:06.232 05:12:45 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:06.232 05:12:45 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:06.232 05:12:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:06.232 05:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:06.232 05:12:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:06.232 05:12:45 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:06.232 05:12:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:06.232 05:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:06.490 05:12:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:06.490 05:12:45 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:06.490 05:12:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:06.490 05:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:07.429 [2024-04-23 05:12:46.486726] bdev_nvme.c:6919:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:07.429 [2024-04-23 05:12:46.486779] bdev_nvme.c:6999:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:07.429 [2024-04-23 05:12:46.486819] bdev_nvme.c:6882:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:07.429 [2024-04-23 05:12:46.573080] bdev_nvme.c:6848:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:07.688 [2024-04-23 05:12:46.636662] bdev_nvme.c:7709:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:07.688 [2024-04-23 05:12:46.636727] bdev_nvme.c:7709:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:07.688 [2024-04-23 05:12:46.636772] bdev_nvme.c:7709:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:07.688 [2024-04-23 05:12:46.636795] bdev_nvme.c:6738:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:07.688 [2024-04-23 05:12:46.636844] bdev_nvme.c:6697:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:07.689 05:12:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:07.689 05:12:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:07.689 05:12:46 -- common/autotest_common.sh@10 -- # set +x 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:07.689 [2024-04-23 05:12:46.645027] bdev_nvme.c:1605:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xaac0c0 was disconnected and freed. delete nvme_qpair. 00:28:07.689 05:12:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:07.689 05:12:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:07.689 05:12:46 -- common/autotest_common.sh@10 -- # set +x 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:07.689 05:12:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:07.689 05:12:46 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:08.623 05:12:47 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:08.623 05:12:47 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:08.623 05:12:47 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:08.623 05:12:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:08.623 05:12:47 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:08.623 05:12:47 -- common/autotest_common.sh@10 -- # set +x 00:28:08.623 05:12:47 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:08.881 05:12:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:08.881 05:12:47 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:08.881 05:12:47 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:09.820 05:12:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:09.820 05:12:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:09.820 05:12:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:09.820 05:12:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:09.820 05:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:09.820 05:12:48 -- common/autotest_common.sh@10 -- # set +x 00:28:09.820 05:12:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:09.820 05:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:09.820 05:12:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:09.820 05:12:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:10.756 05:12:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:10.756 05:12:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:10.756 05:12:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:10.756 05:12:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:10.756 05:12:49 -- common/autotest_common.sh@10 -- # set +x 00:28:10.756 05:12:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:10.756 05:12:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:10.756 05:12:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:10.756 05:12:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:10.756 05:12:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:12.165 05:12:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:12.165 05:12:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:12.165 05:12:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:12.165 05:12:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:12.165 05:12:50 -- common/autotest_common.sh@10 -- # set +x 00:28:12.165 05:12:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:12.165 05:12:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:12.165 05:12:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:12.165 05:12:50 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:12.165 05:12:50 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:13.106 05:12:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:13.106 05:12:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:13.106 05:12:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:13.106 05:12:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:13.106 05:12:51 -- common/autotest_common.sh@10 -- # set +x 00:28:13.106 05:12:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:13.106 05:12:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:13.106 05:12:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:13.106 05:12:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:13.106 05:12:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:13.106 [2024-04-23 05:12:52.087777] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:28:13.106 [2024-04-23 05:12:52.087881] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.106 [2024-04-23 05:12:52.087930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.106 [2024-04-23 05:12:52.087952] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.106 [2024-04-23 05:12:52.087967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.106 [2024-04-23 05:12:52.087981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.106 [2024-04-23 05:12:52.087996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.106 [2024-04-23 05:12:52.088010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.106 [2024-04-23 05:12:52.088026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.106 [2024-04-23 05:12:52.088042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.106 [2024-04-23 05:12:52.088058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.106 [2024-04-23 05:12:52.088073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa72400 is same with the state(5) to be set 00:28:13.106 [2024-04-23 05:12:52.097793] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa72400 (9): Bad file descriptor 00:28:13.106 [2024-04-23 05:12:52.107856] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:14.045 05:12:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:14.045 05:12:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:14.045 05:12:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:14.045 05:12:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:14.045 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:28:14.045 05:12:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:14.045 05:12:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:14.045 [2024-04-23 05:12:53.147558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:15.418 [2024-04-23 05:12:54.171580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:15.418 [2024-04-23 05:12:54.171630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa72400 with addr=10.0.0.2, port=4420 00:28:15.418 [2024-04-23 05:12:54.171658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa72400 is same with the state(5) to be set 00:28:15.418 [2024-04-23 05:12:54.172122] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa72400 (9): Bad file descriptor 00:28:15.418 [2024-04-23 05:12:54.172167] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:15.418 [2024-04-23 05:12:54.172208] bdev_nvme.c:6670:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:28:15.418 [2024-04-23 05:12:54.172249] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:15.418 [2024-04-23 05:12:54.172274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:15.418 [2024-04-23 05:12:54.172295] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:15.418 [2024-04-23 05:12:54.172310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:15.418 [2024-04-23 05:12:54.172325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:15.418 [2024-04-23 05:12:54.172341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:15.418 [2024-04-23 05:12:54.172356] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:15.418 [2024-04-23 05:12:54.172371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:15.418 [2024-04-23 05:12:54.172387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:15.418 [2024-04-23 05:12:54.172401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:15.418 [2024-04-23 05:12:54.172417] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:28:15.418 [2024-04-23 05:12:54.172696] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa72810 (9): Bad file descriptor 00:28:15.418 [2024-04-23 05:12:54.173715] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:28:15.418 [2024-04-23 05:12:54.173738] nvme_ctrlr.c:1148:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:28:15.418 05:12:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:15.418 05:12:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:15.418 05:12:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:16.351 05:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:16.351 05:12:55 -- common/autotest_common.sh@10 -- # set +x 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:16.351 05:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:16.351 05:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:16.351 05:12:55 -- common/autotest_common.sh@10 -- # set +x 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:16.351 05:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:28:16.351 05:12:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:17.286 [2024-04-23 05:12:56.234297] bdev_nvme.c:6919:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:17.286 [2024-04-23 05:12:56.234327] bdev_nvme.c:6999:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:17.286 [2024-04-23 05:12:56.234353] bdev_nvme.c:6882:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:17.286 05:12:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:17.286 05:12:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:17.286 05:12:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:17.286 05:12:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:17.286 05:12:56 -- common/autotest_common.sh@10 -- # set +x 00:28:17.286 05:12:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:17.286 05:12:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:17.286 05:12:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:17.286 05:12:56 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:28:17.286 05:12:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:17.286 [2024-04-23 05:12:56.363780] bdev_nvme.c:6848:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:28:17.546 [2024-04-23 05:12:56.584236] bdev_nvme.c:7709:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:17.546 [2024-04-23 05:12:56.584295] bdev_nvme.c:7709:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:17.546 [2024-04-23 05:12:56.584332] bdev_nvme.c:7709:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:17.546 [2024-04-23 05:12:56.584358] bdev_nvme.c:6738:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:28:17.546 [2024-04-23 05:12:56.584371] bdev_nvme.c:6697:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:17.546 [2024-04-23 05:12:56.591511] bdev_nvme.c:1605:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xab6aa0 was disconnected and freed. delete nvme_qpair. 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:18.485 05:12:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:18.485 05:12:57 -- common/autotest_common.sh@10 -- # set +x 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:18.485 05:12:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2500916 00:28:18.485 05:12:57 -- common/autotest_common.sh@936 -- # '[' -z 2500916 ']' 00:28:18.485 05:12:57 -- common/autotest_common.sh@940 -- # kill -0 2500916 00:28:18.485 05:12:57 -- common/autotest_common.sh@941 -- # uname 00:28:18.485 05:12:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:18.485 05:12:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2500916 00:28:18.485 05:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:18.485 05:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:18.485 05:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2500916' 00:28:18.485 killing process with pid 2500916 00:28:18.485 05:12:57 -- common/autotest_common.sh@955 -- # kill 2500916 00:28:18.485 05:12:57 -- common/autotest_common.sh@960 -- # wait 2500916 00:28:18.485 05:12:57 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:28:18.485 05:12:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:28:18.485 05:12:57 -- nvmf/common.sh@117 -- # sync 00:28:18.485 05:12:57 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:28:18.485 05:12:57 -- nvmf/common.sh@120 -- # set +e 00:28:18.485 05:12:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:28:18.485 05:12:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:28:18.485 rmmod nvme_tcp 00:28:18.485 rmmod nvme_fabrics 00:28:18.745 rmmod nvme_keyring 00:28:18.745 05:12:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:28:18.745 05:12:57 -- nvmf/common.sh@124 -- # set -e 00:28:18.745 05:12:57 -- nvmf/common.sh@125 -- # return 0 00:28:18.745 05:12:57 -- nvmf/common.sh@478 -- # '[' -n 2500772 ']' 00:28:18.745 05:12:57 -- nvmf/common.sh@479 -- # killprocess 2500772 00:28:18.745 05:12:57 -- common/autotest_common.sh@936 -- # '[' -z 2500772 ']' 00:28:18.745 05:12:57 -- common/autotest_common.sh@940 -- # kill -0 2500772 00:28:18.745 05:12:57 -- common/autotest_common.sh@941 -- # uname 00:28:18.745 05:12:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:18.745 05:12:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2500772 00:28:18.745 05:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:18.745 05:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:18.745 05:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2500772' 00:28:18.745 killing process with pid 2500772 00:28:18.745 05:12:57 -- common/autotest_common.sh@955 -- # kill 2500772 00:28:18.745 05:12:57 -- common/autotest_common.sh@960 -- # wait 2500772 00:28:19.005 05:12:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:28:19.005 05:12:57 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:28:19.005 05:12:57 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:28:19.005 05:12:57 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:19.005 05:12:57 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:28:19.005 05:12:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:19.005 05:12:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:19.005 05:12:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:20.909 05:12:59 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:28:20.909 00:28:20.909 real 0m17.459s 00:28:20.909 user 0m24.293s 00:28:20.909 sys 0m2.890s 00:28:20.909 05:12:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:20.909 05:12:59 -- common/autotest_common.sh@10 -- # set +x 00:28:20.909 ************************************ 00:28:20.909 END TEST nvmf_discovery_remove_ifc 00:28:20.909 ************************************ 00:28:20.909 05:13:00 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=tcp 00:28:20.909 05:13:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:20.909 05:13:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:20.909 05:13:00 -- common/autotest_common.sh@10 -- # set +x 00:28:21.167 ************************************ 00:28:21.167 START TEST nvmf_identify_kernel_target 00:28:21.167 ************************************ 00:28:21.167 05:13:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=tcp 00:28:21.167 * Looking for test storage... 00:28:21.167 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:21.167 05:13:00 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:21.167 05:13:00 -- nvmf/common.sh@7 -- # uname -s 00:28:21.167 05:13:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:21.167 05:13:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:21.167 05:13:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:21.167 05:13:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:21.167 05:13:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:21.167 05:13:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:21.167 05:13:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:21.167 05:13:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:21.167 05:13:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:21.167 05:13:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:21.167 05:13:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:21.167 05:13:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:21.167 05:13:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:21.167 05:13:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:21.167 05:13:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:21.167 05:13:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:21.167 05:13:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:21.167 05:13:00 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:21.167 05:13:00 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:21.167 05:13:00 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:21.167 05:13:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.167 05:13:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.167 05:13:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.167 05:13:00 -- paths/export.sh@5 -- # export PATH 00:28:21.167 05:13:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.167 05:13:00 -- nvmf/common.sh@47 -- # : 0 00:28:21.167 05:13:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:21.167 05:13:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:21.167 05:13:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:21.167 05:13:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:21.167 05:13:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:21.167 05:13:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:21.167 05:13:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:21.167 05:13:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:21.167 05:13:00 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:28:21.167 05:13:00 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:28:21.167 05:13:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:21.167 05:13:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:28:21.167 05:13:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:28:21.167 05:13:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:28:21.167 05:13:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:21.167 05:13:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:21.167 05:13:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:21.167 05:13:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:28:21.167 05:13:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:28:21.167 05:13:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:28:21.167 05:13:00 -- common/autotest_common.sh@10 -- # set +x 00:28:23.070 05:13:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:23.070 05:13:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:23.070 05:13:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:23.070 05:13:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:23.070 05:13:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:23.070 05:13:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:23.070 05:13:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:23.070 05:13:02 -- nvmf/common.sh@295 -- # net_devs=() 00:28:23.070 05:13:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:23.070 05:13:02 -- nvmf/common.sh@296 -- # e810=() 00:28:23.070 05:13:02 -- nvmf/common.sh@296 -- # local -ga e810 00:28:23.070 05:13:02 -- nvmf/common.sh@297 -- # x722=() 00:28:23.070 05:13:02 -- nvmf/common.sh@297 -- # local -ga x722 00:28:23.070 05:13:02 -- nvmf/common.sh@298 -- # mlx=() 00:28:23.070 05:13:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:23.070 05:13:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:23.070 05:13:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:23.070 05:13:02 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:28:23.070 05:13:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:23.070 05:13:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:23.070 05:13:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:23.070 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:23.070 05:13:02 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:23.070 05:13:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:23.070 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:23.070 05:13:02 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:23.070 05:13:02 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:23.070 05:13:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:23.070 05:13:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:23.070 05:13:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:23.070 05:13:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:23.070 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:23.070 05:13:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:23.070 05:13:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:23.070 05:13:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:23.070 05:13:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:23.070 05:13:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:23.070 05:13:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:23.070 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:23.070 05:13:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:23.070 05:13:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:23.070 05:13:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:23.070 05:13:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:28:23.070 05:13:02 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:23.070 05:13:02 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:23.070 05:13:02 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:23.070 05:13:02 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:28:23.070 05:13:02 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:23.070 05:13:02 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:23.070 05:13:02 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:28:23.070 05:13:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:23.070 05:13:02 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:23.070 05:13:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:28:23.070 05:13:02 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:28:23.070 05:13:02 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:28:23.070 05:13:02 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:23.070 05:13:02 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:23.070 05:13:02 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:23.070 05:13:02 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:28:23.070 05:13:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:23.070 05:13:02 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:23.070 05:13:02 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:23.070 05:13:02 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:28:23.070 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:23.070 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.145 ms 00:28:23.070 00:28:23.070 --- 10.0.0.2 ping statistics --- 00:28:23.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:23.070 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:28:23.070 05:13:02 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:23.070 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:23.070 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.171 ms 00:28:23.070 00:28:23.070 --- 10.0.0.1 ping statistics --- 00:28:23.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:23.070 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:28:23.070 05:13:02 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:23.070 05:13:02 -- nvmf/common.sh@411 -- # return 0 00:28:23.070 05:13:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:23.070 05:13:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:23.070 05:13:02 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:23.070 05:13:02 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:28:23.070 05:13:02 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:28:23.070 05:13:02 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:28:23.070 05:13:02 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:28:23.070 05:13:02 -- nvmf/common.sh@717 -- # local ip 00:28:23.070 05:13:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:23.070 05:13:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:23.070 05:13:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:23.070 05:13:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:23.070 05:13:02 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:23.070 05:13:02 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:23.070 05:13:02 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=10.0.0.1 00:28:23.070 05:13:02 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 10.0.0.1 00:28:23.070 05:13:02 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=10.0.0.1 00:28:23.070 05:13:02 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:28:23.070 05:13:02 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:23.070 05:13:02 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:28:23.070 05:13:02 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:28:23.070 05:13:02 -- nvmf/common.sh@628 -- # local block nvme 00:28:23.070 05:13:02 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:28:23.070 05:13:02 -- nvmf/common.sh@631 -- # modprobe nvmet 00:28:23.330 05:13:02 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:28:23.330 05:13:02 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:28:24.266 Waiting for block devices as requested 00:28:24.266 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:28:24.266 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:24.523 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:24.523 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:24.523 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:24.523 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:24.523 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:24.782 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:24.782 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:24.782 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:24.782 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:25.042 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:25.042 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:25.042 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:25.301 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:25.301 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:25.301 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:25.301 05:13:04 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:25.301 05:13:04 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:28:25.301 05:13:04 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:28:25.301 05:13:04 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:28:25.301 05:13:04 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:28:25.301 05:13:04 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:28:25.301 05:13:04 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:28:25.301 05:13:04 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:28:25.301 05:13:04 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:28:25.561 No valid GPT data, bailing 00:28:25.561 05:13:04 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:28:25.561 05:13:04 -- scripts/common.sh@391 -- # pt= 00:28:25.561 05:13:04 -- scripts/common.sh@392 -- # return 1 00:28:25.561 05:13:04 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:28:25.561 05:13:04 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:28:25.561 05:13:04 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:25.561 05:13:04 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:28:25.561 05:13:04 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:28:25.561 05:13:04 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:28:25.561 05:13:04 -- nvmf/common.sh@656 -- # echo 1 00:28:25.561 05:13:04 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:28:25.561 05:13:04 -- nvmf/common.sh@658 -- # echo 1 00:28:25.561 05:13:04 -- nvmf/common.sh@660 -- # echo 10.0.0.1 00:28:25.561 05:13:04 -- nvmf/common.sh@661 -- # echo tcp 00:28:25.561 05:13:04 -- nvmf/common.sh@662 -- # echo 4420 00:28:25.561 05:13:04 -- nvmf/common.sh@663 -- # echo ipv4 00:28:25.561 05:13:04 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:28:25.561 05:13:04 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:28:25.561 00:28:25.561 Discovery Log Number of Records 2, Generation counter 2 00:28:25.561 =====Discovery Log Entry 0====== 00:28:25.561 trtype: tcp 00:28:25.561 adrfam: ipv4 00:28:25.561 subtype: current discovery subsystem 00:28:25.561 treq: not specified, sq flow control disable supported 00:28:25.561 portid: 1 00:28:25.561 trsvcid: 4420 00:28:25.561 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:28:25.561 traddr: 10.0.0.1 00:28:25.561 eflags: none 00:28:25.561 sectype: none 00:28:25.561 =====Discovery Log Entry 1====== 00:28:25.561 trtype: tcp 00:28:25.561 adrfam: ipv4 00:28:25.561 subtype: nvme subsystem 00:28:25.561 treq: not specified, sq flow control disable supported 00:28:25.561 portid: 1 00:28:25.561 trsvcid: 4420 00:28:25.561 subnqn: nqn.2016-06.io.spdk:testnqn 00:28:25.561 traddr: 10.0.0.1 00:28:25.561 eflags: none 00:28:25.561 sectype: none 00:28:25.561 05:13:04 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.1 00:28:25.561 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:28:25.561 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.561 ===================================================== 00:28:25.561 NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2014-08.org.nvmexpress.discovery 00:28:25.561 ===================================================== 00:28:25.561 Controller Capabilities/Features 00:28:25.561 ================================ 00:28:25.561 Vendor ID: 0000 00:28:25.561 Subsystem Vendor ID: 0000 00:28:25.561 Serial Number: 879ce70b0562d655af04 00:28:25.561 Model Number: Linux 00:28:25.561 Firmware Version: 6.7.0-68 00:28:25.561 Recommended Arb Burst: 0 00:28:25.561 IEEE OUI Identifier: 00 00 00 00:28:25.561 Multi-path I/O 00:28:25.561 May have multiple subsystem ports: No 00:28:25.561 May have multiple controllers: No 00:28:25.561 Associated with SR-IOV VF: No 00:28:25.561 Max Data Transfer Size: Unlimited 00:28:25.561 Max Number of Namespaces: 0 00:28:25.561 Max Number of I/O Queues: 1024 00:28:25.561 NVMe Specification Version (VS): 1.3 00:28:25.561 NVMe Specification Version (Identify): 1.3 00:28:25.561 Maximum Queue Entries: 1024 00:28:25.561 Contiguous Queues Required: No 00:28:25.561 Arbitration Mechanisms Supported 00:28:25.561 Weighted Round Robin: Not Supported 00:28:25.561 Vendor Specific: Not Supported 00:28:25.561 Reset Timeout: 7500 ms 00:28:25.561 Doorbell Stride: 4 bytes 00:28:25.561 NVM Subsystem Reset: Not Supported 00:28:25.561 Command Sets Supported 00:28:25.561 NVM Command Set: Supported 00:28:25.561 Boot Partition: Not Supported 00:28:25.561 Memory Page Size Minimum: 4096 bytes 00:28:25.561 Memory Page Size Maximum: 4096 bytes 00:28:25.561 Persistent Memory Region: Not Supported 00:28:25.561 Optional Asynchronous Events Supported 00:28:25.561 Namespace Attribute Notices: Not Supported 00:28:25.561 Firmware Activation Notices: Not Supported 00:28:25.561 ANA Change Notices: Not Supported 00:28:25.561 PLE Aggregate Log Change Notices: Not Supported 00:28:25.561 LBA Status Info Alert Notices: Not Supported 00:28:25.561 EGE Aggregate Log Change Notices: Not Supported 00:28:25.561 Normal NVM Subsystem Shutdown event: Not Supported 00:28:25.561 Zone Descriptor Change Notices: Not Supported 00:28:25.561 Discovery Log Change Notices: Supported 00:28:25.561 Controller Attributes 00:28:25.561 128-bit Host Identifier: Not Supported 00:28:25.561 Non-Operational Permissive Mode: Not Supported 00:28:25.561 NVM Sets: Not Supported 00:28:25.561 Read Recovery Levels: Not Supported 00:28:25.561 Endurance Groups: Not Supported 00:28:25.561 Predictable Latency Mode: Not Supported 00:28:25.561 Traffic Based Keep ALive: Not Supported 00:28:25.561 Namespace Granularity: Not Supported 00:28:25.561 SQ Associations: Not Supported 00:28:25.561 UUID List: Not Supported 00:28:25.561 Multi-Domain Subsystem: Not Supported 00:28:25.561 Fixed Capacity Management: Not Supported 00:28:25.561 Variable Capacity Management: Not Supported 00:28:25.561 Delete Endurance Group: Not Supported 00:28:25.561 Delete NVM Set: Not Supported 00:28:25.561 Extended LBA Formats Supported: Not Supported 00:28:25.561 Flexible Data Placement Supported: Not Supported 00:28:25.561 00:28:25.561 Controller Memory Buffer Support 00:28:25.561 ================================ 00:28:25.561 Supported: No 00:28:25.561 00:28:25.561 Persistent Memory Region Support 00:28:25.561 ================================ 00:28:25.561 Supported: No 00:28:25.561 00:28:25.561 Admin Command Set Attributes 00:28:25.561 ============================ 00:28:25.561 Security Send/Receive: Not Supported 00:28:25.561 Format NVM: Not Supported 00:28:25.561 Firmware Activate/Download: Not Supported 00:28:25.561 Namespace Management: Not Supported 00:28:25.561 Device Self-Test: Not Supported 00:28:25.561 Directives: Not Supported 00:28:25.561 NVMe-MI: Not Supported 00:28:25.561 Virtualization Management: Not Supported 00:28:25.561 Doorbell Buffer Config: Not Supported 00:28:25.561 Get LBA Status Capability: Not Supported 00:28:25.561 Command & Feature Lockdown Capability: Not Supported 00:28:25.561 Abort Command Limit: 1 00:28:25.561 Async Event Request Limit: 1 00:28:25.561 Number of Firmware Slots: N/A 00:28:25.561 Firmware Slot 1 Read-Only: N/A 00:28:25.561 Firmware Activation Without Reset: N/A 00:28:25.561 Multiple Update Detection Support: N/A 00:28:25.561 Firmware Update Granularity: No Information Provided 00:28:25.561 Per-Namespace SMART Log: No 00:28:25.561 Asymmetric Namespace Access Log Page: Not Supported 00:28:25.561 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:28:25.561 Command Effects Log Page: Not Supported 00:28:25.561 Get Log Page Extended Data: Supported 00:28:25.561 Telemetry Log Pages: Not Supported 00:28:25.561 Persistent Event Log Pages: Not Supported 00:28:25.561 Supported Log Pages Log Page: May Support 00:28:25.561 Commands Supported & Effects Log Page: Not Supported 00:28:25.561 Feature Identifiers & Effects Log Page:May Support 00:28:25.561 NVMe-MI Commands & Effects Log Page: May Support 00:28:25.561 Data Area 4 for Telemetry Log: Not Supported 00:28:25.561 Error Log Page Entries Supported: 1 00:28:25.561 Keep Alive: Not Supported 00:28:25.561 00:28:25.561 NVM Command Set Attributes 00:28:25.561 ========================== 00:28:25.561 Submission Queue Entry Size 00:28:25.561 Max: 1 00:28:25.561 Min: 1 00:28:25.561 Completion Queue Entry Size 00:28:25.561 Max: 1 00:28:25.561 Min: 1 00:28:25.562 Number of Namespaces: 0 00:28:25.562 Compare Command: Not Supported 00:28:25.562 Write Uncorrectable Command: Not Supported 00:28:25.562 Dataset Management Command: Not Supported 00:28:25.562 Write Zeroes Command: Not Supported 00:28:25.562 Set Features Save Field: Not Supported 00:28:25.562 Reservations: Not Supported 00:28:25.562 Timestamp: Not Supported 00:28:25.562 Copy: Not Supported 00:28:25.562 Volatile Write Cache: Not Present 00:28:25.562 Atomic Write Unit (Normal): 1 00:28:25.562 Atomic Write Unit (PFail): 1 00:28:25.562 Atomic Compare & Write Unit: 1 00:28:25.562 Fused Compare & Write: Not Supported 00:28:25.562 Scatter-Gather List 00:28:25.562 SGL Command Set: Supported 00:28:25.562 SGL Keyed: Not Supported 00:28:25.562 SGL Bit Bucket Descriptor: Not Supported 00:28:25.562 SGL Metadata Pointer: Not Supported 00:28:25.562 Oversized SGL: Not Supported 00:28:25.562 SGL Metadata Address: Not Supported 00:28:25.562 SGL Offset: Supported 00:28:25.562 Transport SGL Data Block: Not Supported 00:28:25.562 Replay Protected Memory Block: Not Supported 00:28:25.562 00:28:25.562 Firmware Slot Information 00:28:25.562 ========================= 00:28:25.562 Active slot: 0 00:28:25.562 00:28:25.562 00:28:25.562 Error Log 00:28:25.562 ========= 00:28:25.562 00:28:25.562 Active Namespaces 00:28:25.562 ================= 00:28:25.562 Discovery Log Page 00:28:25.562 ================== 00:28:25.562 Generation Counter: 2 00:28:25.562 Number of Records: 2 00:28:25.562 Record Format: 0 00:28:25.562 00:28:25.562 Discovery Log Entry 0 00:28:25.562 ---------------------- 00:28:25.562 Transport Type: 3 (TCP) 00:28:25.562 Address Family: 1 (IPv4) 00:28:25.562 Subsystem Type: 3 (Current Discovery Subsystem) 00:28:25.562 Entry Flags: 00:28:25.562 Duplicate Returned Information: 0 00:28:25.562 Explicit Persistent Connection Support for Discovery: 0 00:28:25.562 Transport Requirements: 00:28:25.562 Secure Channel: Not Specified 00:28:25.562 Port ID: 1 (0x0001) 00:28:25.562 Controller ID: 65535 (0xffff) 00:28:25.562 Admin Max SQ Size: 32 00:28:25.562 Transport Service Identifier: 4420 00:28:25.562 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:28:25.562 Transport Address: 10.0.0.1 00:28:25.562 Discovery Log Entry 1 00:28:25.562 ---------------------- 00:28:25.562 Transport Type: 3 (TCP) 00:28:25.562 Address Family: 1 (IPv4) 00:28:25.562 Subsystem Type: 2 (NVM Subsystem) 00:28:25.562 Entry Flags: 00:28:25.562 Duplicate Returned Information: 0 00:28:25.562 Explicit Persistent Connection Support for Discovery: 0 00:28:25.562 Transport Requirements: 00:28:25.562 Secure Channel: Not Specified 00:28:25.562 Port ID: 1 (0x0001) 00:28:25.562 Controller ID: 65535 (0xffff) 00:28:25.562 Admin Max SQ Size: 32 00:28:25.562 Transport Service Identifier: 4420 00:28:25.562 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:28:25.562 Transport Address: 10.0.0.1 00:28:25.562 05:13:04 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:28:25.562 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.562 get_feature(0x01) failed 00:28:25.562 get_feature(0x02) failed 00:28:25.562 get_feature(0x04) failed 00:28:25.562 ===================================================== 00:28:25.562 NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:28:25.562 ===================================================== 00:28:25.562 Controller Capabilities/Features 00:28:25.562 ================================ 00:28:25.562 Vendor ID: 0000 00:28:25.562 Subsystem Vendor ID: 0000 00:28:25.562 Serial Number: ffc3b67e7fb231e9c35d 00:28:25.562 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:28:25.562 Firmware Version: 6.7.0-68 00:28:25.562 Recommended Arb Burst: 6 00:28:25.562 IEEE OUI Identifier: 00 00 00 00:28:25.562 Multi-path I/O 00:28:25.562 May have multiple subsystem ports: Yes 00:28:25.562 May have multiple controllers: Yes 00:28:25.562 Associated with SR-IOV VF: No 00:28:25.562 Max Data Transfer Size: Unlimited 00:28:25.562 Max Number of Namespaces: 1024 00:28:25.562 Max Number of I/O Queues: 128 00:28:25.562 NVMe Specification Version (VS): 1.3 00:28:25.562 NVMe Specification Version (Identify): 1.3 00:28:25.562 Maximum Queue Entries: 1024 00:28:25.562 Contiguous Queues Required: No 00:28:25.562 Arbitration Mechanisms Supported 00:28:25.562 Weighted Round Robin: Not Supported 00:28:25.562 Vendor Specific: Not Supported 00:28:25.562 Reset Timeout: 7500 ms 00:28:25.562 Doorbell Stride: 4 bytes 00:28:25.562 NVM Subsystem Reset: Not Supported 00:28:25.562 Command Sets Supported 00:28:25.562 NVM Command Set: Supported 00:28:25.562 Boot Partition: Not Supported 00:28:25.562 Memory Page Size Minimum: 4096 bytes 00:28:25.562 Memory Page Size Maximum: 4096 bytes 00:28:25.562 Persistent Memory Region: Not Supported 00:28:25.562 Optional Asynchronous Events Supported 00:28:25.562 Namespace Attribute Notices: Supported 00:28:25.562 Firmware Activation Notices: Not Supported 00:28:25.562 ANA Change Notices: Supported 00:28:25.562 PLE Aggregate Log Change Notices: Not Supported 00:28:25.562 LBA Status Info Alert Notices: Not Supported 00:28:25.562 EGE Aggregate Log Change Notices: Not Supported 00:28:25.562 Normal NVM Subsystem Shutdown event: Not Supported 00:28:25.562 Zone Descriptor Change Notices: Not Supported 00:28:25.562 Discovery Log Change Notices: Not Supported 00:28:25.562 Controller Attributes 00:28:25.562 128-bit Host Identifier: Supported 00:28:25.562 Non-Operational Permissive Mode: Not Supported 00:28:25.562 NVM Sets: Not Supported 00:28:25.562 Read Recovery Levels: Not Supported 00:28:25.562 Endurance Groups: Not Supported 00:28:25.562 Predictable Latency Mode: Not Supported 00:28:25.562 Traffic Based Keep ALive: Supported 00:28:25.562 Namespace Granularity: Not Supported 00:28:25.562 SQ Associations: Not Supported 00:28:25.562 UUID List: Not Supported 00:28:25.562 Multi-Domain Subsystem: Not Supported 00:28:25.562 Fixed Capacity Management: Not Supported 00:28:25.562 Variable Capacity Management: Not Supported 00:28:25.562 Delete Endurance Group: Not Supported 00:28:25.562 Delete NVM Set: Not Supported 00:28:25.562 Extended LBA Formats Supported: Not Supported 00:28:25.562 Flexible Data Placement Supported: Not Supported 00:28:25.562 00:28:25.562 Controller Memory Buffer Support 00:28:25.562 ================================ 00:28:25.562 Supported: No 00:28:25.562 00:28:25.562 Persistent Memory Region Support 00:28:25.562 ================================ 00:28:25.562 Supported: No 00:28:25.562 00:28:25.562 Admin Command Set Attributes 00:28:25.562 ============================ 00:28:25.562 Security Send/Receive: Not Supported 00:28:25.562 Format NVM: Not Supported 00:28:25.562 Firmware Activate/Download: Not Supported 00:28:25.562 Namespace Management: Not Supported 00:28:25.562 Device Self-Test: Not Supported 00:28:25.562 Directives: Not Supported 00:28:25.562 NVMe-MI: Not Supported 00:28:25.562 Virtualization Management: Not Supported 00:28:25.562 Doorbell Buffer Config: Not Supported 00:28:25.562 Get LBA Status Capability: Not Supported 00:28:25.562 Command & Feature Lockdown Capability: Not Supported 00:28:25.562 Abort Command Limit: 4 00:28:25.562 Async Event Request Limit: 4 00:28:25.562 Number of Firmware Slots: N/A 00:28:25.562 Firmware Slot 1 Read-Only: N/A 00:28:25.562 Firmware Activation Without Reset: N/A 00:28:25.562 Multiple Update Detection Support: N/A 00:28:25.562 Firmware Update Granularity: No Information Provided 00:28:25.562 Per-Namespace SMART Log: Yes 00:28:25.563 Asymmetric Namespace Access Log Page: Supported 00:28:25.563 ANA Transition Time : 10 sec 00:28:25.563 00:28:25.563 Asymmetric Namespace Access Capabilities 00:28:25.563 ANA Optimized State : Supported 00:28:25.563 ANA Non-Optimized State : Supported 00:28:25.563 ANA Inaccessible State : Supported 00:28:25.563 ANA Persistent Loss State : Supported 00:28:25.563 ANA Change State : Supported 00:28:25.563 ANAGRPID is not changed : No 00:28:25.563 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:28:25.563 00:28:25.563 ANA Group Identifier Maximum : 128 00:28:25.563 Number of ANA Group Identifiers : 128 00:28:25.563 Max Number of Allowed Namespaces : 1024 00:28:25.563 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:28:25.563 Command Effects Log Page: Supported 00:28:25.563 Get Log Page Extended Data: Supported 00:28:25.563 Telemetry Log Pages: Not Supported 00:28:25.563 Persistent Event Log Pages: Not Supported 00:28:25.563 Supported Log Pages Log Page: May Support 00:28:25.563 Commands Supported & Effects Log Page: Not Supported 00:28:25.563 Feature Identifiers & Effects Log Page:May Support 00:28:25.563 NVMe-MI Commands & Effects Log Page: May Support 00:28:25.563 Data Area 4 for Telemetry Log: Not Supported 00:28:25.563 Error Log Page Entries Supported: 128 00:28:25.563 Keep Alive: Supported 00:28:25.563 Keep Alive Granularity: 1000 ms 00:28:25.563 00:28:25.563 NVM Command Set Attributes 00:28:25.563 ========================== 00:28:25.563 Submission Queue Entry Size 00:28:25.563 Max: 64 00:28:25.563 Min: 64 00:28:25.563 Completion Queue Entry Size 00:28:25.563 Max: 16 00:28:25.563 Min: 16 00:28:25.563 Number of Namespaces: 1024 00:28:25.563 Compare Command: Not Supported 00:28:25.563 Write Uncorrectable Command: Not Supported 00:28:25.563 Dataset Management Command: Supported 00:28:25.563 Write Zeroes Command: Supported 00:28:25.563 Set Features Save Field: Not Supported 00:28:25.563 Reservations: Not Supported 00:28:25.563 Timestamp: Not Supported 00:28:25.563 Copy: Not Supported 00:28:25.563 Volatile Write Cache: Present 00:28:25.563 Atomic Write Unit (Normal): 1 00:28:25.563 Atomic Write Unit (PFail): 1 00:28:25.563 Atomic Compare & Write Unit: 1 00:28:25.563 Fused Compare & Write: Not Supported 00:28:25.563 Scatter-Gather List 00:28:25.563 SGL Command Set: Supported 00:28:25.563 SGL Keyed: Not Supported 00:28:25.563 SGL Bit Bucket Descriptor: Not Supported 00:28:25.563 SGL Metadata Pointer: Not Supported 00:28:25.563 Oversized SGL: Not Supported 00:28:25.563 SGL Metadata Address: Not Supported 00:28:25.563 SGL Offset: Supported 00:28:25.563 Transport SGL Data Block: Not Supported 00:28:25.563 Replay Protected Memory Block: Not Supported 00:28:25.563 00:28:25.563 Firmware Slot Information 00:28:25.563 ========================= 00:28:25.563 Active slot: 0 00:28:25.563 00:28:25.563 Asymmetric Namespace Access 00:28:25.563 =========================== 00:28:25.563 Change Count : 0 00:28:25.563 Number of ANA Group Descriptors : 1 00:28:25.563 ANA Group Descriptor : 0 00:28:25.563 ANA Group ID : 1 00:28:25.563 Number of NSID Values : 1 00:28:25.563 Change Count : 0 00:28:25.563 ANA State : 1 00:28:25.563 Namespace Identifier : 1 00:28:25.563 00:28:25.563 Commands Supported and Effects 00:28:25.563 ============================== 00:28:25.563 Admin Commands 00:28:25.563 -------------- 00:28:25.563 Get Log Page (02h): Supported 00:28:25.563 Identify (06h): Supported 00:28:25.563 Abort (08h): Supported 00:28:25.563 Set Features (09h): Supported 00:28:25.563 Get Features (0Ah): Supported 00:28:25.563 Asynchronous Event Request (0Ch): Supported 00:28:25.563 Keep Alive (18h): Supported 00:28:25.563 I/O Commands 00:28:25.563 ------------ 00:28:25.563 Flush (00h): Supported 00:28:25.563 Write (01h): Supported LBA-Change 00:28:25.563 Read (02h): Supported 00:28:25.563 Write Zeroes (08h): Supported LBA-Change 00:28:25.563 Dataset Management (09h): Supported 00:28:25.563 00:28:25.563 Error Log 00:28:25.563 ========= 00:28:25.563 Entry: 0 00:28:25.563 Error Count: 0x3 00:28:25.563 Submission Queue Id: 0x0 00:28:25.563 Command Id: 0x5 00:28:25.563 Phase Bit: 0 00:28:25.563 Status Code: 0x2 00:28:25.563 Status Code Type: 0x0 00:28:25.563 Do Not Retry: 1 00:28:25.563 Error Location: 0x28 00:28:25.563 LBA: 0x0 00:28:25.563 Namespace: 0x0 00:28:25.563 Vendor Log Page: 0x0 00:28:25.563 ----------- 00:28:25.563 Entry: 1 00:28:25.563 Error Count: 0x2 00:28:25.563 Submission Queue Id: 0x0 00:28:25.563 Command Id: 0x5 00:28:25.563 Phase Bit: 0 00:28:25.563 Status Code: 0x2 00:28:25.563 Status Code Type: 0x0 00:28:25.563 Do Not Retry: 1 00:28:25.563 Error Location: 0x28 00:28:25.563 LBA: 0x0 00:28:25.563 Namespace: 0x0 00:28:25.563 Vendor Log Page: 0x0 00:28:25.563 ----------- 00:28:25.563 Entry: 2 00:28:25.563 Error Count: 0x1 00:28:25.563 Submission Queue Id: 0x0 00:28:25.563 Command Id: 0x4 00:28:25.563 Phase Bit: 0 00:28:25.563 Status Code: 0x2 00:28:25.563 Status Code Type: 0x0 00:28:25.563 Do Not Retry: 1 00:28:25.563 Error Location: 0x28 00:28:25.563 LBA: 0x0 00:28:25.563 Namespace: 0x0 00:28:25.563 Vendor Log Page: 0x0 00:28:25.563 00:28:25.563 Number of Queues 00:28:25.563 ================ 00:28:25.563 Number of I/O Submission Queues: 128 00:28:25.563 Number of I/O Completion Queues: 128 00:28:25.563 00:28:25.563 ZNS Specific Controller Data 00:28:25.563 ============================ 00:28:25.563 Zone Append Size Limit: 0 00:28:25.563 00:28:25.563 00:28:25.563 Active Namespaces 00:28:25.563 ================= 00:28:25.563 get_feature(0x05) failed 00:28:25.563 Namespace ID:1 00:28:25.563 Command Set Identifier: NVM (00h) 00:28:25.563 Deallocate: Supported 00:28:25.563 Deallocated/Unwritten Error: Not Supported 00:28:25.563 Deallocated Read Value: Unknown 00:28:25.563 Deallocate in Write Zeroes: Not Supported 00:28:25.563 Deallocated Guard Field: 0xFFFF 00:28:25.563 Flush: Supported 00:28:25.563 Reservation: Not Supported 00:28:25.563 Namespace Sharing Capabilities: Multiple Controllers 00:28:25.563 Size (in LBAs): 1953525168 (931GiB) 00:28:25.563 Capacity (in LBAs): 1953525168 (931GiB) 00:28:25.563 Utilization (in LBAs): 1953525168 (931GiB) 00:28:25.563 UUID: 5923cce2-592d-4cbd-bc87-8043d5ffe0e3 00:28:25.563 Thin Provisioning: Not Supported 00:28:25.563 Per-NS Atomic Units: Yes 00:28:25.563 Atomic Boundary Size (Normal): 0 00:28:25.563 Atomic Boundary Size (PFail): 0 00:28:25.563 Atomic Boundary Offset: 0 00:28:25.563 NGUID/EUI64 Never Reused: No 00:28:25.563 ANA group ID: 1 00:28:25.563 Namespace Write Protected: No 00:28:25.563 Number of LBA Formats: 1 00:28:25.563 Current LBA Format: LBA Format #00 00:28:25.563 LBA Format #00: Data Size: 512 Metadata Size: 0 00:28:25.563 00:28:25.563 05:13:04 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:28:25.563 05:13:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:28:25.563 05:13:04 -- nvmf/common.sh@117 -- # sync 00:28:25.563 05:13:04 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:28:25.563 05:13:04 -- nvmf/common.sh@120 -- # set +e 00:28:25.563 05:13:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:28:25.563 05:13:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:28:25.563 rmmod nvme_tcp 00:28:25.563 rmmod nvme_fabrics 00:28:25.563 05:13:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:28:25.563 05:13:04 -- nvmf/common.sh@124 -- # set -e 00:28:25.563 05:13:04 -- nvmf/common.sh@125 -- # return 0 00:28:25.563 05:13:04 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:28:25.563 05:13:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:28:25.563 05:13:04 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:28:25.563 05:13:04 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:28:25.563 05:13:04 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:25.563 05:13:04 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:28:25.563 05:13:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:25.563 05:13:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:25.563 05:13:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:28.099 05:13:06 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:28:28.099 05:13:06 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:28:28.099 05:13:06 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:28:28.099 05:13:06 -- nvmf/common.sh@675 -- # echo 0 00:28:28.099 05:13:06 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:28.099 05:13:06 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:28:28.099 05:13:06 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:28:28.099 05:13:06 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:28.099 05:13:06 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:28:28.099 05:13:06 -- nvmf/common.sh@684 -- # modprobe -r nvmet_tcp nvmet 00:28:28.099 05:13:06 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:29.033 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:28:29.033 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:28:29.033 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:28:29.033 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:28:29.033 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:28:29.033 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:28:29.033 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:28:29.033 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:28:29.033 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:28:30.002 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:28:30.002 00:28:30.002 real 0m8.873s 00:28:30.002 user 0m1.775s 00:28:30.002 sys 0m3.181s 00:28:30.002 05:13:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:30.002 05:13:08 -- common/autotest_common.sh@10 -- # set +x 00:28:30.002 ************************************ 00:28:30.002 END TEST nvmf_identify_kernel_target 00:28:30.002 ************************************ 00:28:30.003 05:13:09 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=tcp 00:28:30.003 05:13:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:30.003 05:13:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:30.003 05:13:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.003 ************************************ 00:28:30.003 START TEST nvmf_auth 00:28:30.003 ************************************ 00:28:30.003 05:13:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=tcp 00:28:30.262 * Looking for test storage... 00:28:30.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:30.262 05:13:09 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:30.262 05:13:09 -- nvmf/common.sh@7 -- # uname -s 00:28:30.262 05:13:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:30.262 05:13:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:30.262 05:13:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:30.262 05:13:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:30.262 05:13:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:30.262 05:13:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:30.262 05:13:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:30.262 05:13:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:30.262 05:13:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:30.262 05:13:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:30.262 05:13:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:30.262 05:13:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:30.262 05:13:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:30.262 05:13:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:30.262 05:13:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:30.262 05:13:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:30.262 05:13:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:30.262 05:13:09 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:30.262 05:13:09 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:30.262 05:13:09 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:30.262 05:13:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.262 05:13:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.262 05:13:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.262 05:13:09 -- paths/export.sh@5 -- # export PATH 00:28:30.262 05:13:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.262 05:13:09 -- nvmf/common.sh@47 -- # : 0 00:28:30.262 05:13:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:30.262 05:13:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:30.262 05:13:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:30.262 05:13:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:30.262 05:13:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:30.262 05:13:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:30.262 05:13:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:30.262 05:13:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:30.262 05:13:09 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:28:30.262 05:13:09 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:28:30.262 05:13:09 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:28:30.262 05:13:09 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:28:30.262 05:13:09 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:28:30.262 05:13:09 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:28:30.262 05:13:09 -- host/auth.sh@21 -- # keys=() 00:28:30.262 05:13:09 -- host/auth.sh@77 -- # nvmftestinit 00:28:30.262 05:13:09 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:28:30.262 05:13:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:30.262 05:13:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:28:30.262 05:13:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:28:30.262 05:13:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:28:30.262 05:13:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:30.262 05:13:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:30.262 05:13:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:30.262 05:13:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:28:30.262 05:13:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:28:30.262 05:13:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:28:30.262 05:13:09 -- common/autotest_common.sh@10 -- # set +x 00:28:32.169 05:13:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:32.169 05:13:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:32.169 05:13:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:32.169 05:13:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:32.169 05:13:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:32.169 05:13:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:32.169 05:13:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:32.169 05:13:11 -- nvmf/common.sh@295 -- # net_devs=() 00:28:32.169 05:13:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:32.169 05:13:11 -- nvmf/common.sh@296 -- # e810=() 00:28:32.169 05:13:11 -- nvmf/common.sh@296 -- # local -ga e810 00:28:32.169 05:13:11 -- nvmf/common.sh@297 -- # x722=() 00:28:32.169 05:13:11 -- nvmf/common.sh@297 -- # local -ga x722 00:28:32.169 05:13:11 -- nvmf/common.sh@298 -- # mlx=() 00:28:32.169 05:13:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:32.169 05:13:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:32.169 05:13:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:32.169 05:13:11 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:28:32.169 05:13:11 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:28:32.169 05:13:11 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:28:32.169 05:13:11 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:28:32.169 05:13:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:32.170 05:13:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:32.170 05:13:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:32.170 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:32.170 05:13:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:32.170 05:13:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:32.170 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:32.170 05:13:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:32.170 05:13:11 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:32.170 05:13:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:32.170 05:13:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:32.170 05:13:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:32.170 05:13:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:32.170 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:32.170 05:13:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:32.170 05:13:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:32.170 05:13:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:32.170 05:13:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:32.170 05:13:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:32.170 05:13:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:32.170 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:32.170 05:13:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:32.170 05:13:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:32.170 05:13:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:32.170 05:13:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:28:32.170 05:13:11 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:32.170 05:13:11 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:32.170 05:13:11 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:32.170 05:13:11 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:28:32.170 05:13:11 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:32.170 05:13:11 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:32.170 05:13:11 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:28:32.170 05:13:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:32.170 05:13:11 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:32.170 05:13:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:28:32.170 05:13:11 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:28:32.170 05:13:11 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:28:32.170 05:13:11 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:32.170 05:13:11 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:32.170 05:13:11 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:32.170 05:13:11 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:28:32.170 05:13:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:32.170 05:13:11 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:32.170 05:13:11 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:32.170 05:13:11 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:28:32.170 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:32.170 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:28:32.170 00:28:32.170 --- 10.0.0.2 ping statistics --- 00:28:32.170 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:32.170 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:28:32.170 05:13:11 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:32.170 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:32.170 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:28:32.170 00:28:32.170 --- 10.0.0.1 ping statistics --- 00:28:32.170 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:32.170 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:28:32.170 05:13:11 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:32.170 05:13:11 -- nvmf/common.sh@411 -- # return 0 00:28:32.170 05:13:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:32.170 05:13:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:32.170 05:13:11 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:28:32.170 05:13:11 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:32.170 05:13:11 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:28:32.170 05:13:11 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:28:32.170 05:13:11 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:28:32.170 05:13:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:28:32.170 05:13:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:28:32.170 05:13:11 -- common/autotest_common.sh@10 -- # set +x 00:28:32.170 05:13:11 -- nvmf/common.sh@470 -- # nvmfpid=2507910 00:28:32.170 05:13:11 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:28:32.170 05:13:11 -- nvmf/common.sh@471 -- # waitforlisten 2507910 00:28:32.170 05:13:11 -- common/autotest_common.sh@817 -- # '[' -z 2507910 ']' 00:28:32.170 05:13:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:32.170 05:13:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:32.170 05:13:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:32.170 05:13:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:32.170 05:13:11 -- common/autotest_common.sh@10 -- # set +x 00:28:32.739 05:13:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:32.739 05:13:11 -- common/autotest_common.sh@850 -- # return 0 00:28:32.739 05:13:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:28:32.739 05:13:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:28:32.739 05:13:11 -- common/autotest_common.sh@10 -- # set +x 00:28:32.739 05:13:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:32.739 05:13:11 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:28:32.739 05:13:11 -- host/auth.sh@81 -- # gen_key null 32 00:28:32.739 05:13:11 -- host/auth.sh@53 -- # local digest len file key 00:28:32.739 05:13:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:32.739 05:13:11 -- host/auth.sh@54 -- # local -A digests 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # digest=null 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # len=32 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # key=52e0118c92d3e9826b2d22fbe25e9f07 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.wqK 00:28:32.740 05:13:11 -- host/auth.sh@59 -- # format_dhchap_key 52e0118c92d3e9826b2d22fbe25e9f07 0 00:28:32.740 05:13:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 52e0118c92d3e9826b2d22fbe25e9f07 0 00:28:32.740 05:13:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # key=52e0118c92d3e9826b2d22fbe25e9f07 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # digest=0 00:28:32.740 05:13:11 -- nvmf/common.sh@694 -- # python - 00:28:32.740 05:13:11 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.wqK 00:28:32.740 05:13:11 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.wqK 00:28:32.740 05:13:11 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.wqK 00:28:32.740 05:13:11 -- host/auth.sh@82 -- # gen_key null 48 00:28:32.740 05:13:11 -- host/auth.sh@53 -- # local digest len file key 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # local -A digests 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # digest=null 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # len=48 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # key=24990fda401c05dc211159556befbd544f18c03e86e2a346 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.mfV 00:28:32.740 05:13:11 -- host/auth.sh@59 -- # format_dhchap_key 24990fda401c05dc211159556befbd544f18c03e86e2a346 0 00:28:32.740 05:13:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 24990fda401c05dc211159556befbd544f18c03e86e2a346 0 00:28:32.740 05:13:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # key=24990fda401c05dc211159556befbd544f18c03e86e2a346 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # digest=0 00:28:32.740 05:13:11 -- nvmf/common.sh@694 -- # python - 00:28:32.740 05:13:11 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.mfV 00:28:32.740 05:13:11 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.mfV 00:28:32.740 05:13:11 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.mfV 00:28:32.740 05:13:11 -- host/auth.sh@83 -- # gen_key sha256 32 00:28:32.740 05:13:11 -- host/auth.sh@53 -- # local digest len file key 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # local -A digests 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # digest=sha256 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # len=32 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # key=bf311c341ca782777be0341821e99129 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.wVW 00:28:32.740 05:13:11 -- host/auth.sh@59 -- # format_dhchap_key bf311c341ca782777be0341821e99129 1 00:28:32.740 05:13:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 bf311c341ca782777be0341821e99129 1 00:28:32.740 05:13:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # key=bf311c341ca782777be0341821e99129 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # digest=1 00:28:32.740 05:13:11 -- nvmf/common.sh@694 -- # python - 00:28:32.740 05:13:11 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.wVW 00:28:32.740 05:13:11 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.wVW 00:28:32.740 05:13:11 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.wVW 00:28:32.740 05:13:11 -- host/auth.sh@84 -- # gen_key sha384 48 00:28:32.740 05:13:11 -- host/auth.sh@53 -- # local digest len file key 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # local -A digests 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # digest=sha384 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # len=48 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # key=688bb2f280da1041c04952e9f1d1c4d2b00476aa77a8e39a 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.VfJ 00:28:32.740 05:13:11 -- host/auth.sh@59 -- # format_dhchap_key 688bb2f280da1041c04952e9f1d1c4d2b00476aa77a8e39a 2 00:28:32.740 05:13:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 688bb2f280da1041c04952e9f1d1c4d2b00476aa77a8e39a 2 00:28:32.740 05:13:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # key=688bb2f280da1041c04952e9f1d1c4d2b00476aa77a8e39a 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # digest=2 00:28:32.740 05:13:11 -- nvmf/common.sh@694 -- # python - 00:28:32.740 05:13:11 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.VfJ 00:28:32.740 05:13:11 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.VfJ 00:28:32.740 05:13:11 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.VfJ 00:28:32.740 05:13:11 -- host/auth.sh@85 -- # gen_key sha512 64 00:28:32.740 05:13:11 -- host/auth.sh@53 -- # local digest len file key 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:32.740 05:13:11 -- host/auth.sh@54 -- # local -A digests 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # digest=sha512 00:28:32.740 05:13:11 -- host/auth.sh@56 -- # len=64 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:28:32.740 05:13:11 -- host/auth.sh@57 -- # key=055626e4d760f33e3a3e7737a6bf69811741e9c7fde250a1129109f473e325e7 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:28:32.740 05:13:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.G4p 00:28:32.740 05:13:11 -- host/auth.sh@59 -- # format_dhchap_key 055626e4d760f33e3a3e7737a6bf69811741e9c7fde250a1129109f473e325e7 3 00:28:32.740 05:13:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 055626e4d760f33e3a3e7737a6bf69811741e9c7fde250a1129109f473e325e7 3 00:28:32.740 05:13:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # key=055626e4d760f33e3a3e7737a6bf69811741e9c7fde250a1129109f473e325e7 00:28:32.740 05:13:11 -- nvmf/common.sh@693 -- # digest=3 00:28:32.740 05:13:11 -- nvmf/common.sh@694 -- # python - 00:28:32.999 05:13:11 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.G4p 00:28:32.999 05:13:11 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.G4p 00:28:32.999 05:13:11 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.G4p 00:28:32.999 05:13:11 -- host/auth.sh@87 -- # waitforlisten 2507910 00:28:32.999 05:13:11 -- common/autotest_common.sh@817 -- # '[' -z 2507910 ']' 00:28:32.999 05:13:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:32.999 05:13:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:32.999 05:13:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:32.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:32.999 05:13:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:32.999 05:13:11 -- common/autotest_common.sh@10 -- # set +x 00:28:33.257 05:13:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:33.257 05:13:12 -- common/autotest_common.sh@850 -- # return 0 00:28:33.257 05:13:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:33.257 05:13:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.wqK 00:28:33.257 05:13:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:33.257 05:13:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.257 05:13:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:33.257 05:13:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:33.257 05:13:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.mfV 00:28:33.257 05:13:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:33.257 05:13:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.257 05:13:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:33.257 05:13:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:33.257 05:13:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.wVW 00:28:33.257 05:13:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:33.257 05:13:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.257 05:13:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:33.257 05:13:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:33.257 05:13:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.VfJ 00:28:33.257 05:13:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:33.257 05:13:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.257 05:13:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:33.257 05:13:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:33.257 05:13:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.G4p 00:28:33.257 05:13:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:33.257 05:13:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.257 05:13:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:33.257 05:13:12 -- host/auth.sh@92 -- # nvmet_auth_init 00:28:33.257 05:13:12 -- host/auth.sh@35 -- # get_main_ns_ip 00:28:33.257 05:13:12 -- nvmf/common.sh@717 -- # local ip 00:28:33.257 05:13:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:33.257 05:13:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:33.257 05:13:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:33.257 05:13:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:33.257 05:13:12 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:33.257 05:13:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:33.257 05:13:12 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:33.257 05:13:12 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:33.257 05:13:12 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:33.257 05:13:12 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 10.0.0.1 00:28:33.257 05:13:12 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=10.0.0.1 00:28:33.257 05:13:12 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:28:33.257 05:13:12 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:28:33.258 05:13:12 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:28:33.258 05:13:12 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:28:33.258 05:13:12 -- nvmf/common.sh@628 -- # local block nvme 00:28:33.258 05:13:12 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:28:33.258 05:13:12 -- nvmf/common.sh@631 -- # modprobe nvmet 00:28:33.258 05:13:12 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:28:33.258 05:13:12 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:28:34.192 Waiting for block devices as requested 00:28:34.192 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:28:34.449 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:34.449 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:34.449 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:34.707 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:34.707 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:34.707 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:34.707 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:34.707 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:34.965 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:34.965 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:34.965 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:34.965 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:35.224 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:35.224 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:35.224 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:35.482 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:35.742 05:13:14 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:35.742 05:13:14 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:28:35.742 05:13:14 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:28:35.742 05:13:14 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:28:35.742 05:13:14 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:28:35.742 05:13:14 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:28:35.742 05:13:14 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:28:35.742 05:13:14 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:28:35.742 05:13:14 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:28:35.742 No valid GPT data, bailing 00:28:35.742 05:13:14 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:28:35.742 05:13:14 -- scripts/common.sh@391 -- # pt= 00:28:35.742 05:13:14 -- scripts/common.sh@392 -- # return 1 00:28:35.742 05:13:14 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:28:35.742 05:13:14 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:28:35.742 05:13:14 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:28:35.742 05:13:14 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:28:35.742 05:13:14 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:28:35.742 05:13:14 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:28:35.742 05:13:14 -- nvmf/common.sh@656 -- # echo 1 00:28:35.742 05:13:14 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:28:35.742 05:13:14 -- nvmf/common.sh@658 -- # echo 1 00:28:35.742 05:13:14 -- nvmf/common.sh@660 -- # echo 10.0.0.1 00:28:35.742 05:13:14 -- nvmf/common.sh@661 -- # echo tcp 00:28:35.742 05:13:14 -- nvmf/common.sh@662 -- # echo 4420 00:28:35.742 05:13:14 -- nvmf/common.sh@663 -- # echo ipv4 00:28:35.742 05:13:14 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:28:35.743 05:13:14 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:28:35.743 00:28:35.743 Discovery Log Number of Records 2, Generation counter 2 00:28:35.743 =====Discovery Log Entry 0====== 00:28:35.743 trtype: tcp 00:28:35.743 adrfam: ipv4 00:28:35.743 subtype: current discovery subsystem 00:28:35.743 treq: not specified, sq flow control disable supported 00:28:35.743 portid: 1 00:28:35.743 trsvcid: 4420 00:28:35.743 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:28:35.743 traddr: 10.0.0.1 00:28:35.743 eflags: none 00:28:35.743 sectype: none 00:28:35.743 =====Discovery Log Entry 1====== 00:28:35.743 trtype: tcp 00:28:35.743 adrfam: ipv4 00:28:35.743 subtype: nvme subsystem 00:28:35.743 treq: not specified, sq flow control disable supported 00:28:35.743 portid: 1 00:28:35.743 trsvcid: 4420 00:28:35.743 subnqn: nqn.2024-02.io.spdk:cnode0 00:28:35.743 traddr: 10.0.0.1 00:28:35.743 eflags: none 00:28:35.743 sectype: none 00:28:35.743 05:13:14 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:28:35.743 05:13:14 -- host/auth.sh@37 -- # echo 0 00:28:35.743 05:13:14 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:28:35.743 05:13:14 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:28:35.743 05:13:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:35.743 05:13:14 -- host/auth.sh@44 -- # digest=sha256 00:28:35.743 05:13:14 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:35.743 05:13:14 -- host/auth.sh@44 -- # keyid=1 00:28:35.743 05:13:14 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:35.743 05:13:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:35.743 05:13:14 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:35.743 05:13:14 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:35.743 05:13:14 -- host/auth.sh@100 -- # IFS=, 00:28:35.743 05:13:14 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:28:35.743 05:13:14 -- host/auth.sh@100 -- # IFS=, 00:28:35.743 05:13:14 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:28:35.743 05:13:14 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:28:35.743 05:13:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:35.743 05:13:14 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:28:35.743 05:13:14 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:28:35.743 05:13:14 -- host/auth.sh@68 -- # keyid=1 00:28:35.743 05:13:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:28:35.743 05:13:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:35.743 05:13:14 -- common/autotest_common.sh@10 -- # set +x 00:28:35.743 05:13:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:35.743 05:13:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:35.743 05:13:14 -- nvmf/common.sh@717 -- # local ip 00:28:35.743 05:13:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:35.743 05:13:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:35.743 05:13:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:35.743 05:13:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:35.743 05:13:14 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:35.743 05:13:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:35.743 05:13:14 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:35.743 05:13:14 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:35.743 05:13:14 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:35.743 05:13:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:35.743 05:13:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:35.743 05:13:14 -- common/autotest_common.sh@10 -- # set +x 00:28:36.003 nvme0n1 00:28:36.003 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.003 05:13:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:36.003 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.003 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.003 05:13:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:36.003 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.003 05:13:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:36.003 05:13:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:36.003 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.003 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.003 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.003 05:13:15 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:28:36.003 05:13:15 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:36.003 05:13:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:36.003 05:13:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:28:36.003 05:13:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:36.003 05:13:15 -- host/auth.sh@44 -- # digest=sha256 00:28:36.003 05:13:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:36.003 05:13:15 -- host/auth.sh@44 -- # keyid=0 00:28:36.003 05:13:15 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:36.003 05:13:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:36.003 05:13:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:36.003 05:13:15 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:36.003 05:13:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:28:36.003 05:13:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:36.003 05:13:15 -- host/auth.sh@68 -- # digest=sha256 00:28:36.003 05:13:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:36.003 05:13:15 -- host/auth.sh@68 -- # keyid=0 00:28:36.003 05:13:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:36.003 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.003 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.003 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.003 05:13:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:36.003 05:13:15 -- nvmf/common.sh@717 -- # local ip 00:28:36.003 05:13:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:36.003 05:13:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:36.003 05:13:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:36.003 05:13:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:36.003 05:13:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:36.003 05:13:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:36.003 05:13:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:36.003 05:13:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:36.003 05:13:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:36.003 05:13:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:36.003 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.003 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.262 nvme0n1 00:28:36.262 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.262 05:13:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:36.262 05:13:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:36.262 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.262 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.262 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.262 05:13:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:36.262 05:13:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:36.262 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.262 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.262 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.262 05:13:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:36.262 05:13:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:28:36.262 05:13:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:36.262 05:13:15 -- host/auth.sh@44 -- # digest=sha256 00:28:36.262 05:13:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:36.262 05:13:15 -- host/auth.sh@44 -- # keyid=1 00:28:36.262 05:13:15 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:36.262 05:13:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:36.262 05:13:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:36.262 05:13:15 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:36.262 05:13:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:28:36.262 05:13:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:36.262 05:13:15 -- host/auth.sh@68 -- # digest=sha256 00:28:36.262 05:13:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:36.262 05:13:15 -- host/auth.sh@68 -- # keyid=1 00:28:36.262 05:13:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:36.262 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.262 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.262 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.262 05:13:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:36.262 05:13:15 -- nvmf/common.sh@717 -- # local ip 00:28:36.262 05:13:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:36.262 05:13:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:36.262 05:13:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:36.262 05:13:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:36.262 05:13:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:36.262 05:13:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:36.262 05:13:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:36.262 05:13:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:36.262 05:13:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:36.262 05:13:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:36.262 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.262 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.262 nvme0n1 00:28:36.262 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.262 05:13:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:36.262 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.262 05:13:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:36.262 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.262 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.521 05:13:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:36.521 05:13:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:36.521 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.521 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.521 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.521 05:13:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:36.521 05:13:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:28:36.521 05:13:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:36.521 05:13:15 -- host/auth.sh@44 -- # digest=sha256 00:28:36.521 05:13:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:36.521 05:13:15 -- host/auth.sh@44 -- # keyid=2 00:28:36.521 05:13:15 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:36.521 05:13:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:36.521 05:13:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:36.521 05:13:15 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:36.521 05:13:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:28:36.521 05:13:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:36.521 05:13:15 -- host/auth.sh@68 -- # digest=sha256 00:28:36.521 05:13:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:36.521 05:13:15 -- host/auth.sh@68 -- # keyid=2 00:28:36.521 05:13:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:36.521 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.521 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.521 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.521 05:13:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:36.521 05:13:15 -- nvmf/common.sh@717 -- # local ip 00:28:36.521 05:13:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:36.521 05:13:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:36.521 05:13:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:36.521 05:13:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:36.521 05:13:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:36.521 05:13:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:36.521 05:13:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:36.521 05:13:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:36.521 05:13:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:36.521 05:13:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:36.521 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.521 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.522 nvme0n1 00:28:36.522 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.522 05:13:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:36.522 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.522 05:13:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:36.522 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.522 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.522 05:13:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:36.522 05:13:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:36.522 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.522 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.522 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.522 05:13:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:36.522 05:13:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:28:36.522 05:13:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:36.522 05:13:15 -- host/auth.sh@44 -- # digest=sha256 00:28:36.522 05:13:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:36.522 05:13:15 -- host/auth.sh@44 -- # keyid=3 00:28:36.522 05:13:15 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:36.522 05:13:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:36.522 05:13:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:36.522 05:13:15 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:36.522 05:13:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:28:36.522 05:13:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:36.522 05:13:15 -- host/auth.sh@68 -- # digest=sha256 00:28:36.522 05:13:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:36.522 05:13:15 -- host/auth.sh@68 -- # keyid=3 00:28:36.522 05:13:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:36.522 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.522 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.522 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.522 05:13:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:36.522 05:13:15 -- nvmf/common.sh@717 -- # local ip 00:28:36.522 05:13:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:36.522 05:13:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:36.522 05:13:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:36.522 05:13:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:36.522 05:13:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:36.522 05:13:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:36.522 05:13:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:36.522 05:13:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:36.522 05:13:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:36.522 05:13:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:36.522 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.522 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.780 nvme0n1 00:28:36.780 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.780 05:13:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:36.780 05:13:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:36.780 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.780 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.780 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.780 05:13:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:36.780 05:13:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:36.781 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.781 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.781 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.781 05:13:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:36.781 05:13:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:28:36.781 05:13:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:36.781 05:13:15 -- host/auth.sh@44 -- # digest=sha256 00:28:36.781 05:13:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:36.781 05:13:15 -- host/auth.sh@44 -- # keyid=4 00:28:36.781 05:13:15 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:36.781 05:13:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:36.781 05:13:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:36.781 05:13:15 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:36.781 05:13:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:28:36.781 05:13:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:36.781 05:13:15 -- host/auth.sh@68 -- # digest=sha256 00:28:36.781 05:13:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:36.781 05:13:15 -- host/auth.sh@68 -- # keyid=4 00:28:36.781 05:13:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:36.781 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.781 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.781 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.781 05:13:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:36.781 05:13:15 -- nvmf/common.sh@717 -- # local ip 00:28:36.781 05:13:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:36.781 05:13:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:36.781 05:13:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:36.781 05:13:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:36.781 05:13:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:36.781 05:13:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:36.781 05:13:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:36.781 05:13:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:36.781 05:13:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:36.781 05:13:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:36.781 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.781 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.781 nvme0n1 00:28:36.781 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:36.781 05:13:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:36.781 05:13:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:36.781 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:36.781 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.781 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.041 05:13:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:37.041 05:13:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:37.041 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.041 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:37.041 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.041 05:13:15 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:37.041 05:13:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:37.041 05:13:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:28:37.041 05:13:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:37.041 05:13:15 -- host/auth.sh@44 -- # digest=sha256 00:28:37.041 05:13:15 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:37.041 05:13:15 -- host/auth.sh@44 -- # keyid=0 00:28:37.041 05:13:15 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:37.041 05:13:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:37.041 05:13:15 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:37.041 05:13:15 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:37.041 05:13:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:28:37.041 05:13:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:37.041 05:13:15 -- host/auth.sh@68 -- # digest=sha256 00:28:37.041 05:13:15 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:37.041 05:13:15 -- host/auth.sh@68 -- # keyid=0 00:28:37.041 05:13:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:37.041 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.041 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:37.041 05:13:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.041 05:13:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:37.041 05:13:15 -- nvmf/common.sh@717 -- # local ip 00:28:37.041 05:13:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:37.041 05:13:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:37.041 05:13:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:37.041 05:13:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:37.041 05:13:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:37.041 05:13:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:37.041 05:13:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:37.041 05:13:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:37.041 05:13:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:37.041 05:13:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:37.041 05:13:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.041 05:13:15 -- common/autotest_common.sh@10 -- # set +x 00:28:37.041 nvme0n1 00:28:37.041 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.041 05:13:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:37.041 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.041 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.041 05:13:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:37.041 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.041 05:13:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:37.041 05:13:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:37.041 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.041 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.302 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.302 05:13:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:37.302 05:13:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:28:37.302 05:13:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:37.302 05:13:16 -- host/auth.sh@44 -- # digest=sha256 00:28:37.302 05:13:16 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:37.302 05:13:16 -- host/auth.sh@44 -- # keyid=1 00:28:37.302 05:13:16 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:37.302 05:13:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:37.302 05:13:16 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:37.302 05:13:16 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:37.302 05:13:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:28:37.302 05:13:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:37.302 05:13:16 -- host/auth.sh@68 -- # digest=sha256 00:28:37.302 05:13:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:37.302 05:13:16 -- host/auth.sh@68 -- # keyid=1 00:28:37.302 05:13:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:37.302 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.302 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.302 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.302 05:13:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:37.302 05:13:16 -- nvmf/common.sh@717 -- # local ip 00:28:37.302 05:13:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:37.302 05:13:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:37.302 05:13:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:37.302 05:13:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:37.302 05:13:16 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:37.302 05:13:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:37.302 05:13:16 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:37.302 05:13:16 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:37.302 05:13:16 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:37.302 05:13:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:37.302 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.302 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.302 nvme0n1 00:28:37.302 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.302 05:13:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:37.302 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.302 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.302 05:13:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:37.303 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.303 05:13:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:37.303 05:13:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:37.303 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.303 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.303 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.303 05:13:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:37.303 05:13:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:28:37.303 05:13:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:37.303 05:13:16 -- host/auth.sh@44 -- # digest=sha256 00:28:37.303 05:13:16 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:37.303 05:13:16 -- host/auth.sh@44 -- # keyid=2 00:28:37.303 05:13:16 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:37.303 05:13:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:37.303 05:13:16 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:37.303 05:13:16 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:37.303 05:13:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:28:37.303 05:13:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:37.303 05:13:16 -- host/auth.sh@68 -- # digest=sha256 00:28:37.303 05:13:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:37.303 05:13:16 -- host/auth.sh@68 -- # keyid=2 00:28:37.303 05:13:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:37.303 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.303 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.303 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.303 05:13:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:37.303 05:13:16 -- nvmf/common.sh@717 -- # local ip 00:28:37.303 05:13:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:37.303 05:13:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:37.303 05:13:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:37.303 05:13:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:37.303 05:13:16 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:37.303 05:13:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:37.303 05:13:16 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:37.303 05:13:16 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:37.303 05:13:16 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:37.303 05:13:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:37.303 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.303 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.563 nvme0n1 00:28:37.563 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.563 05:13:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:37.563 05:13:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:37.563 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.563 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.563 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.563 05:13:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:37.563 05:13:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:37.563 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.563 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.563 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.563 05:13:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:37.563 05:13:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:28:37.563 05:13:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:37.563 05:13:16 -- host/auth.sh@44 -- # digest=sha256 00:28:37.563 05:13:16 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:37.563 05:13:16 -- host/auth.sh@44 -- # keyid=3 00:28:37.563 05:13:16 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:37.563 05:13:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:37.563 05:13:16 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:37.563 05:13:16 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:37.563 05:13:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:28:37.563 05:13:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:37.563 05:13:16 -- host/auth.sh@68 -- # digest=sha256 00:28:37.563 05:13:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:37.563 05:13:16 -- host/auth.sh@68 -- # keyid=3 00:28:37.563 05:13:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:37.563 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.563 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.563 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.563 05:13:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:37.563 05:13:16 -- nvmf/common.sh@717 -- # local ip 00:28:37.563 05:13:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:37.563 05:13:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:37.563 05:13:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:37.563 05:13:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:37.563 05:13:16 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:37.563 05:13:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:37.563 05:13:16 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:37.563 05:13:16 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:37.563 05:13:16 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:37.563 05:13:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:37.563 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.563 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.823 nvme0n1 00:28:37.823 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.823 05:13:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:37.823 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.823 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.823 05:13:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:37.823 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.823 05:13:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:37.823 05:13:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:37.823 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.823 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.823 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.823 05:13:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:37.823 05:13:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:28:37.823 05:13:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:37.823 05:13:16 -- host/auth.sh@44 -- # digest=sha256 00:28:37.823 05:13:16 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:37.823 05:13:16 -- host/auth.sh@44 -- # keyid=4 00:28:37.823 05:13:16 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:37.823 05:13:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:37.823 05:13:16 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:37.823 05:13:16 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:37.823 05:13:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:28:37.823 05:13:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:37.823 05:13:16 -- host/auth.sh@68 -- # digest=sha256 00:28:37.823 05:13:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:37.823 05:13:16 -- host/auth.sh@68 -- # keyid=4 00:28:37.823 05:13:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:37.823 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.823 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.823 05:13:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:37.823 05:13:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:37.823 05:13:16 -- nvmf/common.sh@717 -- # local ip 00:28:37.823 05:13:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:37.823 05:13:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:37.823 05:13:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:37.823 05:13:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:37.823 05:13:16 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:37.823 05:13:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:37.823 05:13:16 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:37.824 05:13:16 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:37.824 05:13:16 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:37.824 05:13:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:37.824 05:13:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:37.824 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:28:38.083 nvme0n1 00:28:38.083 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.083 05:13:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:38.083 05:13:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:38.083 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.083 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.083 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.083 05:13:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:38.083 05:13:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:38.083 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.083 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.083 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.083 05:13:17 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:38.083 05:13:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:38.083 05:13:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:28:38.083 05:13:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:38.083 05:13:17 -- host/auth.sh@44 -- # digest=sha256 00:28:38.083 05:13:17 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:38.083 05:13:17 -- host/auth.sh@44 -- # keyid=0 00:28:38.083 05:13:17 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:38.083 05:13:17 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:38.083 05:13:17 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:38.083 05:13:17 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:38.083 05:13:17 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:28:38.083 05:13:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:38.083 05:13:17 -- host/auth.sh@68 -- # digest=sha256 00:28:38.083 05:13:17 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:38.083 05:13:17 -- host/auth.sh@68 -- # keyid=0 00:28:38.083 05:13:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:38.083 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.083 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.083 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.083 05:13:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:38.083 05:13:17 -- nvmf/common.sh@717 -- # local ip 00:28:38.083 05:13:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:38.083 05:13:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:38.083 05:13:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:38.083 05:13:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:38.083 05:13:17 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:38.083 05:13:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:38.083 05:13:17 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:38.083 05:13:17 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:38.083 05:13:17 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:38.083 05:13:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:38.083 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.083 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.341 nvme0n1 00:28:38.341 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.341 05:13:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:38.341 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.341 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.341 05:13:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:38.341 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.341 05:13:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:38.341 05:13:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:38.341 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.341 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.341 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.341 05:13:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:38.341 05:13:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:28:38.341 05:13:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:38.341 05:13:17 -- host/auth.sh@44 -- # digest=sha256 00:28:38.341 05:13:17 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:38.341 05:13:17 -- host/auth.sh@44 -- # keyid=1 00:28:38.341 05:13:17 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:38.341 05:13:17 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:38.341 05:13:17 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:38.341 05:13:17 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:38.341 05:13:17 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:28:38.341 05:13:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:38.341 05:13:17 -- host/auth.sh@68 -- # digest=sha256 00:28:38.341 05:13:17 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:38.341 05:13:17 -- host/auth.sh@68 -- # keyid=1 00:28:38.341 05:13:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:38.341 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.341 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.341 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.341 05:13:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:38.341 05:13:17 -- nvmf/common.sh@717 -- # local ip 00:28:38.341 05:13:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:38.341 05:13:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:38.341 05:13:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:38.341 05:13:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:38.341 05:13:17 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:38.341 05:13:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:38.341 05:13:17 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:38.341 05:13:17 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:38.341 05:13:17 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:38.341 05:13:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:38.341 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.341 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.599 nvme0n1 00:28:38.599 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.599 05:13:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:38.599 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.599 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.599 05:13:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:38.599 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.599 05:13:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:38.599 05:13:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:38.599 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.599 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.599 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.599 05:13:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:38.599 05:13:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:28:38.600 05:13:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:38.600 05:13:17 -- host/auth.sh@44 -- # digest=sha256 00:28:38.600 05:13:17 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:38.600 05:13:17 -- host/auth.sh@44 -- # keyid=2 00:28:38.600 05:13:17 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:38.600 05:13:17 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:38.600 05:13:17 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:38.600 05:13:17 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:38.600 05:13:17 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:28:38.600 05:13:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:38.600 05:13:17 -- host/auth.sh@68 -- # digest=sha256 00:28:38.600 05:13:17 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:38.600 05:13:17 -- host/auth.sh@68 -- # keyid=2 00:28:38.600 05:13:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:38.600 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.600 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.600 05:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.600 05:13:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:38.600 05:13:17 -- nvmf/common.sh@717 -- # local ip 00:28:38.600 05:13:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:38.600 05:13:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:38.600 05:13:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:38.600 05:13:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:38.600 05:13:17 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:38.600 05:13:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:38.600 05:13:17 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:38.600 05:13:17 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:38.600 05:13:17 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:38.600 05:13:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:38.600 05:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.600 05:13:17 -- common/autotest_common.sh@10 -- # set +x 00:28:38.858 nvme0n1 00:28:38.858 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:38.858 05:13:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:38.858 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:38.858 05:13:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:38.858 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:38.858 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.118 05:13:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:39.118 05:13:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:39.118 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.118 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.118 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.118 05:13:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:39.118 05:13:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:28:39.118 05:13:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:39.118 05:13:18 -- host/auth.sh@44 -- # digest=sha256 00:28:39.118 05:13:18 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:39.118 05:13:18 -- host/auth.sh@44 -- # keyid=3 00:28:39.118 05:13:18 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:39.118 05:13:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:39.118 05:13:18 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:39.118 05:13:18 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:39.118 05:13:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:28:39.118 05:13:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:39.118 05:13:18 -- host/auth.sh@68 -- # digest=sha256 00:28:39.118 05:13:18 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:39.118 05:13:18 -- host/auth.sh@68 -- # keyid=3 00:28:39.118 05:13:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:39.118 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.118 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.118 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.118 05:13:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:39.118 05:13:18 -- nvmf/common.sh@717 -- # local ip 00:28:39.118 05:13:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:39.118 05:13:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:39.118 05:13:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:39.118 05:13:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:39.118 05:13:18 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:39.118 05:13:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:39.118 05:13:18 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:39.118 05:13:18 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:39.118 05:13:18 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:39.118 05:13:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:39.118 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.118 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.378 nvme0n1 00:28:39.378 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.378 05:13:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:39.378 05:13:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:39.378 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.378 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.379 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.379 05:13:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:39.379 05:13:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:39.379 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.379 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.379 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.379 05:13:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:39.379 05:13:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:28:39.379 05:13:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:39.379 05:13:18 -- host/auth.sh@44 -- # digest=sha256 00:28:39.379 05:13:18 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:39.379 05:13:18 -- host/auth.sh@44 -- # keyid=4 00:28:39.379 05:13:18 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:39.379 05:13:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:39.379 05:13:18 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:39.379 05:13:18 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:39.379 05:13:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:28:39.379 05:13:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:39.379 05:13:18 -- host/auth.sh@68 -- # digest=sha256 00:28:39.379 05:13:18 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:39.379 05:13:18 -- host/auth.sh@68 -- # keyid=4 00:28:39.379 05:13:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:39.379 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.379 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.379 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.379 05:13:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:39.379 05:13:18 -- nvmf/common.sh@717 -- # local ip 00:28:39.379 05:13:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:39.379 05:13:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:39.379 05:13:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:39.379 05:13:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:39.379 05:13:18 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:39.379 05:13:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:39.379 05:13:18 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:39.379 05:13:18 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:39.379 05:13:18 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:39.379 05:13:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:39.379 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.379 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.639 nvme0n1 00:28:39.639 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.639 05:13:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:39.639 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.639 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.639 05:13:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:39.639 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.639 05:13:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:39.639 05:13:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:39.639 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.639 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.639 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.639 05:13:18 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:39.639 05:13:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:39.639 05:13:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:28:39.639 05:13:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:39.639 05:13:18 -- host/auth.sh@44 -- # digest=sha256 00:28:39.639 05:13:18 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:39.639 05:13:18 -- host/auth.sh@44 -- # keyid=0 00:28:39.639 05:13:18 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:39.639 05:13:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:39.639 05:13:18 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:39.639 05:13:18 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:39.639 05:13:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:28:39.639 05:13:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:39.639 05:13:18 -- host/auth.sh@68 -- # digest=sha256 00:28:39.639 05:13:18 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:39.639 05:13:18 -- host/auth.sh@68 -- # keyid=0 00:28:39.639 05:13:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:39.639 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.639 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:39.639 05:13:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:39.639 05:13:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:39.639 05:13:18 -- nvmf/common.sh@717 -- # local ip 00:28:39.639 05:13:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:39.639 05:13:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:39.639 05:13:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:39.639 05:13:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:39.639 05:13:18 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:39.639 05:13:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:39.639 05:13:18 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:39.639 05:13:18 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:39.639 05:13:18 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:39.639 05:13:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:39.639 05:13:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:39.639 05:13:18 -- common/autotest_common.sh@10 -- # set +x 00:28:40.208 nvme0n1 00:28:40.209 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.209 05:13:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:40.209 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.209 05:13:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:40.209 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.209 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.209 05:13:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:40.209 05:13:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:40.209 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.209 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.209 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.209 05:13:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:40.209 05:13:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:28:40.209 05:13:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:40.209 05:13:19 -- host/auth.sh@44 -- # digest=sha256 00:28:40.209 05:13:19 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:40.209 05:13:19 -- host/auth.sh@44 -- # keyid=1 00:28:40.209 05:13:19 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:40.209 05:13:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:40.209 05:13:19 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:40.209 05:13:19 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:40.209 05:13:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:28:40.209 05:13:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:40.209 05:13:19 -- host/auth.sh@68 -- # digest=sha256 00:28:40.209 05:13:19 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:40.209 05:13:19 -- host/auth.sh@68 -- # keyid=1 00:28:40.209 05:13:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:40.209 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.209 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.209 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.209 05:13:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:40.209 05:13:19 -- nvmf/common.sh@717 -- # local ip 00:28:40.209 05:13:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:40.209 05:13:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:40.209 05:13:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:40.209 05:13:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:40.209 05:13:19 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:40.209 05:13:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:40.209 05:13:19 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:40.209 05:13:19 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:40.209 05:13:19 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:40.209 05:13:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:40.209 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.209 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.778 nvme0n1 00:28:40.778 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.778 05:13:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:40.778 05:13:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:40.778 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.778 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.779 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.779 05:13:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:40.779 05:13:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:40.779 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.779 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.779 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.779 05:13:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:40.779 05:13:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:28:40.779 05:13:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:40.779 05:13:19 -- host/auth.sh@44 -- # digest=sha256 00:28:40.779 05:13:19 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:40.779 05:13:19 -- host/auth.sh@44 -- # keyid=2 00:28:40.779 05:13:19 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:40.779 05:13:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:40.779 05:13:19 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:40.779 05:13:19 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:40.779 05:13:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:28:40.779 05:13:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:40.779 05:13:19 -- host/auth.sh@68 -- # digest=sha256 00:28:40.779 05:13:19 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:40.779 05:13:19 -- host/auth.sh@68 -- # keyid=2 00:28:40.779 05:13:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:40.779 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.779 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.779 05:13:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.779 05:13:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:40.779 05:13:19 -- nvmf/common.sh@717 -- # local ip 00:28:40.779 05:13:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:40.779 05:13:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:40.779 05:13:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:40.779 05:13:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:40.779 05:13:19 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:40.779 05:13:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:40.779 05:13:19 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:40.779 05:13:19 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:40.779 05:13:19 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:40.779 05:13:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:40.779 05:13:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.779 05:13:19 -- common/autotest_common.sh@10 -- # set +x 00:28:41.346 nvme0n1 00:28:41.346 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.346 05:13:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:41.346 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.346 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:41.346 05:13:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:41.346 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.346 05:13:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:41.346 05:13:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:41.346 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.346 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:41.346 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.346 05:13:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:41.346 05:13:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:28:41.346 05:13:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:41.346 05:13:20 -- host/auth.sh@44 -- # digest=sha256 00:28:41.346 05:13:20 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:41.346 05:13:20 -- host/auth.sh@44 -- # keyid=3 00:28:41.346 05:13:20 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:41.346 05:13:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:41.346 05:13:20 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:41.346 05:13:20 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:41.346 05:13:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:28:41.346 05:13:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:41.346 05:13:20 -- host/auth.sh@68 -- # digest=sha256 00:28:41.346 05:13:20 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:41.346 05:13:20 -- host/auth.sh@68 -- # keyid=3 00:28:41.346 05:13:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:41.346 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.346 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:41.346 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.346 05:13:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:41.346 05:13:20 -- nvmf/common.sh@717 -- # local ip 00:28:41.346 05:13:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:41.346 05:13:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:41.346 05:13:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:41.346 05:13:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:41.346 05:13:20 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:41.346 05:13:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:41.346 05:13:20 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:41.346 05:13:20 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:41.346 05:13:20 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:41.346 05:13:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:41.346 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.347 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:41.919 nvme0n1 00:28:41.919 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.919 05:13:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:41.919 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.919 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:41.919 05:13:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:41.919 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.919 05:13:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:41.919 05:13:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:41.919 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.919 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:41.919 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.919 05:13:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:41.919 05:13:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:28:41.919 05:13:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:41.919 05:13:20 -- host/auth.sh@44 -- # digest=sha256 00:28:41.919 05:13:20 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:41.919 05:13:20 -- host/auth.sh@44 -- # keyid=4 00:28:41.919 05:13:20 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:41.919 05:13:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:41.919 05:13:20 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:41.919 05:13:20 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:41.919 05:13:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:28:41.919 05:13:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:41.919 05:13:20 -- host/auth.sh@68 -- # digest=sha256 00:28:41.919 05:13:20 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:41.919 05:13:20 -- host/auth.sh@68 -- # keyid=4 00:28:41.919 05:13:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:41.919 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.919 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:41.919 05:13:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.919 05:13:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:41.919 05:13:20 -- nvmf/common.sh@717 -- # local ip 00:28:41.919 05:13:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:41.919 05:13:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:41.919 05:13:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:41.919 05:13:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:41.919 05:13:20 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:41.919 05:13:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:41.919 05:13:20 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:41.919 05:13:20 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:41.919 05:13:20 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:41.919 05:13:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:41.919 05:13:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.919 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:28:42.486 nvme0n1 00:28:42.486 05:13:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:42.486 05:13:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:42.486 05:13:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:42.486 05:13:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:42.486 05:13:21 -- common/autotest_common.sh@10 -- # set +x 00:28:42.486 05:13:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:42.486 05:13:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:42.486 05:13:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:42.486 05:13:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:42.486 05:13:21 -- common/autotest_common.sh@10 -- # set +x 00:28:42.486 05:13:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:42.486 05:13:21 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:42.486 05:13:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:42.486 05:13:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:28:42.486 05:13:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:42.486 05:13:21 -- host/auth.sh@44 -- # digest=sha256 00:28:42.486 05:13:21 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:42.486 05:13:21 -- host/auth.sh@44 -- # keyid=0 00:28:42.486 05:13:21 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:42.486 05:13:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:42.486 05:13:21 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:42.486 05:13:21 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:42.486 05:13:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:28:42.486 05:13:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:42.486 05:13:21 -- host/auth.sh@68 -- # digest=sha256 00:28:42.486 05:13:21 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:42.486 05:13:21 -- host/auth.sh@68 -- # keyid=0 00:28:42.486 05:13:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:42.486 05:13:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:42.486 05:13:21 -- common/autotest_common.sh@10 -- # set +x 00:28:42.486 05:13:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:42.486 05:13:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:42.486 05:13:21 -- nvmf/common.sh@717 -- # local ip 00:28:42.486 05:13:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:42.486 05:13:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:42.486 05:13:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:42.486 05:13:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:42.486 05:13:21 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:42.486 05:13:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:42.486 05:13:21 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:42.486 05:13:21 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:42.486 05:13:21 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:42.486 05:13:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:42.486 05:13:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:42.486 05:13:21 -- common/autotest_common.sh@10 -- # set +x 00:28:43.425 nvme0n1 00:28:43.425 05:13:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:43.425 05:13:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:43.425 05:13:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:43.425 05:13:22 -- common/autotest_common.sh@10 -- # set +x 00:28:43.425 05:13:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:43.425 05:13:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:43.426 05:13:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:43.426 05:13:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:43.426 05:13:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:43.426 05:13:22 -- common/autotest_common.sh@10 -- # set +x 00:28:43.426 05:13:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:43.426 05:13:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:43.426 05:13:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:28:43.426 05:13:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:43.426 05:13:22 -- host/auth.sh@44 -- # digest=sha256 00:28:43.426 05:13:22 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:43.426 05:13:22 -- host/auth.sh@44 -- # keyid=1 00:28:43.426 05:13:22 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:43.426 05:13:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:43.426 05:13:22 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:43.426 05:13:22 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:43.426 05:13:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:28:43.426 05:13:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:43.426 05:13:22 -- host/auth.sh@68 -- # digest=sha256 00:28:43.426 05:13:22 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:43.426 05:13:22 -- host/auth.sh@68 -- # keyid=1 00:28:43.426 05:13:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:43.426 05:13:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:43.426 05:13:22 -- common/autotest_common.sh@10 -- # set +x 00:28:43.426 05:13:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:43.426 05:13:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:43.426 05:13:22 -- nvmf/common.sh@717 -- # local ip 00:28:43.426 05:13:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:43.426 05:13:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:43.426 05:13:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:43.426 05:13:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:43.426 05:13:22 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:43.426 05:13:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:43.426 05:13:22 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:43.426 05:13:22 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:43.426 05:13:22 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:43.426 05:13:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:43.426 05:13:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:43.426 05:13:22 -- common/autotest_common.sh@10 -- # set +x 00:28:44.365 nvme0n1 00:28:44.365 05:13:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:44.365 05:13:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:44.365 05:13:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:44.365 05:13:23 -- common/autotest_common.sh@10 -- # set +x 00:28:44.365 05:13:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:44.365 05:13:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:44.365 05:13:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:44.365 05:13:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:44.365 05:13:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:44.365 05:13:23 -- common/autotest_common.sh@10 -- # set +x 00:28:44.365 05:13:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:44.365 05:13:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:44.365 05:13:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:28:44.365 05:13:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:44.365 05:13:23 -- host/auth.sh@44 -- # digest=sha256 00:28:44.365 05:13:23 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:44.365 05:13:23 -- host/auth.sh@44 -- # keyid=2 00:28:44.365 05:13:23 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:44.365 05:13:23 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:44.365 05:13:23 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:44.365 05:13:23 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:44.365 05:13:23 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:28:44.365 05:13:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:44.365 05:13:23 -- host/auth.sh@68 -- # digest=sha256 00:28:44.365 05:13:23 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:44.365 05:13:23 -- host/auth.sh@68 -- # keyid=2 00:28:44.365 05:13:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:44.365 05:13:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:44.365 05:13:23 -- common/autotest_common.sh@10 -- # set +x 00:28:44.365 05:13:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:44.365 05:13:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:44.365 05:13:23 -- nvmf/common.sh@717 -- # local ip 00:28:44.365 05:13:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:44.365 05:13:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:44.365 05:13:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:44.365 05:13:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:44.365 05:13:23 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:44.365 05:13:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:44.365 05:13:23 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:44.365 05:13:23 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:44.365 05:13:23 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:44.365 05:13:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:44.365 05:13:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:44.365 05:13:23 -- common/autotest_common.sh@10 -- # set +x 00:28:45.349 nvme0n1 00:28:45.349 05:13:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:45.349 05:13:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:45.349 05:13:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:45.349 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:28:45.349 05:13:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:45.349 05:13:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:45.349 05:13:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:45.349 05:13:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:45.349 05:13:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:45.349 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:28:45.349 05:13:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:45.349 05:13:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:45.349 05:13:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:28:45.349 05:13:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:45.349 05:13:24 -- host/auth.sh@44 -- # digest=sha256 00:28:45.349 05:13:24 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:45.349 05:13:24 -- host/auth.sh@44 -- # keyid=3 00:28:45.349 05:13:24 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:45.349 05:13:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:45.349 05:13:24 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:45.349 05:13:24 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:45.349 05:13:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:28:45.349 05:13:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:45.349 05:13:24 -- host/auth.sh@68 -- # digest=sha256 00:28:45.349 05:13:24 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:45.349 05:13:24 -- host/auth.sh@68 -- # keyid=3 00:28:45.349 05:13:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:45.349 05:13:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:45.349 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:28:45.349 05:13:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:45.349 05:13:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:45.349 05:13:24 -- nvmf/common.sh@717 -- # local ip 00:28:45.349 05:13:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:45.349 05:13:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:45.349 05:13:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:45.349 05:13:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:45.349 05:13:24 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:45.349 05:13:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:45.349 05:13:24 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:45.349 05:13:24 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:45.349 05:13:24 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:45.349 05:13:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:45.349 05:13:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:45.349 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:28:46.287 nvme0n1 00:28:46.287 05:13:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.287 05:13:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:46.287 05:13:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:46.287 05:13:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.287 05:13:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.287 05:13:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.287 05:13:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:46.287 05:13:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:46.287 05:13:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.287 05:13:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.287 05:13:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.287 05:13:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:46.287 05:13:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:28:46.287 05:13:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:46.287 05:13:25 -- host/auth.sh@44 -- # digest=sha256 00:28:46.287 05:13:25 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:46.287 05:13:25 -- host/auth.sh@44 -- # keyid=4 00:28:46.287 05:13:25 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:46.287 05:13:25 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:46.287 05:13:25 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:46.287 05:13:25 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:46.287 05:13:25 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:28:46.287 05:13:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:46.287 05:13:25 -- host/auth.sh@68 -- # digest=sha256 00:28:46.287 05:13:25 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:46.287 05:13:25 -- host/auth.sh@68 -- # keyid=4 00:28:46.287 05:13:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:46.287 05:13:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.287 05:13:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.287 05:13:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.287 05:13:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:46.287 05:13:25 -- nvmf/common.sh@717 -- # local ip 00:28:46.287 05:13:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:46.287 05:13:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:46.287 05:13:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:46.287 05:13:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:46.287 05:13:25 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:46.287 05:13:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:46.287 05:13:25 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:46.287 05:13:25 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:46.287 05:13:25 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:46.287 05:13:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:46.287 05:13:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.287 05:13:25 -- common/autotest_common.sh@10 -- # set +x 00:28:47.226 nvme0n1 00:28:47.226 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.226 05:13:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.226 05:13:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.226 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.226 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.226 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.226 05:13:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.226 05:13:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:47.226 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.226 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.226 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.226 05:13:26 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:28:47.226 05:13:26 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:47.226 05:13:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:47.226 05:13:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:28:47.226 05:13:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:47.226 05:13:26 -- host/auth.sh@44 -- # digest=sha384 00:28:47.226 05:13:26 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:47.226 05:13:26 -- host/auth.sh@44 -- # keyid=0 00:28:47.226 05:13:26 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:47.226 05:13:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:47.226 05:13:26 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:47.226 05:13:26 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:47.226 05:13:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:28:47.226 05:13:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:47.226 05:13:26 -- host/auth.sh@68 -- # digest=sha384 00:28:47.226 05:13:26 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:47.226 05:13:26 -- host/auth.sh@68 -- # keyid=0 00:28:47.226 05:13:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:28:47.226 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.226 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.226 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.226 05:13:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:47.226 05:13:26 -- nvmf/common.sh@717 -- # local ip 00:28:47.226 05:13:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:47.226 05:13:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:47.226 05:13:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:47.226 05:13:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:47.226 05:13:26 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:47.226 05:13:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:47.226 05:13:26 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:47.226 05:13:26 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:47.226 05:13:26 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:47.226 05:13:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:47.226 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.226 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.486 nvme0n1 00:28:47.486 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.486 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.486 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.486 05:13:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.486 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:47.486 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.486 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.486 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:47.486 05:13:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:28:47.486 05:13:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:47.486 05:13:26 -- host/auth.sh@44 -- # digest=sha384 00:28:47.486 05:13:26 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:47.486 05:13:26 -- host/auth.sh@44 -- # keyid=1 00:28:47.486 05:13:26 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:47.486 05:13:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:47.486 05:13:26 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:47.486 05:13:26 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:47.486 05:13:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:28:47.486 05:13:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:47.486 05:13:26 -- host/auth.sh@68 -- # digest=sha384 00:28:47.486 05:13:26 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:47.486 05:13:26 -- host/auth.sh@68 -- # keyid=1 00:28:47.486 05:13:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:28:47.486 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.486 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.486 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:47.486 05:13:26 -- nvmf/common.sh@717 -- # local ip 00:28:47.486 05:13:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:47.486 05:13:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:47.486 05:13:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:47.486 05:13:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:47.486 05:13:26 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:47.486 05:13:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:47.486 05:13:26 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:47.486 05:13:26 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:47.486 05:13:26 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:47.486 05:13:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:47.486 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.486 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.486 nvme0n1 00:28:47.486 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.486 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.486 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.486 05:13:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.486 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.486 05:13:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:47.486 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.486 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.746 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.746 05:13:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:47.746 05:13:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:28:47.746 05:13:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:47.746 05:13:26 -- host/auth.sh@44 -- # digest=sha384 00:28:47.746 05:13:26 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:47.746 05:13:26 -- host/auth.sh@44 -- # keyid=2 00:28:47.746 05:13:26 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:47.746 05:13:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:47.746 05:13:26 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:47.746 05:13:26 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:47.746 05:13:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:28:47.746 05:13:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:47.746 05:13:26 -- host/auth.sh@68 -- # digest=sha384 00:28:47.746 05:13:26 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:47.746 05:13:26 -- host/auth.sh@68 -- # keyid=2 00:28:47.746 05:13:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:28:47.746 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.746 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.746 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.746 05:13:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:47.746 05:13:26 -- nvmf/common.sh@717 -- # local ip 00:28:47.746 05:13:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:47.746 05:13:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:47.746 05:13:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:47.746 05:13:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:47.746 05:13:26 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:47.746 05:13:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:47.746 05:13:26 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:47.746 05:13:26 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:47.746 05:13:26 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:47.746 05:13:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:47.746 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.746 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.746 nvme0n1 00:28:47.746 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.746 05:13:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.746 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.746 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.746 05:13:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.746 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.746 05:13:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.746 05:13:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:47.746 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.746 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.746 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.746 05:13:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:47.746 05:13:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:28:47.746 05:13:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:47.746 05:13:26 -- host/auth.sh@44 -- # digest=sha384 00:28:47.746 05:13:26 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:47.746 05:13:26 -- host/auth.sh@44 -- # keyid=3 00:28:47.746 05:13:26 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:47.746 05:13:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:47.746 05:13:26 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:47.746 05:13:26 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:47.746 05:13:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:28:47.746 05:13:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:47.746 05:13:26 -- host/auth.sh@68 -- # digest=sha384 00:28:47.746 05:13:26 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:47.746 05:13:26 -- host/auth.sh@68 -- # keyid=3 00:28:47.746 05:13:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:28:47.746 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.746 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:47.746 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.746 05:13:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:47.746 05:13:26 -- nvmf/common.sh@717 -- # local ip 00:28:47.746 05:13:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:47.746 05:13:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:47.746 05:13:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:47.746 05:13:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:47.746 05:13:26 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:47.746 05:13:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:47.746 05:13:26 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:47.746 05:13:26 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:47.746 05:13:26 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:47.746 05:13:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:47.746 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.746 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:48.005 nvme0n1 00:28:48.005 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.005 05:13:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.005 05:13:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.005 05:13:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.005 05:13:26 -- common/autotest_common.sh@10 -- # set +x 00:28:48.005 05:13:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.005 05:13:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.005 05:13:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.005 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.005 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.005 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.005 05:13:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.005 05:13:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:28:48.005 05:13:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.005 05:13:27 -- host/auth.sh@44 -- # digest=sha384 00:28:48.005 05:13:27 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:48.005 05:13:27 -- host/auth.sh@44 -- # keyid=4 00:28:48.005 05:13:27 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:48.005 05:13:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:48.005 05:13:27 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:48.005 05:13:27 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:48.005 05:13:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:28:48.005 05:13:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.005 05:13:27 -- host/auth.sh@68 -- # digest=sha384 00:28:48.005 05:13:27 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:48.005 05:13:27 -- host/auth.sh@68 -- # keyid=4 00:28:48.005 05:13:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:28:48.005 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.005 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.005 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.005 05:13:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.005 05:13:27 -- nvmf/common.sh@717 -- # local ip 00:28:48.005 05:13:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.005 05:13:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.005 05:13:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.005 05:13:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.005 05:13:27 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:48.005 05:13:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:48.005 05:13:27 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:48.005 05:13:27 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:48.005 05:13:27 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:48.005 05:13:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:48.005 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.005 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.005 nvme0n1 00:28:48.005 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.005 05:13:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.005 05:13:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.005 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.005 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.005 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.263 05:13:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.263 05:13:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.263 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.263 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.263 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.263 05:13:27 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:48.263 05:13:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.263 05:13:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:28:48.263 05:13:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.263 05:13:27 -- host/auth.sh@44 -- # digest=sha384 00:28:48.263 05:13:27 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:48.263 05:13:27 -- host/auth.sh@44 -- # keyid=0 00:28:48.263 05:13:27 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:48.263 05:13:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:48.263 05:13:27 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:48.263 05:13:27 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:48.263 05:13:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:28:48.263 05:13:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.263 05:13:27 -- host/auth.sh@68 -- # digest=sha384 00:28:48.263 05:13:27 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:48.263 05:13:27 -- host/auth.sh@68 -- # keyid=0 00:28:48.263 05:13:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:28:48.263 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.263 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.263 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.263 05:13:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.263 05:13:27 -- nvmf/common.sh@717 -- # local ip 00:28:48.263 05:13:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.263 05:13:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.263 05:13:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.263 05:13:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.263 05:13:27 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:48.263 05:13:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:48.263 05:13:27 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:48.263 05:13:27 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:48.263 05:13:27 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:48.263 05:13:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:48.263 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.263 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.263 nvme0n1 00:28:48.264 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.264 05:13:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.264 05:13:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.264 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.264 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.264 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.264 05:13:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.264 05:13:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.264 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.264 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.264 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.264 05:13:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.264 05:13:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:28:48.264 05:13:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.264 05:13:27 -- host/auth.sh@44 -- # digest=sha384 00:28:48.264 05:13:27 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:48.264 05:13:27 -- host/auth.sh@44 -- # keyid=1 00:28:48.264 05:13:27 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:48.264 05:13:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:48.264 05:13:27 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:48.264 05:13:27 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:48.264 05:13:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:28:48.264 05:13:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.264 05:13:27 -- host/auth.sh@68 -- # digest=sha384 00:28:48.264 05:13:27 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:48.264 05:13:27 -- host/auth.sh@68 -- # keyid=1 00:28:48.264 05:13:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:28:48.264 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.264 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.522 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.522 05:13:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.522 05:13:27 -- nvmf/common.sh@717 -- # local ip 00:28:48.522 05:13:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.522 05:13:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.522 05:13:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.522 05:13:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.522 05:13:27 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:48.522 05:13:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:48.522 05:13:27 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:48.522 05:13:27 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:48.522 05:13:27 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:48.522 05:13:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:48.522 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.522 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.522 nvme0n1 00:28:48.522 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.522 05:13:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.522 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.522 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.522 05:13:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.522 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.522 05:13:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.522 05:13:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.522 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.522 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.522 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.522 05:13:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.522 05:13:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:28:48.522 05:13:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.522 05:13:27 -- host/auth.sh@44 -- # digest=sha384 00:28:48.522 05:13:27 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:48.522 05:13:27 -- host/auth.sh@44 -- # keyid=2 00:28:48.522 05:13:27 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:48.522 05:13:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:48.522 05:13:27 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:48.522 05:13:27 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:48.522 05:13:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:28:48.522 05:13:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.522 05:13:27 -- host/auth.sh@68 -- # digest=sha384 00:28:48.522 05:13:27 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:48.522 05:13:27 -- host/auth.sh@68 -- # keyid=2 00:28:48.522 05:13:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:28:48.522 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.522 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.522 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.522 05:13:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.522 05:13:27 -- nvmf/common.sh@717 -- # local ip 00:28:48.522 05:13:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.522 05:13:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.522 05:13:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.522 05:13:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.522 05:13:27 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:48.522 05:13:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:48.522 05:13:27 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:48.522 05:13:27 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:48.522 05:13:27 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:48.522 05:13:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:48.522 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.522 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.782 nvme0n1 00:28:48.782 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.782 05:13:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.782 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.782 05:13:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.782 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.782 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.782 05:13:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.782 05:13:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.782 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.782 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.782 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.782 05:13:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.782 05:13:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:28:48.782 05:13:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.782 05:13:27 -- host/auth.sh@44 -- # digest=sha384 00:28:48.782 05:13:27 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:48.782 05:13:27 -- host/auth.sh@44 -- # keyid=3 00:28:48.782 05:13:27 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:48.782 05:13:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:48.782 05:13:27 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:48.782 05:13:27 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:48.782 05:13:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:28:48.782 05:13:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.782 05:13:27 -- host/auth.sh@68 -- # digest=sha384 00:28:48.782 05:13:27 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:48.782 05:13:27 -- host/auth.sh@68 -- # keyid=3 00:28:48.782 05:13:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:28:48.782 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.782 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.782 05:13:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.782 05:13:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.782 05:13:27 -- nvmf/common.sh@717 -- # local ip 00:28:48.782 05:13:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.782 05:13:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.782 05:13:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.782 05:13:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.782 05:13:27 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:48.782 05:13:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:48.782 05:13:27 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:48.782 05:13:27 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:48.782 05:13:27 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:48.782 05:13:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:48.782 05:13:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.782 05:13:27 -- common/autotest_common.sh@10 -- # set +x 00:28:49.042 nvme0n1 00:28:49.042 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.042 05:13:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:49.042 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.042 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.043 05:13:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:49.043 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.043 05:13:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:49.043 05:13:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:49.043 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.043 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.043 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.043 05:13:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:49.043 05:13:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:28:49.043 05:13:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:49.043 05:13:28 -- host/auth.sh@44 -- # digest=sha384 00:28:49.043 05:13:28 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:49.043 05:13:28 -- host/auth.sh@44 -- # keyid=4 00:28:49.043 05:13:28 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:49.043 05:13:28 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:49.043 05:13:28 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:49.043 05:13:28 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:49.043 05:13:28 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:28:49.043 05:13:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:49.043 05:13:28 -- host/auth.sh@68 -- # digest=sha384 00:28:49.043 05:13:28 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:49.043 05:13:28 -- host/auth.sh@68 -- # keyid=4 00:28:49.043 05:13:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:28:49.043 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.043 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.043 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.043 05:13:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:49.043 05:13:28 -- nvmf/common.sh@717 -- # local ip 00:28:49.043 05:13:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:49.043 05:13:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:49.043 05:13:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:49.043 05:13:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:49.043 05:13:28 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:49.043 05:13:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:49.043 05:13:28 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:49.043 05:13:28 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:49.043 05:13:28 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:49.043 05:13:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:49.043 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.043 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.303 nvme0n1 00:28:49.303 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.303 05:13:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:49.303 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.303 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.303 05:13:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:49.303 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.303 05:13:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:49.303 05:13:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:49.303 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.303 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.303 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.303 05:13:28 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:49.303 05:13:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:49.303 05:13:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:28:49.303 05:13:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:49.303 05:13:28 -- host/auth.sh@44 -- # digest=sha384 00:28:49.303 05:13:28 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:49.303 05:13:28 -- host/auth.sh@44 -- # keyid=0 00:28:49.303 05:13:28 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:49.303 05:13:28 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:49.303 05:13:28 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:49.303 05:13:28 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:49.303 05:13:28 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:28:49.303 05:13:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:49.303 05:13:28 -- host/auth.sh@68 -- # digest=sha384 00:28:49.303 05:13:28 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:49.303 05:13:28 -- host/auth.sh@68 -- # keyid=0 00:28:49.303 05:13:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:28:49.303 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.303 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.303 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.303 05:13:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:49.303 05:13:28 -- nvmf/common.sh@717 -- # local ip 00:28:49.303 05:13:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:49.303 05:13:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:49.303 05:13:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:49.303 05:13:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:49.303 05:13:28 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:49.303 05:13:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:49.303 05:13:28 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:49.303 05:13:28 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:49.303 05:13:28 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:49.303 05:13:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:49.303 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.303 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.563 nvme0n1 00:28:49.563 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.563 05:13:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:49.563 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.563 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.563 05:13:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:49.563 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.563 05:13:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:49.563 05:13:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:49.563 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.563 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.563 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.563 05:13:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:49.563 05:13:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:28:49.563 05:13:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:49.563 05:13:28 -- host/auth.sh@44 -- # digest=sha384 00:28:49.563 05:13:28 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:49.563 05:13:28 -- host/auth.sh@44 -- # keyid=1 00:28:49.563 05:13:28 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:49.563 05:13:28 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:49.563 05:13:28 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:49.563 05:13:28 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:49.563 05:13:28 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:28:49.563 05:13:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:49.563 05:13:28 -- host/auth.sh@68 -- # digest=sha384 00:28:49.563 05:13:28 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:49.563 05:13:28 -- host/auth.sh@68 -- # keyid=1 00:28:49.564 05:13:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:28:49.564 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.564 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.564 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.564 05:13:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:49.564 05:13:28 -- nvmf/common.sh@717 -- # local ip 00:28:49.564 05:13:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:49.564 05:13:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:49.564 05:13:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:49.564 05:13:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:49.564 05:13:28 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:49.564 05:13:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:49.564 05:13:28 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:49.564 05:13:28 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:49.564 05:13:28 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:49.564 05:13:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:49.564 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.564 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.822 nvme0n1 00:28:49.822 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.822 05:13:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:49.822 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.822 05:13:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:49.822 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.822 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.822 05:13:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:49.822 05:13:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:49.822 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.822 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.822 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.822 05:13:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:49.822 05:13:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:28:49.822 05:13:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:49.822 05:13:28 -- host/auth.sh@44 -- # digest=sha384 00:28:49.822 05:13:28 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:49.822 05:13:28 -- host/auth.sh@44 -- # keyid=2 00:28:49.823 05:13:28 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:49.823 05:13:28 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:49.823 05:13:28 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:49.823 05:13:28 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:49.823 05:13:28 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:28:49.823 05:13:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:49.823 05:13:28 -- host/auth.sh@68 -- # digest=sha384 00:28:49.823 05:13:28 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:49.823 05:13:28 -- host/auth.sh@68 -- # keyid=2 00:28:49.823 05:13:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:28:49.823 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.823 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.823 05:13:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.823 05:13:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:49.823 05:13:28 -- nvmf/common.sh@717 -- # local ip 00:28:49.823 05:13:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:49.823 05:13:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:49.823 05:13:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:49.823 05:13:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:49.823 05:13:28 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:49.823 05:13:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:49.823 05:13:28 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:49.823 05:13:28 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:49.823 05:13:28 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:49.823 05:13:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:49.823 05:13:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.823 05:13:28 -- common/autotest_common.sh@10 -- # set +x 00:28:50.081 nvme0n1 00:28:50.081 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.081 05:13:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:50.081 05:13:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:50.081 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.081 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.081 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.339 05:13:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:50.339 05:13:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:50.339 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.339 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.339 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.339 05:13:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:50.339 05:13:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:28:50.339 05:13:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:50.339 05:13:29 -- host/auth.sh@44 -- # digest=sha384 00:28:50.339 05:13:29 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:50.339 05:13:29 -- host/auth.sh@44 -- # keyid=3 00:28:50.339 05:13:29 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:50.339 05:13:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:50.339 05:13:29 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:50.339 05:13:29 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:50.339 05:13:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:28:50.339 05:13:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:50.339 05:13:29 -- host/auth.sh@68 -- # digest=sha384 00:28:50.339 05:13:29 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:50.339 05:13:29 -- host/auth.sh@68 -- # keyid=3 00:28:50.339 05:13:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:28:50.339 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.339 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.339 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.339 05:13:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:50.339 05:13:29 -- nvmf/common.sh@717 -- # local ip 00:28:50.339 05:13:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:50.339 05:13:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:50.339 05:13:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:50.339 05:13:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:50.339 05:13:29 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:50.339 05:13:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:50.339 05:13:29 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:50.339 05:13:29 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:50.339 05:13:29 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:50.339 05:13:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:50.339 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.339 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.597 nvme0n1 00:28:50.597 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.597 05:13:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:50.597 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.597 05:13:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:50.597 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.597 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.597 05:13:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:50.597 05:13:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:50.597 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.597 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.597 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.597 05:13:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:50.597 05:13:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:28:50.597 05:13:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:50.597 05:13:29 -- host/auth.sh@44 -- # digest=sha384 00:28:50.597 05:13:29 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:50.597 05:13:29 -- host/auth.sh@44 -- # keyid=4 00:28:50.597 05:13:29 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:50.597 05:13:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:50.597 05:13:29 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:50.597 05:13:29 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:50.597 05:13:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:28:50.597 05:13:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:50.597 05:13:29 -- host/auth.sh@68 -- # digest=sha384 00:28:50.597 05:13:29 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:50.597 05:13:29 -- host/auth.sh@68 -- # keyid=4 00:28:50.597 05:13:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:28:50.597 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.598 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.598 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.598 05:13:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:50.598 05:13:29 -- nvmf/common.sh@717 -- # local ip 00:28:50.598 05:13:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:50.598 05:13:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:50.598 05:13:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:50.598 05:13:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:50.598 05:13:29 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:50.598 05:13:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:50.598 05:13:29 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:50.598 05:13:29 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:50.598 05:13:29 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:50.598 05:13:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:50.598 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.598 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.858 nvme0n1 00:28:50.858 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.858 05:13:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:50.858 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.858 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.858 05:13:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:50.858 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.858 05:13:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:50.858 05:13:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:50.858 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.858 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.858 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.858 05:13:29 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:50.858 05:13:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:50.858 05:13:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:28:50.858 05:13:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:50.858 05:13:29 -- host/auth.sh@44 -- # digest=sha384 00:28:50.858 05:13:29 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:50.858 05:13:29 -- host/auth.sh@44 -- # keyid=0 00:28:50.858 05:13:29 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:50.858 05:13:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:50.858 05:13:29 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:50.858 05:13:29 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:50.858 05:13:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:28:50.858 05:13:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:50.858 05:13:29 -- host/auth.sh@68 -- # digest=sha384 00:28:50.858 05:13:29 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:50.858 05:13:29 -- host/auth.sh@68 -- # keyid=0 00:28:50.858 05:13:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:28:50.858 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.858 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.858 05:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.858 05:13:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:50.858 05:13:29 -- nvmf/common.sh@717 -- # local ip 00:28:50.858 05:13:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:50.858 05:13:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:50.858 05:13:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:50.858 05:13:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:50.858 05:13:29 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:50.858 05:13:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:50.858 05:13:29 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:50.858 05:13:29 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:50.858 05:13:29 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:50.858 05:13:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:50.858 05:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.858 05:13:29 -- common/autotest_common.sh@10 -- # set +x 00:28:51.428 nvme0n1 00:28:51.428 05:13:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.428 05:13:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:51.428 05:13:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.428 05:13:30 -- common/autotest_common.sh@10 -- # set +x 00:28:51.428 05:13:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:51.428 05:13:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.428 05:13:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:51.428 05:13:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:51.428 05:13:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.428 05:13:30 -- common/autotest_common.sh@10 -- # set +x 00:28:51.428 05:13:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.428 05:13:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:51.428 05:13:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:28:51.428 05:13:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:51.428 05:13:30 -- host/auth.sh@44 -- # digest=sha384 00:28:51.428 05:13:30 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:51.428 05:13:30 -- host/auth.sh@44 -- # keyid=1 00:28:51.428 05:13:30 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:51.428 05:13:30 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:51.428 05:13:30 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:51.428 05:13:30 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:51.428 05:13:30 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:28:51.428 05:13:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:51.428 05:13:30 -- host/auth.sh@68 -- # digest=sha384 00:28:51.428 05:13:30 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:51.428 05:13:30 -- host/auth.sh@68 -- # keyid=1 00:28:51.428 05:13:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:28:51.428 05:13:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.428 05:13:30 -- common/autotest_common.sh@10 -- # set +x 00:28:51.428 05:13:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.428 05:13:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:51.428 05:13:30 -- nvmf/common.sh@717 -- # local ip 00:28:51.428 05:13:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:51.428 05:13:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:51.428 05:13:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:51.428 05:13:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:51.428 05:13:30 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:51.428 05:13:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:51.428 05:13:30 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:51.428 05:13:30 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:51.428 05:13:30 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:51.428 05:13:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:51.428 05:13:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.428 05:13:30 -- common/autotest_common.sh@10 -- # set +x 00:28:51.996 nvme0n1 00:28:51.996 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.996 05:13:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:51.996 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.996 05:13:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:51.996 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:51.996 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.996 05:13:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:51.996 05:13:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:51.996 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.996 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:51.996 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.996 05:13:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:51.996 05:13:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:28:51.996 05:13:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:51.996 05:13:31 -- host/auth.sh@44 -- # digest=sha384 00:28:51.996 05:13:31 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:51.996 05:13:31 -- host/auth.sh@44 -- # keyid=2 00:28:51.996 05:13:31 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:51.996 05:13:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:51.996 05:13:31 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:51.996 05:13:31 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:51.996 05:13:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:28:51.996 05:13:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:51.996 05:13:31 -- host/auth.sh@68 -- # digest=sha384 00:28:51.996 05:13:31 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:51.996 05:13:31 -- host/auth.sh@68 -- # keyid=2 00:28:51.996 05:13:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:28:51.996 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.996 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:51.996 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:51.996 05:13:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:51.996 05:13:31 -- nvmf/common.sh@717 -- # local ip 00:28:51.996 05:13:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:51.996 05:13:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:51.996 05:13:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:51.996 05:13:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:51.996 05:13:31 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:51.996 05:13:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:51.996 05:13:31 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:51.996 05:13:31 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:51.996 05:13:31 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:51.996 05:13:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:51.996 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:51.996 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:52.562 nvme0n1 00:28:52.562 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.562 05:13:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:52.562 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.562 05:13:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:52.562 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:52.562 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.562 05:13:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:52.562 05:13:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:52.562 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.562 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:52.562 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.562 05:13:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:52.562 05:13:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:28:52.562 05:13:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:52.562 05:13:31 -- host/auth.sh@44 -- # digest=sha384 00:28:52.562 05:13:31 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:52.562 05:13:31 -- host/auth.sh@44 -- # keyid=3 00:28:52.562 05:13:31 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:52.562 05:13:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:52.562 05:13:31 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:52.562 05:13:31 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:52.562 05:13:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:28:52.562 05:13:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:52.562 05:13:31 -- host/auth.sh@68 -- # digest=sha384 00:28:52.562 05:13:31 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:52.562 05:13:31 -- host/auth.sh@68 -- # keyid=3 00:28:52.562 05:13:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:28:52.562 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.562 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:52.562 05:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.562 05:13:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:52.562 05:13:31 -- nvmf/common.sh@717 -- # local ip 00:28:52.562 05:13:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:52.562 05:13:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:52.562 05:13:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:52.562 05:13:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:52.562 05:13:31 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:52.562 05:13:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:52.562 05:13:31 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:52.562 05:13:31 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:52.562 05:13:31 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:52.562 05:13:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:52.562 05:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.562 05:13:31 -- common/autotest_common.sh@10 -- # set +x 00:28:53.133 nvme0n1 00:28:53.133 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.133 05:13:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:53.133 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.133 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.133 05:13:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:53.133 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.133 05:13:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:53.133 05:13:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:53.133 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.133 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.133 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.133 05:13:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:53.133 05:13:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:28:53.133 05:13:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:53.133 05:13:32 -- host/auth.sh@44 -- # digest=sha384 00:28:53.133 05:13:32 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:53.133 05:13:32 -- host/auth.sh@44 -- # keyid=4 00:28:53.133 05:13:32 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:53.133 05:13:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:53.133 05:13:32 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:53.133 05:13:32 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:53.133 05:13:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:28:53.133 05:13:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:53.133 05:13:32 -- host/auth.sh@68 -- # digest=sha384 00:28:53.133 05:13:32 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:53.133 05:13:32 -- host/auth.sh@68 -- # keyid=4 00:28:53.133 05:13:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:28:53.133 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.133 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.133 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.133 05:13:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:53.133 05:13:32 -- nvmf/common.sh@717 -- # local ip 00:28:53.133 05:13:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:53.133 05:13:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:53.133 05:13:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:53.133 05:13:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:53.133 05:13:32 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:53.133 05:13:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:53.133 05:13:32 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:53.133 05:13:32 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:53.133 05:13:32 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:53.133 05:13:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:53.133 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.133 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.702 nvme0n1 00:28:53.702 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.702 05:13:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:53.702 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.702 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.702 05:13:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:53.702 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.702 05:13:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:53.702 05:13:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:53.702 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.702 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.702 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.702 05:13:32 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:53.702 05:13:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:53.702 05:13:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:28:53.702 05:13:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:53.702 05:13:32 -- host/auth.sh@44 -- # digest=sha384 00:28:53.702 05:13:32 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:53.702 05:13:32 -- host/auth.sh@44 -- # keyid=0 00:28:53.702 05:13:32 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:53.702 05:13:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:53.702 05:13:32 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:53.702 05:13:32 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:53.702 05:13:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:28:53.702 05:13:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:53.702 05:13:32 -- host/auth.sh@68 -- # digest=sha384 00:28:53.702 05:13:32 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:53.702 05:13:32 -- host/auth.sh@68 -- # keyid=0 00:28:53.702 05:13:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:28:53.702 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.702 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.702 05:13:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.702 05:13:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:53.702 05:13:32 -- nvmf/common.sh@717 -- # local ip 00:28:53.702 05:13:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:53.703 05:13:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:53.703 05:13:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:53.703 05:13:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:53.703 05:13:32 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:53.703 05:13:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:53.703 05:13:32 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:53.703 05:13:32 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:53.703 05:13:32 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:53.703 05:13:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:53.703 05:13:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.703 05:13:32 -- common/autotest_common.sh@10 -- # set +x 00:28:54.637 nvme0n1 00:28:54.638 05:13:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.638 05:13:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:54.638 05:13:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:54.638 05:13:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.638 05:13:33 -- common/autotest_common.sh@10 -- # set +x 00:28:54.638 05:13:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.638 05:13:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:54.638 05:13:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:54.638 05:13:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.638 05:13:33 -- common/autotest_common.sh@10 -- # set +x 00:28:54.638 05:13:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.638 05:13:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:54.638 05:13:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:28:54.638 05:13:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:54.638 05:13:33 -- host/auth.sh@44 -- # digest=sha384 00:28:54.638 05:13:33 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:54.638 05:13:33 -- host/auth.sh@44 -- # keyid=1 00:28:54.638 05:13:33 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:54.638 05:13:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:54.638 05:13:33 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:54.638 05:13:33 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:54.638 05:13:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:28:54.638 05:13:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:54.638 05:13:33 -- host/auth.sh@68 -- # digest=sha384 00:28:54.638 05:13:33 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:54.638 05:13:33 -- host/auth.sh@68 -- # keyid=1 00:28:54.638 05:13:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:28:54.638 05:13:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.638 05:13:33 -- common/autotest_common.sh@10 -- # set +x 00:28:54.638 05:13:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.638 05:13:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:54.638 05:13:33 -- nvmf/common.sh@717 -- # local ip 00:28:54.638 05:13:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:54.638 05:13:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:54.638 05:13:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:54.638 05:13:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:54.638 05:13:33 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:54.638 05:13:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:54.638 05:13:33 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:54.638 05:13:33 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:54.638 05:13:33 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:54.638 05:13:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:54.638 05:13:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.638 05:13:33 -- common/autotest_common.sh@10 -- # set +x 00:28:55.574 nvme0n1 00:28:55.574 05:13:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:55.574 05:13:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:55.574 05:13:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:55.574 05:13:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:55.574 05:13:34 -- common/autotest_common.sh@10 -- # set +x 00:28:55.574 05:13:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:55.833 05:13:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:55.833 05:13:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:55.833 05:13:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:55.833 05:13:34 -- common/autotest_common.sh@10 -- # set +x 00:28:55.833 05:13:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:55.833 05:13:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:55.833 05:13:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:28:55.833 05:13:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:55.833 05:13:34 -- host/auth.sh@44 -- # digest=sha384 00:28:55.833 05:13:34 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:55.833 05:13:34 -- host/auth.sh@44 -- # keyid=2 00:28:55.834 05:13:34 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:55.834 05:13:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:55.834 05:13:34 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:55.834 05:13:34 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:55.834 05:13:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:28:55.834 05:13:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:55.834 05:13:34 -- host/auth.sh@68 -- # digest=sha384 00:28:55.834 05:13:34 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:55.834 05:13:34 -- host/auth.sh@68 -- # keyid=2 00:28:55.834 05:13:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:28:55.834 05:13:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:55.834 05:13:34 -- common/autotest_common.sh@10 -- # set +x 00:28:55.834 05:13:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:55.834 05:13:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:55.834 05:13:34 -- nvmf/common.sh@717 -- # local ip 00:28:55.834 05:13:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:55.834 05:13:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:55.834 05:13:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:55.834 05:13:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:55.834 05:13:34 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:55.834 05:13:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:55.834 05:13:34 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:55.834 05:13:34 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:55.834 05:13:34 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:55.834 05:13:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:55.834 05:13:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:55.834 05:13:34 -- common/autotest_common.sh@10 -- # set +x 00:28:56.772 nvme0n1 00:28:56.772 05:13:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:56.772 05:13:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:56.772 05:13:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:56.772 05:13:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:56.772 05:13:35 -- common/autotest_common.sh@10 -- # set +x 00:28:56.773 05:13:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:56.773 05:13:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:56.773 05:13:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:56.773 05:13:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:56.773 05:13:35 -- common/autotest_common.sh@10 -- # set +x 00:28:56.773 05:13:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:56.773 05:13:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:56.773 05:13:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:28:56.773 05:13:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:56.773 05:13:35 -- host/auth.sh@44 -- # digest=sha384 00:28:56.773 05:13:35 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:56.773 05:13:35 -- host/auth.sh@44 -- # keyid=3 00:28:56.773 05:13:35 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:56.773 05:13:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:56.773 05:13:35 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:56.773 05:13:35 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:56.773 05:13:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:28:56.773 05:13:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:56.773 05:13:35 -- host/auth.sh@68 -- # digest=sha384 00:28:56.773 05:13:35 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:56.773 05:13:35 -- host/auth.sh@68 -- # keyid=3 00:28:56.773 05:13:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:28:56.773 05:13:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:56.773 05:13:35 -- common/autotest_common.sh@10 -- # set +x 00:28:56.773 05:13:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:56.773 05:13:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:56.773 05:13:35 -- nvmf/common.sh@717 -- # local ip 00:28:56.773 05:13:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:56.773 05:13:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:56.773 05:13:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:56.773 05:13:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:56.773 05:13:35 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:56.773 05:13:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:56.773 05:13:35 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:56.773 05:13:35 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:56.773 05:13:35 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:56.773 05:13:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:56.773 05:13:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:56.773 05:13:35 -- common/autotest_common.sh@10 -- # set +x 00:28:57.710 nvme0n1 00:28:57.710 05:13:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.710 05:13:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:57.710 05:13:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.710 05:13:36 -- common/autotest_common.sh@10 -- # set +x 00:28:57.710 05:13:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:57.710 05:13:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.710 05:13:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:57.710 05:13:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:57.710 05:13:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.710 05:13:36 -- common/autotest_common.sh@10 -- # set +x 00:28:57.710 05:13:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.710 05:13:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:57.710 05:13:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:28:57.710 05:13:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:57.710 05:13:36 -- host/auth.sh@44 -- # digest=sha384 00:28:57.710 05:13:36 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:57.710 05:13:36 -- host/auth.sh@44 -- # keyid=4 00:28:57.710 05:13:36 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:57.710 05:13:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:28:57.710 05:13:36 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:57.710 05:13:36 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:57.710 05:13:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:28:57.710 05:13:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:57.710 05:13:36 -- host/auth.sh@68 -- # digest=sha384 00:28:57.710 05:13:36 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:57.710 05:13:36 -- host/auth.sh@68 -- # keyid=4 00:28:57.710 05:13:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:28:57.710 05:13:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.710 05:13:36 -- common/autotest_common.sh@10 -- # set +x 00:28:57.711 05:13:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.711 05:13:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:57.711 05:13:36 -- nvmf/common.sh@717 -- # local ip 00:28:57.711 05:13:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:57.711 05:13:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:57.711 05:13:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:57.711 05:13:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:57.711 05:13:36 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:57.711 05:13:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:57.711 05:13:36 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:57.711 05:13:36 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:57.711 05:13:36 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:57.711 05:13:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:57.711 05:13:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.711 05:13:36 -- common/autotest_common.sh@10 -- # set +x 00:28:58.646 nvme0n1 00:28:58.646 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.646 05:13:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:58.646 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.646 05:13:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:58.646 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.646 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.646 05:13:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:58.646 05:13:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:58.646 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.646 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.646 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.646 05:13:37 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:28:58.646 05:13:37 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:58.646 05:13:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:58.646 05:13:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:28:58.646 05:13:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:58.646 05:13:37 -- host/auth.sh@44 -- # digest=sha512 00:28:58.646 05:13:37 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:58.646 05:13:37 -- host/auth.sh@44 -- # keyid=0 00:28:58.646 05:13:37 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:58.646 05:13:37 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:58.646 05:13:37 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:58.646 05:13:37 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:58.646 05:13:37 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:28:58.646 05:13:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:58.646 05:13:37 -- host/auth.sh@68 -- # digest=sha512 00:28:58.646 05:13:37 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:58.646 05:13:37 -- host/auth.sh@68 -- # keyid=0 00:28:58.646 05:13:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:28:58.646 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.646 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.646 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.646 05:13:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:58.646 05:13:37 -- nvmf/common.sh@717 -- # local ip 00:28:58.646 05:13:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:58.646 05:13:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:58.647 05:13:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:58.647 05:13:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:58.647 05:13:37 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:58.647 05:13:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:58.647 05:13:37 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:58.647 05:13:37 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:58.647 05:13:37 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:58.647 05:13:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:58.647 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.647 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.647 nvme0n1 00:28:58.647 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.647 05:13:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:58.647 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.647 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.647 05:13:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:58.647 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.907 05:13:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:58.907 05:13:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:58.907 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.907 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.907 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.907 05:13:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:58.907 05:13:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:28:58.907 05:13:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:58.907 05:13:37 -- host/auth.sh@44 -- # digest=sha512 00:28:58.907 05:13:37 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:58.907 05:13:37 -- host/auth.sh@44 -- # keyid=1 00:28:58.907 05:13:37 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:58.907 05:13:37 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:58.907 05:13:37 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:58.907 05:13:37 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:58.907 05:13:37 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:28:58.907 05:13:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:58.907 05:13:37 -- host/auth.sh@68 -- # digest=sha512 00:28:58.907 05:13:37 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:58.907 05:13:37 -- host/auth.sh@68 -- # keyid=1 00:28:58.907 05:13:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:28:58.907 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.907 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.907 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.907 05:13:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:58.907 05:13:37 -- nvmf/common.sh@717 -- # local ip 00:28:58.907 05:13:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:58.907 05:13:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:58.907 05:13:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:58.907 05:13:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:58.907 05:13:37 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:58.907 05:13:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:58.907 05:13:37 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:58.907 05:13:37 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:58.907 05:13:37 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:58.907 05:13:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:58.907 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.907 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.907 nvme0n1 00:28:58.907 05:13:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.907 05:13:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:58.907 05:13:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.907 05:13:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.907 05:13:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:58.907 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.907 05:13:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:58.907 05:13:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:58.907 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.907 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.907 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.907 05:13:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:58.907 05:13:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:28:58.907 05:13:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:58.907 05:13:38 -- host/auth.sh@44 -- # digest=sha512 00:28:58.907 05:13:38 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:58.907 05:13:38 -- host/auth.sh@44 -- # keyid=2 00:28:58.907 05:13:38 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:58.907 05:13:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:58.907 05:13:38 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:58.907 05:13:38 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:58.907 05:13:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:28:58.907 05:13:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:58.907 05:13:38 -- host/auth.sh@68 -- # digest=sha512 00:28:58.907 05:13:38 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:58.907 05:13:38 -- host/auth.sh@68 -- # keyid=2 00:28:58.907 05:13:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:28:58.907 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.907 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.907 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.907 05:13:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:58.907 05:13:38 -- nvmf/common.sh@717 -- # local ip 00:28:58.907 05:13:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:58.907 05:13:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:58.907 05:13:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:58.907 05:13:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:58.907 05:13:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:58.907 05:13:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:58.907 05:13:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:58.907 05:13:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:58.907 05:13:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:58.907 05:13:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:58.907 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.907 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.168 nvme0n1 00:28:59.168 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.168 05:13:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:59.168 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.168 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.168 05:13:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:59.168 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.168 05:13:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.168 05:13:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:59.168 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.168 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.168 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.168 05:13:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:59.168 05:13:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:28:59.168 05:13:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:59.168 05:13:38 -- host/auth.sh@44 -- # digest=sha512 00:28:59.168 05:13:38 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:59.168 05:13:38 -- host/auth.sh@44 -- # keyid=3 00:28:59.168 05:13:38 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:59.168 05:13:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:59.168 05:13:38 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:59.168 05:13:38 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:28:59.168 05:13:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:28:59.168 05:13:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:59.168 05:13:38 -- host/auth.sh@68 -- # digest=sha512 00:28:59.168 05:13:38 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:59.168 05:13:38 -- host/auth.sh@68 -- # keyid=3 00:28:59.168 05:13:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:28:59.168 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.168 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.168 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.168 05:13:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:59.168 05:13:38 -- nvmf/common.sh@717 -- # local ip 00:28:59.168 05:13:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:59.168 05:13:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:59.168 05:13:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:59.168 05:13:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:59.168 05:13:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:59.168 05:13:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:59.168 05:13:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:59.168 05:13:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:59.168 05:13:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:59.168 05:13:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:59.168 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.168 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.427 nvme0n1 00:28:59.428 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.428 05:13:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:59.428 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.428 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.428 05:13:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:59.428 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.428 05:13:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.428 05:13:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:59.428 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.428 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.428 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.428 05:13:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:59.428 05:13:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:28:59.428 05:13:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:59.428 05:13:38 -- host/auth.sh@44 -- # digest=sha512 00:28:59.428 05:13:38 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:59.428 05:13:38 -- host/auth.sh@44 -- # keyid=4 00:28:59.428 05:13:38 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:59.428 05:13:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:59.428 05:13:38 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:59.428 05:13:38 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:28:59.428 05:13:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:28:59.428 05:13:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:59.428 05:13:38 -- host/auth.sh@68 -- # digest=sha512 00:28:59.428 05:13:38 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:59.428 05:13:38 -- host/auth.sh@68 -- # keyid=4 00:28:59.428 05:13:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:28:59.428 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.428 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.428 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.428 05:13:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:59.428 05:13:38 -- nvmf/common.sh@717 -- # local ip 00:28:59.428 05:13:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:59.428 05:13:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:59.428 05:13:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:59.428 05:13:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:59.428 05:13:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:59.428 05:13:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:59.428 05:13:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:59.428 05:13:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:59.428 05:13:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:59.428 05:13:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:59.428 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.428 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.428 nvme0n1 00:28:59.428 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.428 05:13:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:59.428 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.428 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.428 05:13:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:59.428 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.714 05:13:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.714 05:13:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:59.714 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.714 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.714 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.714 05:13:38 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:59.714 05:13:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:59.714 05:13:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:28:59.714 05:13:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:59.714 05:13:38 -- host/auth.sh@44 -- # digest=sha512 00:28:59.714 05:13:38 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:59.714 05:13:38 -- host/auth.sh@44 -- # keyid=0 00:28:59.714 05:13:38 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:59.714 05:13:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:59.714 05:13:38 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:59.714 05:13:38 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:28:59.714 05:13:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:28:59.714 05:13:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:59.714 05:13:38 -- host/auth.sh@68 -- # digest=sha512 00:28:59.714 05:13:38 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:59.714 05:13:38 -- host/auth.sh@68 -- # keyid=0 00:28:59.714 05:13:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:28:59.714 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.714 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.714 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.714 05:13:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:59.714 05:13:38 -- nvmf/common.sh@717 -- # local ip 00:28:59.714 05:13:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:59.714 05:13:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:59.714 05:13:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:59.714 05:13:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:59.714 05:13:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:59.714 05:13:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:59.714 05:13:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:59.715 05:13:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:59.715 05:13:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:59.715 05:13:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:59.715 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.715 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.715 nvme0n1 00:28:59.715 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.715 05:13:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:59.715 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.715 05:13:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:59.715 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.715 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.715 05:13:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.715 05:13:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:59.715 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.715 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.715 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.715 05:13:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:59.715 05:13:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:28:59.715 05:13:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:59.715 05:13:38 -- host/auth.sh@44 -- # digest=sha512 00:28:59.715 05:13:38 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:59.715 05:13:38 -- host/auth.sh@44 -- # keyid=1 00:28:59.715 05:13:38 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:59.715 05:13:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:59.715 05:13:38 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:59.715 05:13:38 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:28:59.715 05:13:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:28:59.715 05:13:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:59.715 05:13:38 -- host/auth.sh@68 -- # digest=sha512 00:28:59.715 05:13:38 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:59.715 05:13:38 -- host/auth.sh@68 -- # keyid=1 00:28:59.715 05:13:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:28:59.715 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.715 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.715 05:13:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.715 05:13:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:59.715 05:13:38 -- nvmf/common.sh@717 -- # local ip 00:28:59.715 05:13:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:59.715 05:13:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:59.715 05:13:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:59.715 05:13:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:59.715 05:13:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:59.715 05:13:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:59.715 05:13:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:59.715 05:13:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:59.715 05:13:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:59.715 05:13:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:59.715 05:13:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.715 05:13:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.973 nvme0n1 00:28:59.973 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.973 05:13:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:59.973 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.973 05:13:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:59.973 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:28:59.973 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.973 05:13:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.973 05:13:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:59.973 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.973 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:28:59.973 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.973 05:13:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:59.973 05:13:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:28:59.973 05:13:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:59.973 05:13:39 -- host/auth.sh@44 -- # digest=sha512 00:28:59.973 05:13:39 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:59.973 05:13:39 -- host/auth.sh@44 -- # keyid=2 00:28:59.973 05:13:39 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:59.973 05:13:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:28:59.973 05:13:39 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:59.973 05:13:39 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:28:59.973 05:13:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:28:59.973 05:13:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:59.973 05:13:39 -- host/auth.sh@68 -- # digest=sha512 00:28:59.973 05:13:39 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:59.973 05:13:39 -- host/auth.sh@68 -- # keyid=2 00:28:59.973 05:13:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:28:59.973 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.973 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:28:59.973 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.973 05:13:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:59.973 05:13:39 -- nvmf/common.sh@717 -- # local ip 00:28:59.973 05:13:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:59.973 05:13:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:59.973 05:13:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:59.973 05:13:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:59.973 05:13:39 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:28:59.973 05:13:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:28:59.973 05:13:39 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:28:59.973 05:13:39 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:28:59.973 05:13:39 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:28:59.973 05:13:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:59.973 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.973 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.232 nvme0n1 00:29:00.232 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.232 05:13:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:00.232 05:13:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:00.232 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.232 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.232 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.232 05:13:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.232 05:13:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:00.232 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.232 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.232 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.232 05:13:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:00.232 05:13:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:29:00.232 05:13:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:00.232 05:13:39 -- host/auth.sh@44 -- # digest=sha512 00:29:00.232 05:13:39 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:00.232 05:13:39 -- host/auth.sh@44 -- # keyid=3 00:29:00.232 05:13:39 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:00.232 05:13:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:00.232 05:13:39 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:00.232 05:13:39 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:00.232 05:13:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:29:00.232 05:13:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:00.232 05:13:39 -- host/auth.sh@68 -- # digest=sha512 00:29:00.232 05:13:39 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:00.232 05:13:39 -- host/auth.sh@68 -- # keyid=3 00:29:00.232 05:13:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:29:00.232 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.232 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.232 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.232 05:13:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:00.232 05:13:39 -- nvmf/common.sh@717 -- # local ip 00:29:00.232 05:13:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:00.232 05:13:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:00.232 05:13:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:00.232 05:13:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:00.232 05:13:39 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:00.232 05:13:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:00.232 05:13:39 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:00.232 05:13:39 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:00.232 05:13:39 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:00.232 05:13:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:00.232 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.232 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.491 nvme0n1 00:29:00.491 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.491 05:13:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:00.491 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.491 05:13:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:00.491 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.491 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.491 05:13:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.491 05:13:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:00.491 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.491 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.491 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.491 05:13:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:00.491 05:13:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:29:00.491 05:13:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:00.491 05:13:39 -- host/auth.sh@44 -- # digest=sha512 00:29:00.491 05:13:39 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:00.491 05:13:39 -- host/auth.sh@44 -- # keyid=4 00:29:00.491 05:13:39 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:00.491 05:13:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:00.491 05:13:39 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:00.491 05:13:39 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:00.491 05:13:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:29:00.491 05:13:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:00.491 05:13:39 -- host/auth.sh@68 -- # digest=sha512 00:29:00.491 05:13:39 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:00.491 05:13:39 -- host/auth.sh@68 -- # keyid=4 00:29:00.491 05:13:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:29:00.491 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.491 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.491 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.491 05:13:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:00.491 05:13:39 -- nvmf/common.sh@717 -- # local ip 00:29:00.491 05:13:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:00.491 05:13:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:00.491 05:13:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:00.491 05:13:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:00.491 05:13:39 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:00.491 05:13:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:00.491 05:13:39 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:00.491 05:13:39 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:00.491 05:13:39 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:00.491 05:13:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:00.491 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.491 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.750 nvme0n1 00:29:00.750 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.750 05:13:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:00.750 05:13:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:00.750 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.750 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.750 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.750 05:13:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.750 05:13:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:00.750 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.750 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.750 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.750 05:13:39 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:00.750 05:13:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:00.750 05:13:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:29:00.750 05:13:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:00.750 05:13:39 -- host/auth.sh@44 -- # digest=sha512 00:29:00.750 05:13:39 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:00.750 05:13:39 -- host/auth.sh@44 -- # keyid=0 00:29:00.750 05:13:39 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:29:00.750 05:13:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:00.750 05:13:39 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:00.750 05:13:39 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:29:00.751 05:13:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:29:00.751 05:13:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:00.751 05:13:39 -- host/auth.sh@68 -- # digest=sha512 00:29:00.751 05:13:39 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:00.751 05:13:39 -- host/auth.sh@68 -- # keyid=0 00:29:00.751 05:13:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:00.751 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.751 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:00.751 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.751 05:13:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:00.751 05:13:39 -- nvmf/common.sh@717 -- # local ip 00:29:00.751 05:13:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:00.751 05:13:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:00.751 05:13:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:00.751 05:13:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:00.751 05:13:39 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:00.751 05:13:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:00.751 05:13:39 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:00.751 05:13:39 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:00.751 05:13:39 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:00.751 05:13:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:00.751 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.751 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:01.011 nvme0n1 00:29:01.011 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.011 05:13:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:01.011 05:13:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.011 05:13:39 -- common/autotest_common.sh@10 -- # set +x 00:29:01.011 05:13:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:01.011 05:13:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.011 05:13:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.011 05:13:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:01.011 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.011 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.011 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.011 05:13:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:01.011 05:13:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:29:01.011 05:13:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:01.011 05:13:40 -- host/auth.sh@44 -- # digest=sha512 00:29:01.011 05:13:40 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:01.011 05:13:40 -- host/auth.sh@44 -- # keyid=1 00:29:01.011 05:13:40 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:01.011 05:13:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:01.011 05:13:40 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:01.011 05:13:40 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:01.011 05:13:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:29:01.011 05:13:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:01.011 05:13:40 -- host/auth.sh@68 -- # digest=sha512 00:29:01.011 05:13:40 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:01.011 05:13:40 -- host/auth.sh@68 -- # keyid=1 00:29:01.011 05:13:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:01.011 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.011 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.011 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.011 05:13:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:01.011 05:13:40 -- nvmf/common.sh@717 -- # local ip 00:29:01.011 05:13:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:01.011 05:13:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:01.011 05:13:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:01.012 05:13:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:01.012 05:13:40 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:01.012 05:13:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:01.012 05:13:40 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:01.012 05:13:40 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:01.012 05:13:40 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:01.012 05:13:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:01.012 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.012 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.272 nvme0n1 00:29:01.272 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.272 05:13:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:01.272 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.272 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.272 05:13:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:01.272 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.272 05:13:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.272 05:13:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:01.272 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.272 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.272 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.272 05:13:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:01.272 05:13:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:29:01.272 05:13:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:01.272 05:13:40 -- host/auth.sh@44 -- # digest=sha512 00:29:01.272 05:13:40 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:01.272 05:13:40 -- host/auth.sh@44 -- # keyid=2 00:29:01.272 05:13:40 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:29:01.272 05:13:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:01.272 05:13:40 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:01.272 05:13:40 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:29:01.272 05:13:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:29:01.272 05:13:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:01.272 05:13:40 -- host/auth.sh@68 -- # digest=sha512 00:29:01.272 05:13:40 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:01.272 05:13:40 -- host/auth.sh@68 -- # keyid=2 00:29:01.272 05:13:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:01.272 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.272 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.272 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.272 05:13:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:01.272 05:13:40 -- nvmf/common.sh@717 -- # local ip 00:29:01.272 05:13:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:01.272 05:13:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:01.272 05:13:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:01.272 05:13:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:01.272 05:13:40 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:01.272 05:13:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:01.272 05:13:40 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:01.272 05:13:40 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:01.272 05:13:40 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:01.272 05:13:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:01.272 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.272 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.531 nvme0n1 00:29:01.531 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.531 05:13:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:01.531 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.531 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.531 05:13:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:01.531 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.531 05:13:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.531 05:13:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:01.531 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.531 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.790 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.790 05:13:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:01.790 05:13:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:29:01.790 05:13:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:01.790 05:13:40 -- host/auth.sh@44 -- # digest=sha512 00:29:01.790 05:13:40 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:01.790 05:13:40 -- host/auth.sh@44 -- # keyid=3 00:29:01.790 05:13:40 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:01.790 05:13:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:01.790 05:13:40 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:01.790 05:13:40 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:01.790 05:13:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:29:01.790 05:13:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:01.790 05:13:40 -- host/auth.sh@68 -- # digest=sha512 00:29:01.790 05:13:40 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:01.790 05:13:40 -- host/auth.sh@68 -- # keyid=3 00:29:01.790 05:13:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:01.790 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.790 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.790 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.790 05:13:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:01.790 05:13:40 -- nvmf/common.sh@717 -- # local ip 00:29:01.790 05:13:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:01.790 05:13:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:01.790 05:13:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:01.790 05:13:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:01.790 05:13:40 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:01.790 05:13:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:01.790 05:13:40 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:01.790 05:13:40 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:01.790 05:13:40 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:01.790 05:13:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:01.790 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.790 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:02.048 nvme0n1 00:29:02.048 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.048 05:13:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:02.048 05:13:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.048 05:13:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:02.048 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:02.048 05:13:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.048 05:13:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.048 05:13:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:02.048 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.048 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.048 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.048 05:13:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:02.048 05:13:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:29:02.048 05:13:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:02.048 05:13:41 -- host/auth.sh@44 -- # digest=sha512 00:29:02.048 05:13:41 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:02.048 05:13:41 -- host/auth.sh@44 -- # keyid=4 00:29:02.048 05:13:41 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:02.048 05:13:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:02.048 05:13:41 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:02.048 05:13:41 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:02.048 05:13:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:29:02.048 05:13:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:02.048 05:13:41 -- host/auth.sh@68 -- # digest=sha512 00:29:02.048 05:13:41 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:02.048 05:13:41 -- host/auth.sh@68 -- # keyid=4 00:29:02.048 05:13:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:02.048 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.048 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.048 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.048 05:13:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:02.048 05:13:41 -- nvmf/common.sh@717 -- # local ip 00:29:02.048 05:13:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:02.048 05:13:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:02.048 05:13:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:02.048 05:13:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:02.048 05:13:41 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:02.048 05:13:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:02.048 05:13:41 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:02.048 05:13:41 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:02.048 05:13:41 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:02.048 05:13:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:02.048 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.048 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.307 nvme0n1 00:29:02.307 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.307 05:13:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:02.307 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.307 05:13:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:02.307 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.307 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.307 05:13:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.307 05:13:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:02.307 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.307 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.307 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.307 05:13:41 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:02.307 05:13:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:02.307 05:13:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:29:02.307 05:13:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:02.307 05:13:41 -- host/auth.sh@44 -- # digest=sha512 00:29:02.307 05:13:41 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:02.307 05:13:41 -- host/auth.sh@44 -- # keyid=0 00:29:02.307 05:13:41 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:29:02.307 05:13:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:02.307 05:13:41 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:02.307 05:13:41 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:29:02.307 05:13:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:29:02.307 05:13:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:02.307 05:13:41 -- host/auth.sh@68 -- # digest=sha512 00:29:02.307 05:13:41 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:02.307 05:13:41 -- host/auth.sh@68 -- # keyid=0 00:29:02.307 05:13:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:02.307 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.307 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.307 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.307 05:13:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:02.307 05:13:41 -- nvmf/common.sh@717 -- # local ip 00:29:02.307 05:13:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:02.307 05:13:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:02.307 05:13:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:02.307 05:13:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:02.307 05:13:41 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:02.307 05:13:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:02.307 05:13:41 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:02.307 05:13:41 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:02.307 05:13:41 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:02.307 05:13:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:02.307 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.307 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.876 nvme0n1 00:29:02.876 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.876 05:13:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:02.876 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.876 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.876 05:13:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:02.876 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.876 05:13:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.876 05:13:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:02.876 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.876 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.876 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.876 05:13:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:02.876 05:13:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:29:02.876 05:13:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:02.876 05:13:41 -- host/auth.sh@44 -- # digest=sha512 00:29:02.876 05:13:41 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:02.876 05:13:41 -- host/auth.sh@44 -- # keyid=1 00:29:02.876 05:13:41 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:02.876 05:13:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:02.876 05:13:41 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:02.876 05:13:41 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:02.876 05:13:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:29:02.876 05:13:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:02.876 05:13:41 -- host/auth.sh@68 -- # digest=sha512 00:29:02.876 05:13:41 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:02.876 05:13:41 -- host/auth.sh@68 -- # keyid=1 00:29:02.876 05:13:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:02.876 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.876 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:02.876 05:13:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.876 05:13:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:02.877 05:13:41 -- nvmf/common.sh@717 -- # local ip 00:29:02.877 05:13:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:02.877 05:13:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:02.877 05:13:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:02.877 05:13:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:02.877 05:13:41 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:02.877 05:13:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:02.877 05:13:41 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:02.877 05:13:41 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:02.877 05:13:41 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:02.877 05:13:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:02.877 05:13:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.877 05:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:03.446 nvme0n1 00:29:03.446 05:13:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.446 05:13:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:03.446 05:13:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.446 05:13:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.446 05:13:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:03.446 05:13:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.446 05:13:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:03.446 05:13:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:03.446 05:13:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.446 05:13:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.446 05:13:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.446 05:13:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:03.446 05:13:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:29:03.446 05:13:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:03.446 05:13:42 -- host/auth.sh@44 -- # digest=sha512 00:29:03.446 05:13:42 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:03.446 05:13:42 -- host/auth.sh@44 -- # keyid=2 00:29:03.446 05:13:42 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:29:03.446 05:13:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:03.446 05:13:42 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:03.446 05:13:42 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:29:03.446 05:13:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:29:03.446 05:13:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:03.446 05:13:42 -- host/auth.sh@68 -- # digest=sha512 00:29:03.446 05:13:42 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:03.446 05:13:42 -- host/auth.sh@68 -- # keyid=2 00:29:03.446 05:13:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:03.446 05:13:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.446 05:13:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.446 05:13:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.446 05:13:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:03.446 05:13:42 -- nvmf/common.sh@717 -- # local ip 00:29:03.446 05:13:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:03.446 05:13:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:03.446 05:13:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:03.446 05:13:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:03.446 05:13:42 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:03.446 05:13:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:03.446 05:13:42 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:03.446 05:13:42 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:03.446 05:13:42 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:03.446 05:13:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:03.446 05:13:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.446 05:13:42 -- common/autotest_common.sh@10 -- # set +x 00:29:04.015 nvme0n1 00:29:04.015 05:13:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.015 05:13:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:04.015 05:13:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:04.015 05:13:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.015 05:13:42 -- common/autotest_common.sh@10 -- # set +x 00:29:04.015 05:13:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.015 05:13:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:04.015 05:13:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:04.015 05:13:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.015 05:13:43 -- common/autotest_common.sh@10 -- # set +x 00:29:04.015 05:13:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.015 05:13:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:04.015 05:13:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:29:04.015 05:13:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:04.015 05:13:43 -- host/auth.sh@44 -- # digest=sha512 00:29:04.015 05:13:43 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:04.015 05:13:43 -- host/auth.sh@44 -- # keyid=3 00:29:04.015 05:13:43 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:04.015 05:13:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:04.015 05:13:43 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:04.015 05:13:43 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:04.015 05:13:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:29:04.016 05:13:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:04.016 05:13:43 -- host/auth.sh@68 -- # digest=sha512 00:29:04.016 05:13:43 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:04.016 05:13:43 -- host/auth.sh@68 -- # keyid=3 00:29:04.016 05:13:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:04.016 05:13:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.016 05:13:43 -- common/autotest_common.sh@10 -- # set +x 00:29:04.016 05:13:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.016 05:13:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:04.016 05:13:43 -- nvmf/common.sh@717 -- # local ip 00:29:04.016 05:13:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:04.016 05:13:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:04.016 05:13:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:04.016 05:13:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:04.016 05:13:43 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:04.016 05:13:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:04.016 05:13:43 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:04.016 05:13:43 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:04.016 05:13:43 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:04.016 05:13:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:04.016 05:13:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.016 05:13:43 -- common/autotest_common.sh@10 -- # set +x 00:29:04.586 nvme0n1 00:29:04.586 05:13:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.586 05:13:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:04.586 05:13:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:04.586 05:13:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.586 05:13:43 -- common/autotest_common.sh@10 -- # set +x 00:29:04.586 05:13:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.586 05:13:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:04.586 05:13:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:04.586 05:13:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.586 05:13:43 -- common/autotest_common.sh@10 -- # set +x 00:29:04.586 05:13:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.586 05:13:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:04.586 05:13:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:29:04.586 05:13:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:04.586 05:13:43 -- host/auth.sh@44 -- # digest=sha512 00:29:04.586 05:13:43 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:04.586 05:13:43 -- host/auth.sh@44 -- # keyid=4 00:29:04.586 05:13:43 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:04.586 05:13:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:04.586 05:13:43 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:04.586 05:13:43 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:04.586 05:13:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:29:04.586 05:13:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:04.586 05:13:43 -- host/auth.sh@68 -- # digest=sha512 00:29:04.586 05:13:43 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:04.586 05:13:43 -- host/auth.sh@68 -- # keyid=4 00:29:04.586 05:13:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:04.586 05:13:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.586 05:13:43 -- common/autotest_common.sh@10 -- # set +x 00:29:04.586 05:13:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.586 05:13:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:04.586 05:13:43 -- nvmf/common.sh@717 -- # local ip 00:29:04.586 05:13:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:04.586 05:13:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:04.586 05:13:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:04.586 05:13:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:04.586 05:13:43 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:04.586 05:13:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:04.586 05:13:43 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:04.586 05:13:43 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:04.586 05:13:43 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:04.586 05:13:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:04.586 05:13:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.586 05:13:43 -- common/autotest_common.sh@10 -- # set +x 00:29:05.154 nvme0n1 00:29:05.154 05:13:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.154 05:13:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:05.154 05:13:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:05.154 05:13:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.154 05:13:44 -- common/autotest_common.sh@10 -- # set +x 00:29:05.154 05:13:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.154 05:13:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:05.154 05:13:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:05.154 05:13:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.154 05:13:44 -- common/autotest_common.sh@10 -- # set +x 00:29:05.154 05:13:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.154 05:13:44 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:05.154 05:13:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:05.154 05:13:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:29:05.154 05:13:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:05.154 05:13:44 -- host/auth.sh@44 -- # digest=sha512 00:29:05.154 05:13:44 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:05.154 05:13:44 -- host/auth.sh@44 -- # keyid=0 00:29:05.154 05:13:44 -- host/auth.sh@45 -- # key=DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:29:05.154 05:13:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:05.154 05:13:44 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:05.154 05:13:44 -- host/auth.sh@49 -- # echo DHHC-1:00:NTJlMDExOGM5MmQzZTk4MjZiMmQyMmZiZTI1ZTlmMDeeGlbN: 00:29:05.154 05:13:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:29:05.154 05:13:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:05.154 05:13:44 -- host/auth.sh@68 -- # digest=sha512 00:29:05.154 05:13:44 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:05.154 05:13:44 -- host/auth.sh@68 -- # keyid=0 00:29:05.154 05:13:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:05.154 05:13:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.154 05:13:44 -- common/autotest_common.sh@10 -- # set +x 00:29:05.154 05:13:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.154 05:13:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:05.154 05:13:44 -- nvmf/common.sh@717 -- # local ip 00:29:05.154 05:13:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:05.154 05:13:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:05.154 05:13:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:05.154 05:13:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:05.154 05:13:44 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:05.154 05:13:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:05.154 05:13:44 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:05.154 05:13:44 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:05.154 05:13:44 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:05.154 05:13:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:05.154 05:13:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.154 05:13:44 -- common/autotest_common.sh@10 -- # set +x 00:29:06.094 nvme0n1 00:29:06.094 05:13:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.094 05:13:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:06.094 05:13:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:06.094 05:13:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.094 05:13:45 -- common/autotest_common.sh@10 -- # set +x 00:29:06.094 05:13:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.094 05:13:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:06.094 05:13:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:06.094 05:13:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.094 05:13:45 -- common/autotest_common.sh@10 -- # set +x 00:29:06.094 05:13:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.094 05:13:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:06.094 05:13:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:29:06.094 05:13:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:06.094 05:13:45 -- host/auth.sh@44 -- # digest=sha512 00:29:06.094 05:13:45 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:06.094 05:13:45 -- host/auth.sh@44 -- # keyid=1 00:29:06.094 05:13:45 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:06.094 05:13:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:06.094 05:13:45 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:06.094 05:13:45 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:06.094 05:13:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:29:06.094 05:13:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:06.094 05:13:45 -- host/auth.sh@68 -- # digest=sha512 00:29:06.094 05:13:45 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:06.094 05:13:45 -- host/auth.sh@68 -- # keyid=1 00:29:06.094 05:13:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:06.094 05:13:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.094 05:13:45 -- common/autotest_common.sh@10 -- # set +x 00:29:06.094 05:13:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.094 05:13:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:06.094 05:13:45 -- nvmf/common.sh@717 -- # local ip 00:29:06.094 05:13:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:06.094 05:13:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:06.094 05:13:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:06.094 05:13:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:06.094 05:13:45 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:06.094 05:13:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:06.094 05:13:45 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:06.094 05:13:45 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:06.094 05:13:45 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:06.094 05:13:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:06.094 05:13:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.094 05:13:45 -- common/autotest_common.sh@10 -- # set +x 00:29:07.034 nvme0n1 00:29:07.034 05:13:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.034 05:13:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:07.034 05:13:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.034 05:13:46 -- common/autotest_common.sh@10 -- # set +x 00:29:07.034 05:13:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:07.034 05:13:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.034 05:13:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:07.034 05:13:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:07.034 05:13:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.034 05:13:46 -- common/autotest_common.sh@10 -- # set +x 00:29:07.034 05:13:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.034 05:13:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:07.034 05:13:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:29:07.034 05:13:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:07.034 05:13:46 -- host/auth.sh@44 -- # digest=sha512 00:29:07.034 05:13:46 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:07.034 05:13:46 -- host/auth.sh@44 -- # keyid=2 00:29:07.034 05:13:46 -- host/auth.sh@45 -- # key=DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:29:07.034 05:13:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:07.034 05:13:46 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:07.034 05:13:46 -- host/auth.sh@49 -- # echo DHHC-1:01:YmYzMTFjMzQxY2E3ODI3NzdiZTAzNDE4MjFlOTkxMjkcgGj4: 00:29:07.034 05:13:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:29:07.034 05:13:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:07.034 05:13:46 -- host/auth.sh@68 -- # digest=sha512 00:29:07.034 05:13:46 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:07.034 05:13:46 -- host/auth.sh@68 -- # keyid=2 00:29:07.034 05:13:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:07.034 05:13:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.034 05:13:46 -- common/autotest_common.sh@10 -- # set +x 00:29:07.034 05:13:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.034 05:13:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:07.034 05:13:46 -- nvmf/common.sh@717 -- # local ip 00:29:07.034 05:13:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:07.034 05:13:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:07.034 05:13:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:07.034 05:13:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:07.034 05:13:46 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:07.034 05:13:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:07.034 05:13:46 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:07.034 05:13:46 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:07.034 05:13:46 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:07.034 05:13:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:07.034 05:13:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.034 05:13:46 -- common/autotest_common.sh@10 -- # set +x 00:29:07.972 nvme0n1 00:29:07.972 05:13:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.972 05:13:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:07.972 05:13:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:07.972 05:13:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.972 05:13:46 -- common/autotest_common.sh@10 -- # set +x 00:29:07.972 05:13:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.972 05:13:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:07.972 05:13:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:07.972 05:13:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.972 05:13:47 -- common/autotest_common.sh@10 -- # set +x 00:29:07.972 05:13:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.972 05:13:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:07.972 05:13:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:29:07.972 05:13:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:07.972 05:13:47 -- host/auth.sh@44 -- # digest=sha512 00:29:07.972 05:13:47 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:07.972 05:13:47 -- host/auth.sh@44 -- # keyid=3 00:29:07.972 05:13:47 -- host/auth.sh@45 -- # key=DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:07.972 05:13:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:07.972 05:13:47 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:07.972 05:13:47 -- host/auth.sh@49 -- # echo DHHC-1:02:Njg4YmIyZjI4MGRhMTA0MWMwNDk1MmU5ZjFkMWM0ZDJiMDA0NzZhYTc3YThlMzlhH25aLQ==: 00:29:07.972 05:13:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:29:07.972 05:13:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:07.972 05:13:47 -- host/auth.sh@68 -- # digest=sha512 00:29:07.972 05:13:47 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:07.972 05:13:47 -- host/auth.sh@68 -- # keyid=3 00:29:07.972 05:13:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:07.972 05:13:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.972 05:13:47 -- common/autotest_common.sh@10 -- # set +x 00:29:07.972 05:13:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.972 05:13:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:07.972 05:13:47 -- nvmf/common.sh@717 -- # local ip 00:29:07.972 05:13:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:07.972 05:13:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:07.972 05:13:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:07.972 05:13:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:07.972 05:13:47 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:07.972 05:13:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:07.972 05:13:47 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:07.972 05:13:47 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:07.972 05:13:47 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:07.973 05:13:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:07.973 05:13:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.973 05:13:47 -- common/autotest_common.sh@10 -- # set +x 00:29:08.911 nvme0n1 00:29:08.911 05:13:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.911 05:13:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:08.911 05:13:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.911 05:13:47 -- common/autotest_common.sh@10 -- # set +x 00:29:08.911 05:13:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:08.911 05:13:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.911 05:13:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:08.911 05:13:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:08.911 05:13:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.911 05:13:47 -- common/autotest_common.sh@10 -- # set +x 00:29:08.911 05:13:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.911 05:13:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:08.911 05:13:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:29:08.911 05:13:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:08.911 05:13:48 -- host/auth.sh@44 -- # digest=sha512 00:29:08.911 05:13:48 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:08.911 05:13:48 -- host/auth.sh@44 -- # keyid=4 00:29:08.911 05:13:48 -- host/auth.sh@45 -- # key=DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:08.911 05:13:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:08.911 05:13:48 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:08.911 05:13:48 -- host/auth.sh@49 -- # echo DHHC-1:03:MDU1NjI2ZTRkNzYwZjMzZTNhM2U3NzM3YTZiZjY5ODExNzQxZTljN2ZkZTI1MGExMTI5MTA5ZjQ3M2UzMjVlN6FELM4=: 00:29:08.911 05:13:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:29:08.911 05:13:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:08.911 05:13:48 -- host/auth.sh@68 -- # digest=sha512 00:29:08.911 05:13:48 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:08.911 05:13:48 -- host/auth.sh@68 -- # keyid=4 00:29:08.911 05:13:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:08.911 05:13:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.911 05:13:48 -- common/autotest_common.sh@10 -- # set +x 00:29:08.911 05:13:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.911 05:13:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:08.911 05:13:48 -- nvmf/common.sh@717 -- # local ip 00:29:08.911 05:13:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:08.911 05:13:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:08.911 05:13:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:08.911 05:13:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:08.911 05:13:48 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:08.911 05:13:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:08.911 05:13:48 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:08.911 05:13:48 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:08.911 05:13:48 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:08.911 05:13:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:08.911 05:13:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.911 05:13:48 -- common/autotest_common.sh@10 -- # set +x 00:29:09.847 nvme0n1 00:29:09.847 05:13:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.847 05:13:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:09.847 05:13:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.847 05:13:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:09.847 05:13:48 -- common/autotest_common.sh@10 -- # set +x 00:29:09.847 05:13:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.847 05:13:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:09.847 05:13:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:09.847 05:13:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.847 05:13:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.106 05:13:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.106 05:13:49 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:29:10.106 05:13:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:10.106 05:13:49 -- host/auth.sh@44 -- # digest=sha256 00:29:10.106 05:13:49 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:10.106 05:13:49 -- host/auth.sh@44 -- # keyid=1 00:29:10.106 05:13:49 -- host/auth.sh@45 -- # key=DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:10.106 05:13:49 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:29:10.106 05:13:49 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:10.106 05:13:49 -- host/auth.sh@49 -- # echo DHHC-1:00:MjQ5OTBmZGE0MDFjMDVkYzIxMTE1OTU1NmJlZmJkNTQ0ZjE4YzAzZTg2ZTJhMzQ2dxJwCA==: 00:29:10.106 05:13:49 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:29:10.106 05:13:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.106 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:29:10.106 05:13:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.106 05:13:49 -- host/auth.sh@119 -- # get_main_ns_ip 00:29:10.106 05:13:49 -- nvmf/common.sh@717 -- # local ip 00:29:10.106 05:13:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:10.106 05:13:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:10.106 05:13:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:10.106 05:13:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:10.106 05:13:49 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:10.106 05:13:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:10.106 05:13:49 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:10.106 05:13:49 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:10.106 05:13:49 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:10.106 05:13:49 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:29:10.106 05:13:49 -- common/autotest_common.sh@638 -- # local es=0 00:29:10.106 05:13:49 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:29:10.106 05:13:49 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:29:10.106 05:13:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:10.106 05:13:49 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:29:10.106 05:13:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:10.106 05:13:49 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:29:10.106 05:13:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.106 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:29:10.106 request: 00:29:10.106 { 00:29:10.106 "name": "nvme0", 00:29:10.106 "trtype": "tcp", 00:29:10.106 "traddr": "10.0.0.1", 00:29:10.106 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:29:10.106 "adrfam": "ipv4", 00:29:10.106 "trsvcid": "4420", 00:29:10.106 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:29:10.106 "method": "bdev_nvme_attach_controller", 00:29:10.106 "req_id": 1 00:29:10.106 } 00:29:10.106 Got JSON-RPC error response 00:29:10.106 response: 00:29:10.106 { 00:29:10.106 "code": -32602, 00:29:10.106 "message": "Invalid parameters" 00:29:10.106 } 00:29:10.106 05:13:49 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:29:10.106 05:13:49 -- common/autotest_common.sh@641 -- # es=1 00:29:10.106 05:13:49 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:29:10.106 05:13:49 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:29:10.106 05:13:49 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:29:10.106 05:13:49 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:29:10.106 05:13:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.106 05:13:49 -- host/auth.sh@121 -- # jq length 00:29:10.106 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:29:10.106 05:13:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.106 05:13:49 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:29:10.106 05:13:49 -- host/auth.sh@124 -- # get_main_ns_ip 00:29:10.106 05:13:49 -- nvmf/common.sh@717 -- # local ip 00:29:10.106 05:13:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:10.106 05:13:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:10.106 05:13:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:10.106 05:13:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:10.106 05:13:49 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:29:10.106 05:13:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:29:10.106 05:13:49 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:29:10.106 05:13:49 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:29:10.106 05:13:49 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:29:10.106 05:13:49 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:10.106 05:13:49 -- common/autotest_common.sh@638 -- # local es=0 00:29:10.106 05:13:49 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:10.106 05:13:49 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:29:10.106 05:13:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:10.106 05:13:49 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:29:10.106 05:13:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:10.106 05:13:49 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:10.106 05:13:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.106 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:29:10.106 request: 00:29:10.106 { 00:29:10.106 "name": "nvme0", 00:29:10.106 "trtype": "tcp", 00:29:10.106 "traddr": "10.0.0.1", 00:29:10.106 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:29:10.106 "adrfam": "ipv4", 00:29:10.106 "trsvcid": "4420", 00:29:10.106 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:29:10.106 "dhchap_key": "key2", 00:29:10.106 "method": "bdev_nvme_attach_controller", 00:29:10.106 "req_id": 1 00:29:10.106 } 00:29:10.106 Got JSON-RPC error response 00:29:10.106 response: 00:29:10.106 { 00:29:10.106 "code": -32602, 00:29:10.106 "message": "Invalid parameters" 00:29:10.106 } 00:29:10.106 05:13:49 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:29:10.106 05:13:49 -- common/autotest_common.sh@641 -- # es=1 00:29:10.106 05:13:49 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:29:10.106 05:13:49 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:29:10.106 05:13:49 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:29:10.106 05:13:49 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:29:10.106 05:13:49 -- host/auth.sh@127 -- # jq length 00:29:10.106 05:13:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.106 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:29:10.106 05:13:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.106 05:13:49 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:29:10.106 05:13:49 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:29:10.106 05:13:49 -- host/auth.sh@130 -- # cleanup 00:29:10.106 05:13:49 -- host/auth.sh@24 -- # nvmftestfini 00:29:10.106 05:13:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:29:10.106 05:13:49 -- nvmf/common.sh@117 -- # sync 00:29:10.106 05:13:49 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:29:10.106 05:13:49 -- nvmf/common.sh@120 -- # set +e 00:29:10.106 05:13:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:29:10.106 05:13:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:29:10.106 rmmod nvme_tcp 00:29:10.106 rmmod nvme_fabrics 00:29:10.106 05:13:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:29:10.106 05:13:49 -- nvmf/common.sh@124 -- # set -e 00:29:10.106 05:13:49 -- nvmf/common.sh@125 -- # return 0 00:29:10.106 05:13:49 -- nvmf/common.sh@478 -- # '[' -n 2507910 ']' 00:29:10.106 05:13:49 -- nvmf/common.sh@479 -- # killprocess 2507910 00:29:10.106 05:13:49 -- common/autotest_common.sh@936 -- # '[' -z 2507910 ']' 00:29:10.106 05:13:49 -- common/autotest_common.sh@940 -- # kill -0 2507910 00:29:10.106 05:13:49 -- common/autotest_common.sh@941 -- # uname 00:29:10.106 05:13:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:10.106 05:13:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2507910 00:29:10.106 05:13:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:10.106 05:13:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:10.107 05:13:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2507910' 00:29:10.107 killing process with pid 2507910 00:29:10.107 05:13:49 -- common/autotest_common.sh@955 -- # kill 2507910 00:29:10.107 05:13:49 -- common/autotest_common.sh@960 -- # wait 2507910 00:29:10.366 05:13:49 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:29:10.366 05:13:49 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:29:10.366 05:13:49 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:29:10.366 05:13:49 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:10.366 05:13:49 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:29:10.366 05:13:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:10.366 05:13:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:10.366 05:13:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:12.292 05:13:51 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:29:12.292 05:13:51 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:29:12.293 05:13:51 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:29:12.551 05:13:51 -- host/auth.sh@27 -- # clean_kernel_target 00:29:12.551 05:13:51 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:29:12.551 05:13:51 -- nvmf/common.sh@675 -- # echo 0 00:29:12.551 05:13:51 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:29:12.551 05:13:51 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:29:12.551 05:13:51 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:12.551 05:13:51 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:29:12.551 05:13:51 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:29:12.551 05:13:51 -- nvmf/common.sh@684 -- # modprobe -r nvmet_tcp nvmet 00:29:12.551 05:13:51 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:13.487 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:13.487 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:13.487 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:13.487 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:13.487 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:13.487 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:13.487 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:13.487 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:13.487 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:14.423 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:14.683 05:13:53 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.wqK /tmp/spdk.key-null.mfV /tmp/spdk.key-sha256.wVW /tmp/spdk.key-sha384.VfJ /tmp/spdk.key-sha512.G4p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvme-auth.log 00:29:14.683 05:13:53 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:15.637 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:29:15.637 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:29:15.637 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:29:15.637 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:29:15.637 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:29:15.637 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:29:15.637 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:29:15.637 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:29:15.637 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:29:15.637 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:29:15.637 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:29:15.637 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:29:15.637 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:29:15.637 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:29:15.637 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:29:15.637 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:29:15.637 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:29:15.923 00:29:15.923 real 0m45.747s 00:29:15.923 user 0m43.351s 00:29:15.923 sys 0m5.301s 00:29:15.923 05:13:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:15.923 05:13:54 -- common/autotest_common.sh@10 -- # set +x 00:29:15.923 ************************************ 00:29:15.923 END TEST nvmf_auth 00:29:15.923 ************************************ 00:29:15.923 05:13:54 -- nvmf/nvmf.sh@104 -- # [[ tcp == \t\c\p ]] 00:29:15.923 05:13:54 -- nvmf/nvmf.sh@105 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:15.923 05:13:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:15.923 05:13:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:15.923 05:13:54 -- common/autotest_common.sh@10 -- # set +x 00:29:15.923 ************************************ 00:29:15.923 START TEST nvmf_digest 00:29:15.923 ************************************ 00:29:15.923 05:13:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:15.923 * Looking for test storage... 00:29:15.923 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:15.923 05:13:55 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:15.923 05:13:55 -- nvmf/common.sh@7 -- # uname -s 00:29:15.923 05:13:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:15.923 05:13:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:15.923 05:13:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:15.923 05:13:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:15.923 05:13:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:15.923 05:13:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:15.923 05:13:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:15.923 05:13:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:15.923 05:13:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:15.923 05:13:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:15.923 05:13:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.923 05:13:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.923 05:13:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:15.923 05:13:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:15.923 05:13:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:15.923 05:13:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:29:15.923 05:13:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:15.923 05:13:55 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:15.923 05:13:55 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:15.923 05:13:55 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:15.923 05:13:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.923 05:13:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.923 05:13:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.923 05:13:55 -- paths/export.sh@5 -- # export PATH 00:29:15.923 05:13:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.923 05:13:55 -- nvmf/common.sh@47 -- # : 0 00:29:15.923 05:13:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:29:15.923 05:13:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:29:15.923 05:13:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:29:15.923 05:13:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:15.923 05:13:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:15.923 05:13:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:29:15.923 05:13:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:29:15.923 05:13:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:29:15.923 05:13:55 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:15.923 05:13:55 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:15.923 05:13:55 -- host/digest.sh@16 -- # runtime=2 00:29:15.923 05:13:55 -- host/digest.sh@136 -- # [[ tcp != \t\c\p ]] 00:29:15.923 05:13:55 -- host/digest.sh@138 -- # nvmftestinit 00:29:15.923 05:13:55 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:29:15.923 05:13:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:15.923 05:13:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:29:15.923 05:13:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:29:15.924 05:13:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:29:15.924 05:13:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:15.924 05:13:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:15.924 05:13:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:15.924 05:13:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:29:15.924 05:13:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:29:15.924 05:13:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:29:15.924 05:13:55 -- common/autotest_common.sh@10 -- # set +x 00:29:18.458 05:13:56 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:18.458 05:13:56 -- nvmf/common.sh@291 -- # pci_devs=() 00:29:18.458 05:13:56 -- nvmf/common.sh@291 -- # local -a pci_devs 00:29:18.458 05:13:56 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:29:18.458 05:13:56 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:29:18.458 05:13:56 -- nvmf/common.sh@293 -- # pci_drivers=() 00:29:18.458 05:13:56 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:29:18.458 05:13:56 -- nvmf/common.sh@295 -- # net_devs=() 00:29:18.458 05:13:56 -- nvmf/common.sh@295 -- # local -ga net_devs 00:29:18.458 05:13:56 -- nvmf/common.sh@296 -- # e810=() 00:29:18.458 05:13:56 -- nvmf/common.sh@296 -- # local -ga e810 00:29:18.458 05:13:56 -- nvmf/common.sh@297 -- # x722=() 00:29:18.458 05:13:56 -- nvmf/common.sh@297 -- # local -ga x722 00:29:18.458 05:13:56 -- nvmf/common.sh@298 -- # mlx=() 00:29:18.458 05:13:56 -- nvmf/common.sh@298 -- # local -ga mlx 00:29:18.458 05:13:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:18.458 05:13:56 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:29:18.458 05:13:56 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:29:18.458 05:13:56 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:29:18.458 05:13:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:18.458 05:13:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:18.458 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:18.458 05:13:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:18.458 05:13:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:18.458 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:18.458 05:13:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:29:18.458 05:13:56 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:29:18.458 05:13:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:18.458 05:13:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:18.458 05:13:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:18.458 05:13:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:18.458 05:13:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:18.458 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:18.458 05:13:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:18.458 05:13:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:18.458 05:13:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:18.458 05:13:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:18.458 05:13:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:18.458 05:13:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:18.458 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:18.458 05:13:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:18.458 05:13:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:29:18.458 05:13:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:29:18.458 05:13:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:29:18.458 05:13:57 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:29:18.458 05:13:57 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:29:18.458 05:13:57 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:18.458 05:13:57 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:18.459 05:13:57 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:18.459 05:13:57 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:29:18.459 05:13:57 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:18.459 05:13:57 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:18.459 05:13:57 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:29:18.459 05:13:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:18.459 05:13:57 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:18.459 05:13:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:29:18.459 05:13:57 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:29:18.459 05:13:57 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:29:18.459 05:13:57 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:18.459 05:13:57 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:18.459 05:13:57 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:18.459 05:13:57 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:29:18.459 05:13:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:18.459 05:13:57 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:18.459 05:13:57 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:18.459 05:13:57 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:29:18.459 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:18.459 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.132 ms 00:29:18.459 00:29:18.459 --- 10.0.0.2 ping statistics --- 00:29:18.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:18.459 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:29:18.459 05:13:57 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:18.459 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:18.459 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:29:18.459 00:29:18.459 --- 10.0.0.1 ping statistics --- 00:29:18.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:18.459 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:29:18.459 05:13:57 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:18.459 05:13:57 -- nvmf/common.sh@411 -- # return 0 00:29:18.459 05:13:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:29:18.459 05:13:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:18.459 05:13:57 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:29:18.459 05:13:57 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:29:18.459 05:13:57 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:18.459 05:13:57 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:29:18.459 05:13:57 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:29:18.459 05:13:57 -- host/digest.sh@140 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:18.459 05:13:57 -- host/digest.sh@141 -- # [[ 0 -eq 1 ]] 00:29:18.459 05:13:57 -- host/digest.sh@145 -- # run_test nvmf_digest_clean run_digest 00:29:18.459 05:13:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:18.459 05:13:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:18.459 05:13:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.459 ************************************ 00:29:18.459 START TEST nvmf_digest_clean 00:29:18.459 ************************************ 00:29:18.459 05:13:57 -- common/autotest_common.sh@1111 -- # run_digest 00:29:18.459 05:13:57 -- host/digest.sh@120 -- # local dsa_initiator 00:29:18.459 05:13:57 -- host/digest.sh@121 -- # [[ '' == \d\s\a\_\i\n\i\t\i\a\t\o\r ]] 00:29:18.459 05:13:57 -- host/digest.sh@121 -- # dsa_initiator=false 00:29:18.459 05:13:57 -- host/digest.sh@123 -- # tgt_params=("--wait-for-rpc") 00:29:18.459 05:13:57 -- host/digest.sh@124 -- # nvmfappstart --wait-for-rpc 00:29:18.459 05:13:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:29:18.459 05:13:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:18.459 05:13:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.459 05:13:57 -- nvmf/common.sh@470 -- # nvmfpid=2516999 00:29:18.459 05:13:57 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:18.459 05:13:57 -- nvmf/common.sh@471 -- # waitforlisten 2516999 00:29:18.459 05:13:57 -- common/autotest_common.sh@817 -- # '[' -z 2516999 ']' 00:29:18.459 05:13:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:18.459 05:13:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:18.459 05:13:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:18.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:18.459 05:13:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:18.459 05:13:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.459 [2024-04-23 05:13:57.300720] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:18.459 [2024-04-23 05:13:57.300809] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:18.459 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.459 [2024-04-23 05:13:57.338152] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:18.459 [2024-04-23 05:13:57.365405] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:18.459 [2024-04-23 05:13:57.447447] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:18.459 [2024-04-23 05:13:57.447525] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:18.459 [2024-04-23 05:13:57.447541] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:18.459 [2024-04-23 05:13:57.447553] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:18.459 [2024-04-23 05:13:57.447578] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:18.459 [2024-04-23 05:13:57.447624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:18.459 05:13:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:18.459 05:13:57 -- common/autotest_common.sh@850 -- # return 0 00:29:18.459 05:13:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:29:18.459 05:13:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:18.459 05:13:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.459 05:13:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:18.459 05:13:57 -- host/digest.sh@125 -- # [[ '' == \d\s\a\_\t\a\r\g\e\t ]] 00:29:18.459 05:13:57 -- host/digest.sh@126 -- # common_target_config 00:29:18.459 05:13:57 -- host/digest.sh@43 -- # rpc_cmd 00:29:18.459 05:13:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:18.459 05:13:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.719 null0 00:29:18.719 [2024-04-23 05:13:57.639631] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:18.719 [2024-04-23 05:13:57.663874] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:18.719 05:13:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:18.719 05:13:57 -- host/digest.sh@128 -- # run_bperf randread 4096 128 false 00:29:18.719 05:13:57 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:29:18.719 05:13:57 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:18.719 05:13:57 -- host/digest.sh@80 -- # rw=randread 00:29:18.719 05:13:57 -- host/digest.sh@80 -- # bs=4096 00:29:18.719 05:13:57 -- host/digest.sh@80 -- # qd=128 00:29:18.719 05:13:57 -- host/digest.sh@80 -- # scan_dsa=false 00:29:18.719 05:13:57 -- host/digest.sh@83 -- # bperfpid=2517021 00:29:18.719 05:13:57 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:18.719 05:13:57 -- host/digest.sh@84 -- # waitforlisten 2517021 /var/tmp/bperf.sock 00:29:18.719 05:13:57 -- common/autotest_common.sh@817 -- # '[' -z 2517021 ']' 00:29:18.719 05:13:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:18.719 05:13:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:18.720 05:13:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:18.720 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:18.720 05:13:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:18.720 05:13:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.720 [2024-04-23 05:13:57.711180] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:18.720 [2024-04-23 05:13:57.711253] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2517021 ] 00:29:18.720 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.720 [2024-04-23 05:13:57.741766] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:18.720 [2024-04-23 05:13:57.769711] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:18.720 [2024-04-23 05:13:57.857648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:18.978 05:13:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:18.978 05:13:57 -- common/autotest_common.sh@850 -- # return 0 00:29:18.978 05:13:57 -- host/digest.sh@86 -- # false 00:29:18.978 05:13:57 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:29:18.978 05:13:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:19.236 05:13:58 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:19.236 05:13:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:19.805 nvme0n1 00:29:19.805 05:13:58 -- host/digest.sh@92 -- # bperf_py perform_tests 00:29:19.805 05:13:58 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:19.805 Running I/O for 2 seconds... 00:29:22.345 00:29:22.345 Latency(us) 00:29:22.345 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:22.345 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:22.345 nvme0n1 : 2.01 18262.99 71.34 0.00 0.00 6997.81 3495.25 16699.54 00:29:22.345 =================================================================================================================== 00:29:22.345 Total : 18262.99 71.34 0.00 0.00 6997.81 3495.25 16699.54 00:29:22.345 0 00:29:22.345 05:14:00 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:29:22.345 05:14:00 -- host/digest.sh@93 -- # get_accel_stats 00:29:22.345 05:14:00 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:22.345 05:14:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:22.345 05:14:00 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:22.345 | select(.opcode=="crc32c") 00:29:22.345 | "\(.module_name) \(.executed)"' 00:29:22.345 05:14:01 -- host/digest.sh@94 -- # false 00:29:22.345 05:14:01 -- host/digest.sh@94 -- # exp_module=software 00:29:22.345 05:14:01 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:29:22.345 05:14:01 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:22.345 05:14:01 -- host/digest.sh@98 -- # killprocess 2517021 00:29:22.345 05:14:01 -- common/autotest_common.sh@936 -- # '[' -z 2517021 ']' 00:29:22.345 05:14:01 -- common/autotest_common.sh@940 -- # kill -0 2517021 00:29:22.345 05:14:01 -- common/autotest_common.sh@941 -- # uname 00:29:22.345 05:14:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:22.345 05:14:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2517021 00:29:22.345 05:14:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:22.345 05:14:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:22.345 05:14:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2517021' 00:29:22.345 killing process with pid 2517021 00:29:22.345 05:14:01 -- common/autotest_common.sh@955 -- # kill 2517021 00:29:22.345 Received shutdown signal, test time was about 2.000000 seconds 00:29:22.345 00:29:22.345 Latency(us) 00:29:22.345 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:22.345 =================================================================================================================== 00:29:22.345 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:22.345 05:14:01 -- common/autotest_common.sh@960 -- # wait 2517021 00:29:22.345 05:14:01 -- host/digest.sh@129 -- # run_bperf randread 131072 16 false 00:29:22.345 05:14:01 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:29:22.345 05:14:01 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:22.345 05:14:01 -- host/digest.sh@80 -- # rw=randread 00:29:22.345 05:14:01 -- host/digest.sh@80 -- # bs=131072 00:29:22.345 05:14:01 -- host/digest.sh@80 -- # qd=16 00:29:22.345 05:14:01 -- host/digest.sh@80 -- # scan_dsa=false 00:29:22.345 05:14:01 -- host/digest.sh@83 -- # bperfpid=2517430 00:29:22.345 05:14:01 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:22.345 05:14:01 -- host/digest.sh@84 -- # waitforlisten 2517430 /var/tmp/bperf.sock 00:29:22.345 05:14:01 -- common/autotest_common.sh@817 -- # '[' -z 2517430 ']' 00:29:22.345 05:14:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:22.345 05:14:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:22.345 05:14:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:22.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:22.345 05:14:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:22.345 05:14:01 -- common/autotest_common.sh@10 -- # set +x 00:29:22.346 [2024-04-23 05:14:01.448321] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:22.346 [2024-04-23 05:14:01.448397] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2517430 ] 00:29:22.346 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:22.346 Zero copy mechanism will not be used. 00:29:22.346 EAL: No free 2048 kB hugepages reported on node 1 00:29:22.346 [2024-04-23 05:14:01.481313] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:22.346 [2024-04-23 05:14:01.508820] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:22.604 [2024-04-23 05:14:01.598254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:22.604 05:14:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:22.604 05:14:01 -- common/autotest_common.sh@850 -- # return 0 00:29:22.604 05:14:01 -- host/digest.sh@86 -- # false 00:29:22.604 05:14:01 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:29:22.604 05:14:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:22.862 05:14:02 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:22.862 05:14:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:23.430 nvme0n1 00:29:23.430 05:14:02 -- host/digest.sh@92 -- # bperf_py perform_tests 00:29:23.430 05:14:02 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:23.430 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:23.430 Zero copy mechanism will not be used. 00:29:23.430 Running I/O for 2 seconds... 00:29:25.963 00:29:25.963 Latency(us) 00:29:25.963 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:25.963 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:25.963 nvme0n1 : 2.01 3275.69 409.46 0.00 0.00 4880.07 1116.54 6189.51 00:29:25.963 =================================================================================================================== 00:29:25.963 Total : 3275.69 409.46 0.00 0.00 4880.07 1116.54 6189.51 00:29:25.963 0 00:29:25.963 05:14:04 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:29:25.963 05:14:04 -- host/digest.sh@93 -- # get_accel_stats 00:29:25.963 05:14:04 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:25.963 05:14:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:25.963 05:14:04 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:25.963 | select(.opcode=="crc32c") 00:29:25.963 | "\(.module_name) \(.executed)"' 00:29:25.963 05:14:04 -- host/digest.sh@94 -- # false 00:29:25.963 05:14:04 -- host/digest.sh@94 -- # exp_module=software 00:29:25.963 05:14:04 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:29:25.963 05:14:04 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:25.963 05:14:04 -- host/digest.sh@98 -- # killprocess 2517430 00:29:25.963 05:14:04 -- common/autotest_common.sh@936 -- # '[' -z 2517430 ']' 00:29:25.963 05:14:04 -- common/autotest_common.sh@940 -- # kill -0 2517430 00:29:25.963 05:14:04 -- common/autotest_common.sh@941 -- # uname 00:29:25.963 05:14:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:25.963 05:14:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2517430 00:29:25.963 05:14:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:25.963 05:14:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:25.963 05:14:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2517430' 00:29:25.963 killing process with pid 2517430 00:29:25.963 05:14:04 -- common/autotest_common.sh@955 -- # kill 2517430 00:29:25.963 Received shutdown signal, test time was about 2.000000 seconds 00:29:25.963 00:29:25.963 Latency(us) 00:29:25.963 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:25.963 =================================================================================================================== 00:29:25.963 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:25.963 05:14:04 -- common/autotest_common.sh@960 -- # wait 2517430 00:29:25.963 05:14:05 -- host/digest.sh@130 -- # run_bperf randwrite 4096 128 false 00:29:25.963 05:14:05 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:29:25.963 05:14:05 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:25.963 05:14:05 -- host/digest.sh@80 -- # rw=randwrite 00:29:25.963 05:14:05 -- host/digest.sh@80 -- # bs=4096 00:29:25.963 05:14:05 -- host/digest.sh@80 -- # qd=128 00:29:25.963 05:14:05 -- host/digest.sh@80 -- # scan_dsa=false 00:29:25.963 05:14:05 -- host/digest.sh@83 -- # bperfpid=2517862 00:29:25.963 05:14:05 -- host/digest.sh@84 -- # waitforlisten 2517862 /var/tmp/bperf.sock 00:29:25.963 05:14:05 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:25.963 05:14:05 -- common/autotest_common.sh@817 -- # '[' -z 2517862 ']' 00:29:25.963 05:14:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:25.963 05:14:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:25.963 05:14:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:25.963 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:25.963 05:14:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:25.963 05:14:05 -- common/autotest_common.sh@10 -- # set +x 00:29:25.963 [2024-04-23 05:14:05.072624] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:25.963 [2024-04-23 05:14:05.072710] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2517862 ] 00:29:25.963 EAL: No free 2048 kB hugepages reported on node 1 00:29:25.963 [2024-04-23 05:14:05.106830] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:26.221 [2024-04-23 05:14:05.133797] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:26.221 [2024-04-23 05:14:05.221399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:26.221 05:14:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:26.221 05:14:05 -- common/autotest_common.sh@850 -- # return 0 00:29:26.221 05:14:05 -- host/digest.sh@86 -- # false 00:29:26.221 05:14:05 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:29:26.221 05:14:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:26.478 05:14:05 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:26.478 05:14:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:27.048 nvme0n1 00:29:27.048 05:14:06 -- host/digest.sh@92 -- # bperf_py perform_tests 00:29:27.048 05:14:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:27.048 Running I/O for 2 seconds... 00:29:29.588 00:29:29.588 Latency(us) 00:29:29.588 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:29.588 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:29.589 nvme0n1 : 2.01 18441.77 72.04 0.00 0.00 6929.82 4393.34 16699.54 00:29:29.589 =================================================================================================================== 00:29:29.589 Total : 18441.77 72.04 0.00 0.00 6929.82 4393.34 16699.54 00:29:29.589 0 00:29:29.589 05:14:08 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:29:29.589 05:14:08 -- host/digest.sh@93 -- # get_accel_stats 00:29:29.589 05:14:08 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:29.589 05:14:08 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:29.589 | select(.opcode=="crc32c") 00:29:29.589 | "\(.module_name) \(.executed)"' 00:29:29.589 05:14:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:29.589 05:14:08 -- host/digest.sh@94 -- # false 00:29:29.589 05:14:08 -- host/digest.sh@94 -- # exp_module=software 00:29:29.589 05:14:08 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:29:29.589 05:14:08 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:29.589 05:14:08 -- host/digest.sh@98 -- # killprocess 2517862 00:29:29.589 05:14:08 -- common/autotest_common.sh@936 -- # '[' -z 2517862 ']' 00:29:29.589 05:14:08 -- common/autotest_common.sh@940 -- # kill -0 2517862 00:29:29.589 05:14:08 -- common/autotest_common.sh@941 -- # uname 00:29:29.589 05:14:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:29.589 05:14:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2517862 00:29:29.589 05:14:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:29.589 05:14:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:29.589 05:14:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2517862' 00:29:29.589 killing process with pid 2517862 00:29:29.589 05:14:08 -- common/autotest_common.sh@955 -- # kill 2517862 00:29:29.589 Received shutdown signal, test time was about 2.000000 seconds 00:29:29.589 00:29:29.589 Latency(us) 00:29:29.589 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:29.589 =================================================================================================================== 00:29:29.589 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:29.589 05:14:08 -- common/autotest_common.sh@960 -- # wait 2517862 00:29:29.589 05:14:08 -- host/digest.sh@131 -- # run_bperf randwrite 131072 16 false 00:29:29.589 05:14:08 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:29:29.589 05:14:08 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:29.589 05:14:08 -- host/digest.sh@80 -- # rw=randwrite 00:29:29.589 05:14:08 -- host/digest.sh@80 -- # bs=131072 00:29:29.589 05:14:08 -- host/digest.sh@80 -- # qd=16 00:29:29.589 05:14:08 -- host/digest.sh@80 -- # scan_dsa=false 00:29:29.589 05:14:08 -- host/digest.sh@83 -- # bperfpid=2518360 00:29:29.589 05:14:08 -- host/digest.sh@84 -- # waitforlisten 2518360 /var/tmp/bperf.sock 00:29:29.589 05:14:08 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:29.589 05:14:08 -- common/autotest_common.sh@817 -- # '[' -z 2518360 ']' 00:29:29.589 05:14:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:29.589 05:14:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:29.589 05:14:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:29.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:29.589 05:14:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:29.589 05:14:08 -- common/autotest_common.sh@10 -- # set +x 00:29:29.847 [2024-04-23 05:14:08.785675] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:29.847 [2024-04-23 05:14:08.785750] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2518360 ] 00:29:29.847 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:29.847 Zero copy mechanism will not be used. 00:29:29.847 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.847 [2024-04-23 05:14:08.817003] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:29.847 [2024-04-23 05:14:08.848183] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:29.847 [2024-04-23 05:14:08.937612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:29.847 05:14:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:29.847 05:14:08 -- common/autotest_common.sh@850 -- # return 0 00:29:29.847 05:14:08 -- host/digest.sh@86 -- # false 00:29:29.847 05:14:08 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:29:29.847 05:14:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:30.414 05:14:09 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.414 05:14:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.674 nvme0n1 00:29:30.674 05:14:09 -- host/digest.sh@92 -- # bperf_py perform_tests 00:29:30.674 05:14:09 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:30.674 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:30.674 Zero copy mechanism will not be used. 00:29:30.674 Running I/O for 2 seconds... 00:29:33.212 00:29:33.212 Latency(us) 00:29:33.212 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:33.212 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:33.212 nvme0n1 : 2.00 4148.29 518.54 0.00 0.00 3848.73 2900.57 6553.60 00:29:33.212 =================================================================================================================== 00:29:33.212 Total : 4148.29 518.54 0.00 0.00 3848.73 2900.57 6553.60 00:29:33.212 0 00:29:33.212 05:14:11 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:29:33.212 05:14:11 -- host/digest.sh@93 -- # get_accel_stats 00:29:33.212 05:14:11 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:33.212 05:14:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:33.212 05:14:11 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:33.212 | select(.opcode=="crc32c") 00:29:33.212 | "\(.module_name) \(.executed)"' 00:29:33.212 05:14:12 -- host/digest.sh@94 -- # false 00:29:33.212 05:14:12 -- host/digest.sh@94 -- # exp_module=software 00:29:33.212 05:14:12 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:29:33.212 05:14:12 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:33.212 05:14:12 -- host/digest.sh@98 -- # killprocess 2518360 00:29:33.212 05:14:12 -- common/autotest_common.sh@936 -- # '[' -z 2518360 ']' 00:29:33.212 05:14:12 -- common/autotest_common.sh@940 -- # kill -0 2518360 00:29:33.212 05:14:12 -- common/autotest_common.sh@941 -- # uname 00:29:33.212 05:14:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:33.212 05:14:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2518360 00:29:33.212 05:14:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:33.212 05:14:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:33.212 05:14:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2518360' 00:29:33.212 killing process with pid 2518360 00:29:33.212 05:14:12 -- common/autotest_common.sh@955 -- # kill 2518360 00:29:33.212 Received shutdown signal, test time was about 2.000000 seconds 00:29:33.212 00:29:33.212 Latency(us) 00:29:33.212 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:33.212 =================================================================================================================== 00:29:33.212 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:33.212 05:14:12 -- common/autotest_common.sh@960 -- # wait 2518360 00:29:33.212 05:14:12 -- host/digest.sh@132 -- # killprocess 2516999 00:29:33.212 05:14:12 -- common/autotest_common.sh@936 -- # '[' -z 2516999 ']' 00:29:33.212 05:14:12 -- common/autotest_common.sh@940 -- # kill -0 2516999 00:29:33.212 05:14:12 -- common/autotest_common.sh@941 -- # uname 00:29:33.212 05:14:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:33.212 05:14:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2516999 00:29:33.212 05:14:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:33.212 05:14:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:33.212 05:14:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2516999' 00:29:33.212 killing process with pid 2516999 00:29:33.212 05:14:12 -- common/autotest_common.sh@955 -- # kill 2516999 00:29:33.212 05:14:12 -- common/autotest_common.sh@960 -- # wait 2516999 00:29:33.472 00:29:33.472 real 0m15.318s 00:29:33.472 user 0m29.601s 00:29:33.472 sys 0m4.278s 00:29:33.472 05:14:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:33.472 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:29:33.472 ************************************ 00:29:33.472 END TEST nvmf_digest_clean 00:29:33.472 ************************************ 00:29:33.472 05:14:12 -- host/digest.sh@147 -- # run_test nvmf_digest_error run_digest_error 00:29:33.472 05:14:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:33.472 05:14:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:33.472 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:29:33.732 ************************************ 00:29:33.732 START TEST nvmf_digest_error 00:29:33.732 ************************************ 00:29:33.732 05:14:12 -- common/autotest_common.sh@1111 -- # run_digest_error 00:29:33.732 05:14:12 -- host/digest.sh@102 -- # nvmfappstart --wait-for-rpc 00:29:33.732 05:14:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:29:33.732 05:14:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:33.732 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:29:33.732 05:14:12 -- nvmf/common.sh@470 -- # nvmfpid=2518807 00:29:33.732 05:14:12 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:33.732 05:14:12 -- nvmf/common.sh@471 -- # waitforlisten 2518807 00:29:33.732 05:14:12 -- common/autotest_common.sh@817 -- # '[' -z 2518807 ']' 00:29:33.732 05:14:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:33.732 05:14:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:33.732 05:14:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:33.732 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:33.732 05:14:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:33.732 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:29:33.732 [2024-04-23 05:14:12.748676] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:33.732 [2024-04-23 05:14:12.748781] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:33.732 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.732 [2024-04-23 05:14:12.791340] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:33.732 [2024-04-23 05:14:12.819086] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:33.991 [2024-04-23 05:14:12.915645] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:33.991 [2024-04-23 05:14:12.915703] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:33.991 [2024-04-23 05:14:12.915731] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:33.991 [2024-04-23 05:14:12.915744] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:33.991 [2024-04-23 05:14:12.915754] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:33.991 [2024-04-23 05:14:12.915791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:33.991 05:14:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:33.991 05:14:12 -- common/autotest_common.sh@850 -- # return 0 00:29:33.991 05:14:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:29:33.991 05:14:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:33.991 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:29:33.991 05:14:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:33.991 05:14:12 -- host/digest.sh@104 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:33.991 05:14:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:33.991 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:29:33.991 [2024-04-23 05:14:12.984403] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:33.991 05:14:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:33.991 05:14:12 -- host/digest.sh@105 -- # common_target_config 00:29:33.991 05:14:12 -- host/digest.sh@43 -- # rpc_cmd 00:29:33.991 05:14:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:33.991 05:14:12 -- common/autotest_common.sh@10 -- # set +x 00:29:33.991 null0 00:29:33.991 [2024-04-23 05:14:13.093974] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:33.991 [2024-04-23 05:14:13.118190] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:33.991 05:14:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:33.991 05:14:13 -- host/digest.sh@108 -- # run_bperf_err randread 4096 128 00:29:33.991 05:14:13 -- host/digest.sh@54 -- # local rw bs qd 00:29:33.991 05:14:13 -- host/digest.sh@56 -- # rw=randread 00:29:33.991 05:14:13 -- host/digest.sh@56 -- # bs=4096 00:29:33.991 05:14:13 -- host/digest.sh@56 -- # qd=128 00:29:33.991 05:14:13 -- host/digest.sh@58 -- # bperfpid=2518953 00:29:33.991 05:14:13 -- host/digest.sh@60 -- # waitforlisten 2518953 /var/tmp/bperf.sock 00:29:33.991 05:14:13 -- common/autotest_common.sh@817 -- # '[' -z 2518953 ']' 00:29:33.991 05:14:13 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:33.991 05:14:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:33.991 05:14:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:33.991 05:14:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:33.991 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:33.991 05:14:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:33.991 05:14:13 -- common/autotest_common.sh@10 -- # set +x 00:29:34.252 [2024-04-23 05:14:13.166982] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:34.252 [2024-04-23 05:14:13.167054] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2518953 ] 00:29:34.252 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.252 [2024-04-23 05:14:13.198755] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:34.252 [2024-04-23 05:14:13.225975] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:34.252 [2024-04-23 05:14:13.312884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:34.517 05:14:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:34.517 05:14:13 -- common/autotest_common.sh@850 -- # return 0 00:29:34.517 05:14:13 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:34.517 05:14:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:34.796 05:14:13 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:34.796 05:14:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:34.796 05:14:13 -- common/autotest_common.sh@10 -- # set +x 00:29:34.796 05:14:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:34.796 05:14:13 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.796 05:14:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:35.054 nvme0n1 00:29:35.054 05:14:14 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:35.054 05:14:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:35.054 05:14:14 -- common/autotest_common.sh@10 -- # set +x 00:29:35.054 05:14:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:35.054 05:14:14 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:35.054 05:14:14 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:35.314 Running I/O for 2 seconds... 00:29:35.314 [2024-04-23 05:14:14.251219] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.314 [2024-04-23 05:14:14.251297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:11543 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.314 [2024-04-23 05:14:14.251320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.314 [2024-04-23 05:14:14.263771] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.314 [2024-04-23 05:14:14.263819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:2568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.314 [2024-04-23 05:14:14.263840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.314 [2024-04-23 05:14:14.280905] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.314 [2024-04-23 05:14:14.280942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.314 [2024-04-23 05:14:14.280972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.295589] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.295620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:14140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.295637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.308601] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.308631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:3005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.308648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.322845] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.322873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:22446 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.322904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.336442] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.336489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:13462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.336508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.351125] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.351170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.351187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.366525] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.366571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:15805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.366589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.378063] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.378096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:25490 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.378115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.392880] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.392912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:21255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.392932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.405760] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.405796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23897 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.405814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.419209] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.419242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24065 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.419262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.435755] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.435786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:14956 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.435802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.448753] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.448782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17053 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.448814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.461193] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.461220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:2179 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.461250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.315 [2024-04-23 05:14:14.474745] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.315 [2024-04-23 05:14:14.474773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:22247 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.315 [2024-04-23 05:14:14.474805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.489149] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.489184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:20453 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.489203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.502976] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.503006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:4527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.503023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.516621] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.516651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20378 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.516668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.530070] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.530103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:24638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.530121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.543851] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.543894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:151 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.543913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.558339] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.558372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:12034 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.558391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.574385] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.574413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:7154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.574443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.589658] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.589687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.589718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.606477] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.606511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:16397 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.606542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.617307] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.617340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:3020 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.617359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.634142] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.634175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:22730 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.634193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.575 [2024-04-23 05:14:14.649947] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.575 [2024-04-23 05:14:14.649981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:20130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.575 [2024-04-23 05:14:14.650006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.576 [2024-04-23 05:14:14.666738] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.576 [2024-04-23 05:14:14.666767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9917 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.576 [2024-04-23 05:14:14.666798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.576 [2024-04-23 05:14:14.681134] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.576 [2024-04-23 05:14:14.681167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:10673 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.576 [2024-04-23 05:14:14.681186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.576 [2024-04-23 05:14:14.692958] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.576 [2024-04-23 05:14:14.692992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:7510 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.576 [2024-04-23 05:14:14.693012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.576 [2024-04-23 05:14:14.709068] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.576 [2024-04-23 05:14:14.709101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:1147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.576 [2024-04-23 05:14:14.709119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.576 [2024-04-23 05:14:14.720225] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.576 [2024-04-23 05:14:14.720253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.576 [2024-04-23 05:14:14.720284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.576 [2024-04-23 05:14:14.736439] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.576 [2024-04-23 05:14:14.736473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:12489 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.576 [2024-04-23 05:14:14.736492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.751119] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.751153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4790 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.751173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.764854] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.764884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14426 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.764901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.775805] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.775847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:13418 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.775863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.789344] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.789372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:22934 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.789402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.802860] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.802888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:24061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.802918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.816559] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.816588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:20284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.816606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.830286] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.830316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:11017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.830333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.841494] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.841531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.841549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.854798] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.854827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13866 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.854858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.868944] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.868974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8080 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.868990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.880602] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.880631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:12329 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.880654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.895655] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.895684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:22686 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.895714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.910439] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.910470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:23088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.910487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.927546] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.927576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:4915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.927608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.942984] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.943013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:20213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.943046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.953827] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.953857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:14354 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.953888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.969665] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.969697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:4849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.969714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.983253] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.983284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.983301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.836 [2024-04-23 05:14:14.994532] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:35.836 [2024-04-23 05:14:14.994571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:12167 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.836 [2024-04-23 05:14:14.994602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.009657] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.009707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4018 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.009740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.020780] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.020807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:23870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.020839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.034837] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.034868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.034900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.048495] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.048535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6374 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.048553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.060929] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.060957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:8246 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.060972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.074645] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.074674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:21463 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.074705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.089871] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.089900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20010 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.089931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.101311] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.101341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:13071 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.101358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.116042] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.116071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:1729 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.116087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.127136] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.127166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:18799 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.127182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.139981] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.140009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.140040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.154089] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.154131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:13545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.154146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.096 [2024-04-23 05:14:15.165467] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.096 [2024-04-23 05:14:15.165495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:3819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.096 [2024-04-23 05:14:15.165533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.097 [2024-04-23 05:14:15.179380] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.097 [2024-04-23 05:14:15.179410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:5801 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.097 [2024-04-23 05:14:15.179427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.097 [2024-04-23 05:14:15.193700] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.097 [2024-04-23 05:14:15.193729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:14565 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.097 [2024-04-23 05:14:15.193747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.097 [2024-04-23 05:14:15.204096] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.097 [2024-04-23 05:14:15.204123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.097 [2024-04-23 05:14:15.204154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.097 [2024-04-23 05:14:15.217074] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.097 [2024-04-23 05:14:15.217101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:13494 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.097 [2024-04-23 05:14:15.217131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.097 [2024-04-23 05:14:15.231349] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.097 [2024-04-23 05:14:15.231377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:3091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.097 [2024-04-23 05:14:15.231414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.097 [2024-04-23 05:14:15.243738] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.097 [2024-04-23 05:14:15.243767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:8203 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.097 [2024-04-23 05:14:15.243784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.097 [2024-04-23 05:14:15.256758] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.097 [2024-04-23 05:14:15.256809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:15879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.097 [2024-04-23 05:14:15.256824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.271936] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.271964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16026 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.271994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.282893] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.282921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:11314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.282951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.297761] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.297792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14287 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.297809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.312323] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.312354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:12238 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.312370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.323779] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.323808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:4989 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.323839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.340104] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.340143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:23925 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.340175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.354562] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.354595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:20877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.354612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.365547] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.365576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:19022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.365606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.380447] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.380478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.380494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.392133] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.392163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.392180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.406512] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.406548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:21 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.406580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.419478] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.419508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.419534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.432070] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.432099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:18433 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.432130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.445948] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.445976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:8416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.446006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.462278] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.462308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:10657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.462336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.476640] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.476670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:9929 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.476687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.487995] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.488025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.488042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.502373] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.356 [2024-04-23 05:14:15.502400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:18843 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.356 [2024-04-23 05:14:15.502430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.356 [2024-04-23 05:14:15.518789] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.357 [2024-04-23 05:14:15.518820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:1504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.357 [2024-04-23 05:14:15.518836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.532269] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.532299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:10951 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.532316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.543338] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.543366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:24112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.543397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.557111] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.557138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.557170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.570994] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.571023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24560 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.571040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.584766] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.584804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:4995 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.584822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.597195] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.597225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18635 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.597242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.609130] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.609158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:19986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.609188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.615 [2024-04-23 05:14:15.622649] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.615 [2024-04-23 05:14:15.622678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:16479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.615 [2024-04-23 05:14:15.622695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.638044] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.638075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22615 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.638091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.654446] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.654477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14581 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.654494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.665205] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.665235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:15873 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.665252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.679439] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.679470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:19241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.679487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.690616] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.690647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:14219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.690664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.706904] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.706932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:12451 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.706963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.717819] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.717847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:14961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.717863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.733468] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.733497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:18877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.733521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.748697] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.748726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:21594 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.748757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.760796] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.760838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:16956 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.760854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.616 [2024-04-23 05:14:15.773616] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.616 [2024-04-23 05:14:15.773646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10577 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.616 [2024-04-23 05:14:15.773663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.788106] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.788136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:10488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.788153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.800847] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.800878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:12524 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.800894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.812613] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.812642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:23187 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.812682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.825948] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.825976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:16003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.826006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.839665] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.839709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:7974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.839725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.857667] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.857695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:10331 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.857726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.875244] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.875278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21232 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.875297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.889297] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.889330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:4569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.889349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.874 [2024-04-23 05:14:15.906763] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.874 [2024-04-23 05:14:15.906793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:16902 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.874 [2024-04-23 05:14:15.906809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:15.918980] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:15.919013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:21681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:15.919032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:15.934147] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:15.934181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19207 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:15.934199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:15.950845] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:15.950880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:17685 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:15.950898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:15.965156] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:15.965201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:15.965218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:15.982379] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:15.982413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:8422 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:15.982433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:15.994863] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:15.994892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:25342 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:15.994924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:16.010337] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:16.010370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25063 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:16.010389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:16.023939] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:16.023969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:25090 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:16.023986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.875 [2024-04-23 05:14:16.037525] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:36.875 [2024-04-23 05:14:16.037571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5862 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.875 [2024-04-23 05:14:16.037588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.050483] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.050510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:3434 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.050550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.063731] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.063761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20465 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.063784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.078545] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.078590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.078607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.092228] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.092257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.092273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.108554] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.108602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.108619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.125129] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.125159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:12998 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.125176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.136057] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.136089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:3991 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.136107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.153941] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.153971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8855 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.153988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.170149] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.170184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:10282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.170203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.181962] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.181995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:22502 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.182014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.198210] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.198249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:8282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.198268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.211211] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.211254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:7373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.211269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.224722] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.224751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:19417 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.224768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 [2024-04-23 05:14:16.236707] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15e9980) 00:29:37.133 [2024-04-23 05:14:16.236734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:20675 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.133 [2024-04-23 05:14:16.236765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.133 00:29:37.133 Latency(us) 00:29:37.133 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.134 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:37.134 nvme0n1 : 2.05 17958.45 70.15 0.00 0.00 6976.46 3398.16 45632.47 00:29:37.134 =================================================================================================================== 00:29:37.134 Total : 17958.45 70.15 0.00 0.00 6976.46 3398.16 45632.47 00:29:37.134 0 00:29:37.134 05:14:16 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:37.134 05:14:16 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:37.134 05:14:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:37.134 05:14:16 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:37.134 | .driver_specific 00:29:37.134 | .nvme_error 00:29:37.134 | .status_code 00:29:37.134 | .command_transient_transport_error' 00:29:37.391 05:14:16 -- host/digest.sh@71 -- # (( 144 > 0 )) 00:29:37.392 05:14:16 -- host/digest.sh@73 -- # killprocess 2518953 00:29:37.392 05:14:16 -- common/autotest_common.sh@936 -- # '[' -z 2518953 ']' 00:29:37.392 05:14:16 -- common/autotest_common.sh@940 -- # kill -0 2518953 00:29:37.392 05:14:16 -- common/autotest_common.sh@941 -- # uname 00:29:37.650 05:14:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:37.650 05:14:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2518953 00:29:37.650 05:14:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:37.650 05:14:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:37.650 05:14:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2518953' 00:29:37.650 killing process with pid 2518953 00:29:37.650 05:14:16 -- common/autotest_common.sh@955 -- # kill 2518953 00:29:37.650 Received shutdown signal, test time was about 2.000000 seconds 00:29:37.650 00:29:37.650 Latency(us) 00:29:37.650 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.650 =================================================================================================================== 00:29:37.650 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:37.650 05:14:16 -- common/autotest_common.sh@960 -- # wait 2518953 00:29:37.650 05:14:16 -- host/digest.sh@109 -- # run_bperf_err randread 131072 16 00:29:37.650 05:14:16 -- host/digest.sh@54 -- # local rw bs qd 00:29:37.650 05:14:16 -- host/digest.sh@56 -- # rw=randread 00:29:37.650 05:14:16 -- host/digest.sh@56 -- # bs=131072 00:29:37.650 05:14:16 -- host/digest.sh@56 -- # qd=16 00:29:37.908 05:14:16 -- host/digest.sh@58 -- # bperfpid=2519354 00:29:37.908 05:14:16 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:37.908 05:14:16 -- host/digest.sh@60 -- # waitforlisten 2519354 /var/tmp/bperf.sock 00:29:37.908 05:14:16 -- common/autotest_common.sh@817 -- # '[' -z 2519354 ']' 00:29:37.908 05:14:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:37.908 05:14:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:37.908 05:14:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:37.908 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:37.908 05:14:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:37.908 05:14:16 -- common/autotest_common.sh@10 -- # set +x 00:29:37.908 [2024-04-23 05:14:16.857573] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:37.908 [2024-04-23 05:14:16.857646] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2519354 ] 00:29:37.908 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:37.908 Zero copy mechanism will not be used. 00:29:37.908 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.908 [2024-04-23 05:14:16.889052] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:37.908 [2024-04-23 05:14:16.916189] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:37.908 [2024-04-23 05:14:17.003856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:38.165 05:14:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:38.165 05:14:17 -- common/autotest_common.sh@850 -- # return 0 00:29:38.165 05:14:17 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:38.165 05:14:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:38.422 05:14:17 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:38.422 05:14:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:38.422 05:14:17 -- common/autotest_common.sh@10 -- # set +x 00:29:38.422 05:14:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:38.422 05:14:17 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.422 05:14:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.989 nvme0n1 00:29:38.989 05:14:17 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:38.989 05:14:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:38.989 05:14:17 -- common/autotest_common.sh@10 -- # set +x 00:29:38.989 05:14:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:38.989 05:14:17 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:38.989 05:14:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:38.989 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:38.989 Zero copy mechanism will not be used. 00:29:38.989 Running I/O for 2 seconds... 00:29:38.989 [2024-04-23 05:14:18.009973] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.010039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.010077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.018102] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.018138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.018157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.026026] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.026060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.026079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.033834] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.033862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.033878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.041584] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.041612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.041643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.049390] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.049422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.049440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.057206] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.057238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.057256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.065044] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.065075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.065093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.073005] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.073037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.073055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.080764] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.080798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.080830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.088530] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.088574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.088590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.096320] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.096352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.096371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.104079] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.104110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.104129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.111972] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.112004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.112023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.119907] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.119940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.119959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.127667] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.127695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.127726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.135394] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.135427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.135445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.143318] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.143350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.143373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.989 [2024-04-23 05:14:18.151144] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:38.989 [2024-04-23 05:14:18.151175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.989 [2024-04-23 05:14:18.151193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.248 [2024-04-23 05:14:18.158990] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.159022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.159039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.166771] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.166814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.166832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.174589] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.174631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.174648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.181807] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.181834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.181865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.188942] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.188969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.189000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.195925] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.195952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.195982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.202983] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.203024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.203039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.210269] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.210307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.210326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.218210] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.218242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.218261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.226044] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.226076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.226094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.233888] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.233921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.233939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.241675] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.241703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.241719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.249561] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.249589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.249604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.257354] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.257385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.257403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.265203] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.265235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.265253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.272987] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.273020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.273037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.280751] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.280779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.280810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.288579] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.288608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.288625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.296404] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.296436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.296455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.304126] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.304157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.304176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.311998] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.312030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.312047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.319867] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.319898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.319917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.327735] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.327762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.327792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.335408] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.335440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.335459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.343269] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.343302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.343326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.351003] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.351035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.351054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.249 [2024-04-23 05:14:18.358757] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.249 [2024-04-23 05:14:18.358785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.249 [2024-04-23 05:14:18.358815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.250 [2024-04-23 05:14:18.366542] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.250 [2024-04-23 05:14:18.366585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.250 [2024-04-23 05:14:18.366601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.250 [2024-04-23 05:14:18.374270] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.250 [2024-04-23 05:14:18.374302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.250 [2024-04-23 05:14:18.374320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.250 [2024-04-23 05:14:18.381981] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.250 [2024-04-23 05:14:18.382014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.250 [2024-04-23 05:14:18.382032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.250 [2024-04-23 05:14:18.389833] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.250 [2024-04-23 05:14:18.389865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.250 [2024-04-23 05:14:18.389883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.250 [2024-04-23 05:14:18.397715] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.250 [2024-04-23 05:14:18.397743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.250 [2024-04-23 05:14:18.397774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.250 [2024-04-23 05:14:18.405398] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.250 [2024-04-23 05:14:18.405429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.250 [2024-04-23 05:14:18.405447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.250 [2024-04-23 05:14:18.413352] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.250 [2024-04-23 05:14:18.413384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.250 [2024-04-23 05:14:18.413402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.421283] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.421315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.421333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.429064] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.429096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.429114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.436843] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.436889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.436908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.444658] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.444687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.444703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.452513] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.452565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.452582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.460321] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.460353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.460371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.468115] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.468146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.468164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.475967] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.475998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.476022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.483755] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.483782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.483813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.491700] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.491729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.491760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.499714] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.499743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.499760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.507415] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.507446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.507465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.515172] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.515203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.515220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.522954] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.522986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.523004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.531024] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.531055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.531073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.539021] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.539052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.539070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.546848] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.546900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.546919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.554640] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.554667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.554684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.562352] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.562384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.562402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.570133] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.570165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.570183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.577896] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.577928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.509 [2024-04-23 05:14:18.577946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.509 [2024-04-23 05:14:18.585659] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.509 [2024-04-23 05:14:18.585687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.585703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.593328] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.593360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.593378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.601096] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.601127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.601145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.609073] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.609106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.609124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.616799] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.616826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.616841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.624606] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.624635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.624651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.632218] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.632251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.632270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.639987] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.640020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.640037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.647737] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.647765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.647781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.655622] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.655651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.655682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.663632] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.663658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.663689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.510 [2024-04-23 05:14:18.671338] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.510 [2024-04-23 05:14:18.671376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.510 [2024-04-23 05:14:18.671394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.679165] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.769 [2024-04-23 05:14:18.679197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.769 [2024-04-23 05:14:18.679221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.686942] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.769 [2024-04-23 05:14:18.686974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.769 [2024-04-23 05:14:18.686992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.694760] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.769 [2024-04-23 05:14:18.694787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.769 [2024-04-23 05:14:18.694817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.702697] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.769 [2024-04-23 05:14:18.702725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.769 [2024-04-23 05:14:18.702756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.710509] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.769 [2024-04-23 05:14:18.710563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.769 [2024-04-23 05:14:18.710579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.718381] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.769 [2024-04-23 05:14:18.718414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.769 [2024-04-23 05:14:18.718432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.726211] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.769 [2024-04-23 05:14:18.726242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.769 [2024-04-23 05:14:18.726261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.769 [2024-04-23 05:14:18.734008] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.734039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.734057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.741868] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.741894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.741910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.749709] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.749737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.749768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.757632] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.757662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.757694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.765544] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.765588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.765604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.773375] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.773407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.773425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.781177] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.781209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.781227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.788939] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.788971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.788988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.796925] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.796957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.796976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.804638] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.804668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.804699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.812450] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.812483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.812507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.820291] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.820323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.820341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.828248] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.828280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.828298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.835996] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.836028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.836047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.843526] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.843560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.843592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.851404] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.851437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.851455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.859157] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.859189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.859207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.866899] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.866931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.866949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.874607] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.874635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.874667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.882406] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.882443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.882462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.890211] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.890244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.890262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.897920] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.897952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.897970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.905856] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.905898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.905914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.913831] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.913864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.913883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.921680] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.921708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.921739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.770 [2024-04-23 05:14:18.929452] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:39.770 [2024-04-23 05:14:18.929484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.770 [2024-04-23 05:14:18.929503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.937299] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.937332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.937351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.945016] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.945047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.945066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.952781] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.952824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.952840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.960524] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.960570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.960586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.968361] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.968393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.968411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.976156] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.976188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.976206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.984021] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.984052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.984070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.991890] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.991922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.991940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:18.999813] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:18.999840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:18.999872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.007750] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.007777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.007807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.015407] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.015440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.015467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.022746] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.022775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.022791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.030466] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.030498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.030525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.038288] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.038319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.038337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.046026] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.046057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.046074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.053784] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.053829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.053844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.061491] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.061530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.061565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.069355] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.069388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.069406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.077067] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.077099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.077117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.084903] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.084936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.084954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.092683] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.092711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.092727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.100502] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.100545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.100564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.108296] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.108328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.108346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.030 [2024-04-23 05:14:19.115973] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.030 [2024-04-23 05:14:19.116006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.030 [2024-04-23 05:14:19.116024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.123753] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.123782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.123813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.131586] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.131615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.131631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.139324] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.139356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.139374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.147027] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.147060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.147084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.154824] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.154871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.154890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.162625] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.162654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.162669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.170364] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.170396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.170415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.178213] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.178245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.178264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.186004] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.186036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.186055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.031 [2024-04-23 05:14:19.193772] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.031 [2024-04-23 05:14:19.193814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.031 [2024-04-23 05:14:19.193830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.201720] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.201749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.201764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.209377] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.209409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.209427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.217035] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.217073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.217092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.224733] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.224762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.224779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.232670] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.232715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.232731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.240608] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.240652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.240668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.248355] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.248388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.248406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.256083] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.256116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.256134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.263833] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.263879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.263898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.271631] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.271659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.271675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.279452] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.290 [2024-04-23 05:14:19.279484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.290 [2024-04-23 05:14:19.279502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.290 [2024-04-23 05:14:19.287311] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.287343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.287361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.295269] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.295301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.295320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.303012] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.303045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.303063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.310778] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.310821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.310837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.318450] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.318483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.318501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.326335] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.326367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.326386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.334119] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.334150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.334168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.341971] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.342004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.342023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.349729] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.349757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.349779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.357426] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.357458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.357477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.365141] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.365174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.365193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.372935] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.372968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.372986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.380652] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.380680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.380696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.388301] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.388333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.388351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.396004] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.396036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.396055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.403748] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.403775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.403791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.411595] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.411639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.411655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.419389] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.419421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.419440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.427281] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.427314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.427332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.435114] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.435146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.435164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.442924] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.442957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.442975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.291 [2024-04-23 05:14:19.450734] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.291 [2024-04-23 05:14:19.450762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.291 [2024-04-23 05:14:19.450777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.550 [2024-04-23 05:14:19.458809] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.550 [2024-04-23 05:14:19.458838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.550 [2024-04-23 05:14:19.458869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.550 [2024-04-23 05:14:19.466665] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.550 [2024-04-23 05:14:19.466694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.550 [2024-04-23 05:14:19.466710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.550 [2024-04-23 05:14:19.474344] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.550 [2024-04-23 05:14:19.474376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.550 [2024-04-23 05:14:19.474395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.550 [2024-04-23 05:14:19.482009] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.550 [2024-04-23 05:14:19.482042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.550 [2024-04-23 05:14:19.482066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.550 [2024-04-23 05:14:19.489875] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.550 [2024-04-23 05:14:19.489907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.550 [2024-04-23 05:14:19.489925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.497599] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.497628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.497645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.505293] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.505325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.505344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.513002] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.513034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.513053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.520787] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.520817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.520851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.528457] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.528489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.528507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.536319] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.536352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.536370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.543986] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.544018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.544037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.551683] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.551718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.551736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.559408] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.559440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.559458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.567129] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.567161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.567179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.574883] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.574915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.574934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.582900] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.582932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.582951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.590831] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.590873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.590892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.598621] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.598648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.598664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.606323] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.606356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.606375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.614175] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.614206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.614225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.622284] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.622317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.622336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.630029] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.630062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.630080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.637881] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.637914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.637933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.645600] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.645629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.645645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.653255] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.653287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.653306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.661038] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.661070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.661088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.668804] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.668850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.668869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.676809] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.676839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.676875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.684576] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.684610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.684628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.692390] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.692422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.692440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.551 [2024-04-23 05:14:19.700115] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.551 [2024-04-23 05:14:19.700148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.551 [2024-04-23 05:14:19.700166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.552 [2024-04-23 05:14:19.707876] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.552 [2024-04-23 05:14:19.707911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.552 [2024-04-23 05:14:19.707930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.810 [2024-04-23 05:14:19.715655] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.810 [2024-04-23 05:14:19.715684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.810 [2024-04-23 05:14:19.715700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.810 [2024-04-23 05:14:19.723554] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.810 [2024-04-23 05:14:19.723600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.723616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.731370] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.731402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.731420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.739140] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.739172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.739190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.746824] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.746867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.746883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.755852] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.755899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.755919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.763319] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.763351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.763370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.770982] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.771015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.771034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.778750] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.778779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.778811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.786715] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.786745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.786761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.794690] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.794719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.794735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.804069] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.804103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.804122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.813230] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.813265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.813286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.822817] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.822867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.822892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.832575] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.832607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.832640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.842105] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.842140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.842160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.850703] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.850734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.850765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.858712] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.858756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.858772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.866593] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.866638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.866655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.874498] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.874549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.874582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.882472] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.882526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.882547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.890456] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.890489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.890508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.897865] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.897903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.897923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.905699] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.905728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.905747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.913474] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.913512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.913541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.921281] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.921313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.921333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.929219] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.929251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.929270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.936993] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.937026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.811 [2024-04-23 05:14:19.937045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:40.811 [2024-04-23 05:14:19.944827] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.811 [2024-04-23 05:14:19.944870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.812 [2024-04-23 05:14:19.944890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.812 [2024-04-23 05:14:19.952821] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.812 [2024-04-23 05:14:19.952851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.812 [2024-04-23 05:14:19.952884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:40.812 [2024-04-23 05:14:19.960995] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.812 [2024-04-23 05:14:19.961028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.812 [2024-04-23 05:14:19.961047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:40.812 [2024-04-23 05:14:19.968817] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:40.812 [2024-04-23 05:14:19.968848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:40.812 [2024-04-23 05:14:19.968893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.070 [2024-04-23 05:14:19.976678] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:41.070 [2024-04-23 05:14:19.976708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.070 [2024-04-23 05:14:19.976725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:41.070 [2024-04-23 05:14:19.984384] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:41.070 [2024-04-23 05:14:19.984416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.070 [2024-04-23 05:14:19.984435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:41.070 [2024-04-23 05:14:19.992225] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:41.070 [2024-04-23 05:14:19.992257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.070 [2024-04-23 05:14:19.992275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:41.071 [2024-04-23 05:14:19.999902] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x10ea5f0) 00:29:41.071 [2024-04-23 05:14:19.999934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:41.071 [2024-04-23 05:14:19.999953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:41.071 00:29:41.071 Latency(us) 00:29:41.071 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.071 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:41.071 nvme0n1 : 2.00 3950.54 493.82 0.00 0.00 4044.70 1237.90 12524.66 00:29:41.071 =================================================================================================================== 00:29:41.071 Total : 3950.54 493.82 0.00 0.00 4044.70 1237.90 12524.66 00:29:41.071 0 00:29:41.071 05:14:20 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:41.071 05:14:20 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:41.071 05:14:20 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:41.071 | .driver_specific 00:29:41.071 | .nvme_error 00:29:41.071 | .status_code 00:29:41.071 | .command_transient_transport_error' 00:29:41.071 05:14:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:41.330 05:14:20 -- host/digest.sh@71 -- # (( 255 > 0 )) 00:29:41.330 05:14:20 -- host/digest.sh@73 -- # killprocess 2519354 00:29:41.330 05:14:20 -- common/autotest_common.sh@936 -- # '[' -z 2519354 ']' 00:29:41.330 05:14:20 -- common/autotest_common.sh@940 -- # kill -0 2519354 00:29:41.330 05:14:20 -- common/autotest_common.sh@941 -- # uname 00:29:41.330 05:14:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:41.330 05:14:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2519354 00:29:41.330 05:14:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:41.330 05:14:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:41.330 05:14:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2519354' 00:29:41.330 killing process with pid 2519354 00:29:41.330 05:14:20 -- common/autotest_common.sh@955 -- # kill 2519354 00:29:41.330 Received shutdown signal, test time was about 2.000000 seconds 00:29:41.330 00:29:41.330 Latency(us) 00:29:41.330 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.330 =================================================================================================================== 00:29:41.330 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:41.330 05:14:20 -- common/autotest_common.sh@960 -- # wait 2519354 00:29:41.588 05:14:20 -- host/digest.sh@114 -- # run_bperf_err randwrite 4096 128 00:29:41.588 05:14:20 -- host/digest.sh@54 -- # local rw bs qd 00:29:41.588 05:14:20 -- host/digest.sh@56 -- # rw=randwrite 00:29:41.588 05:14:20 -- host/digest.sh@56 -- # bs=4096 00:29:41.588 05:14:20 -- host/digest.sh@56 -- # qd=128 00:29:41.588 05:14:20 -- host/digest.sh@58 -- # bperfpid=2519764 00:29:41.588 05:14:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:41.588 05:14:20 -- host/digest.sh@60 -- # waitforlisten 2519764 /var/tmp/bperf.sock 00:29:41.588 05:14:20 -- common/autotest_common.sh@817 -- # '[' -z 2519764 ']' 00:29:41.588 05:14:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:41.588 05:14:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:41.588 05:14:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:41.588 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:41.588 05:14:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:41.588 05:14:20 -- common/autotest_common.sh@10 -- # set +x 00:29:41.588 [2024-04-23 05:14:20.587263] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:41.588 [2024-04-23 05:14:20.587348] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2519764 ] 00:29:41.588 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.588 [2024-04-23 05:14:20.618642] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:41.588 [2024-04-23 05:14:20.650018] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:41.588 [2024-04-23 05:14:20.735716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:41.847 05:14:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:41.847 05:14:20 -- common/autotest_common.sh@850 -- # return 0 00:29:41.847 05:14:20 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:41.847 05:14:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:42.105 05:14:21 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:42.105 05:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:42.105 05:14:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.105 05:14:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:42.105 05:14:21 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.105 05:14:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.365 nvme0n1 00:29:42.365 05:14:21 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:42.365 05:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:42.365 05:14:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.365 05:14:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:42.365 05:14:21 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:42.365 05:14:21 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:42.624 Running I/O for 2 seconds... 00:29:42.624 [2024-04-23 05:14:21.560771] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ee5c8 00:29:42.624 [2024-04-23 05:14:21.561873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:2671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.561917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.574284] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fac10 00:29:42.624 [2024-04-23 05:14:21.575345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24053 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.575379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.587833] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ebfd0 00:29:42.624 [2024-04-23 05:14:21.588772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:17232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.588802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.601841] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e6fa8 00:29:42.624 [2024-04-23 05:14:21.602882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.602916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.615522] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fef90 00:29:42.624 [2024-04-23 05:14:21.616957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:3759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.616989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.627510] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ec840 00:29:42.624 [2024-04-23 05:14:21.629152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:13664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.629184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.638792] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fb480 00:29:42.624 [2024-04-23 05:14:21.639695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:23834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.639723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0003 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.652541] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f6cc8 00:29:42.624 [2024-04-23 05:14:21.653538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:7769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.653584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0013 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.666428] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e7818 00:29:42.624 [2024-04-23 05:14:21.667628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:7346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.667657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.680179] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fcdd0 00:29:42.624 [2024-04-23 05:14:21.681533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.681579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.693896] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f0bc0 00:29:42.624 [2024-04-23 05:14:21.695440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:12255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.695471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.707662] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e01f8 00:29:42.624 [2024-04-23 05:14:21.709349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:5793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.709381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.721419] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190eaef0 00:29:42.624 [2024-04-23 05:14:21.723290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:8962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.723322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.735060] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ff3c8 00:29:42.624 [2024-04-23 05:14:21.737149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4636 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.737181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.744376] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fbcf0 00:29:42.624 [2024-04-23 05:14:21.745206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:22818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.745237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.758063] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190eaef0 00:29:42.624 [2024-04-23 05:14:21.759082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:3543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.624 [2024-04-23 05:14:21.759113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:42.624 [2024-04-23 05:14:21.771771] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f8a50 00:29:42.625 [2024-04-23 05:14:21.772966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:6045 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.625 [2024-04-23 05:14:21.772997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:42.625 [2024-04-23 05:14:21.785206] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e12d8 00:29:42.625 [2024-04-23 05:14:21.786520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:8462 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.625 [2024-04-23 05:14:21.786565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:42.883 [2024-04-23 05:14:21.797867] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190df118 00:29:42.883 [2024-04-23 05:14:21.799060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:18650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.883 [2024-04-23 05:14:21.799091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:29:42.883 [2024-04-23 05:14:21.811628] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f1430 00:29:42.883 [2024-04-23 05:14:21.812966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.883 [2024-04-23 05:14:21.812997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:29:42.883 [2024-04-23 05:14:21.825287] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ea680 00:29:42.883 [2024-04-23 05:14:21.826887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:16882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.883 [2024-04-23 05:14:21.826917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:42.883 [2024-04-23 05:14:21.839031] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e6738 00:29:42.883 [2024-04-23 05:14:21.840823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:8969 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.883 [2024-04-23 05:14:21.840851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:42.883 [2024-04-23 05:14:21.852774] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fcdd0 00:29:42.883 [2024-04-23 05:14:21.854708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:7019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.883 [2024-04-23 05:14:21.854736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:42.883 [2024-04-23 05:14:21.866528] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f7538 00:29:42.884 [2024-04-23 05:14:21.868593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:7425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.868621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.875795] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fa3a0 00:29:42.884 [2024-04-23 05:14:21.876704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:13535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.876731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0031 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.890668] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f2510 00:29:42.884 [2024-04-23 05:14:21.892500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:1081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.892544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.901878] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fef90 00:29:42.884 [2024-04-23 05:14:21.902884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:19373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.902915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.915585] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e5658 00:29:42.884 [2024-04-23 05:14:21.916754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:5833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.916782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.929305] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190df988 00:29:42.884 [2024-04-23 05:14:21.930700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:5294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.930728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.943034] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e88f8 00:29:42.884 [2024-04-23 05:14:21.944575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23989 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.944604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.956700] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fc998 00:29:42.884 [2024-04-23 05:14:21.958408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:226 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.958439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.970545] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fc560 00:29:42.884 [2024-04-23 05:14:21.972423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:21284 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.972454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.984326] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f81e0 00:29:42.884 [2024-04-23 05:14:21.986390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:15649 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.986421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:21.993726] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f35f0 00:29:42.884 [2024-04-23 05:14:21.994545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:20361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:21.994588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0031 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:22.009638] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f5378 00:29:42.884 [2024-04-23 05:14:22.011197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:20676 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:22.011230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:22.023206] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fac10 00:29:42.884 [2024-04-23 05:14:22.024907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:14805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:22.024939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:22.034257] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f1ca0 00:29:42.884 [2024-04-23 05:14:22.035108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:23393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.884 [2024-04-23 05:14:22.035139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:42.884 [2024-04-23 05:14:22.048037] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fa3a0 00:29:43.143 [2024-04-23 05:14:22.049345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:20140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.049377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.062945] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fa3a0 00:29:43.143 [2024-04-23 05:14:22.064806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:1396 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.064853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.076719] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e88f8 00:29:43.143 [2024-04-23 05:14:22.078838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:11917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.078866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.090497] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f35f0 00:29:43.143 [2024-04-23 05:14:22.092826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:1039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.092854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.099858] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f4b08 00:29:43.143 [2024-04-23 05:14:22.100850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:2825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.100881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.113601] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e01f8 00:29:43.143 [2024-04-23 05:14:22.114793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:25482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.114821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.127360] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f8a50 00:29:43.143 [2024-04-23 05:14:22.128794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:14062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.128822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.139753] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e6738 00:29:43.143 [2024-04-23 05:14:22.141095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.141126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0030 p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.153508] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e01f8 00:29:43.143 [2024-04-23 05:14:22.155009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.155040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.167231] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f2510 00:29:43.143 [2024-04-23 05:14:22.168914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:7179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.168944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.178646] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e4578 00:29:43.143 [2024-04-23 05:14:22.179734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:21640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.179761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.192178] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ef270 00:29:43.143 [2024-04-23 05:14:22.192990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:9302 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.193020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.205956] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fef90 00:29:43.143 [2024-04-23 05:14:22.207004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:1477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.207034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.219668] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e5220 00:29:43.143 [2024-04-23 05:14:22.220899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:22125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.220929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.232138] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190df118 00:29:43.143 [2024-04-23 05:14:22.234014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:23260 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.234051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.243494] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f1868 00:29:43.143 [2024-04-23 05:14:22.244479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:11356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.244509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.257291] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e8088 00:29:43.143 [2024-04-23 05:14:22.258432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:2216 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.258462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:001f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.271138] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fef90 00:29:43.143 [2024-04-23 05:14:22.272438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:8853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.272469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.284932] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f7970 00:29:43.143 [2024-04-23 05:14:22.286448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.143 [2024-04-23 05:14:22.286478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:29:43.143 [2024-04-23 05:14:22.298733] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f5378 00:29:43.144 [2024-04-23 05:14:22.300425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:20387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.144 [2024-04-23 05:14:22.300456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:43.402 [2024-04-23 05:14:22.312948] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e8088 00:29:43.402 [2024-04-23 05:14:22.314868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:20939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.402 [2024-04-23 05:14:22.314899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:43.402 [2024-04-23 05:14:22.326689] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e0a68 00:29:43.402 [2024-04-23 05:14:22.328809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:21208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.402 [2024-04-23 05:14:22.328841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:43.402 [2024-04-23 05:14:22.340466] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190df118 00:29:43.402 [2024-04-23 05:14:22.342689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:16751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.402 [2024-04-23 05:14:22.342717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.402 [2024-04-23 05:14:22.349733] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f0788 00:29:43.402 [2024-04-23 05:14:22.350797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:507 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.402 [2024-04-23 05:14:22.350832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:29:43.402 [2024-04-23 05:14:22.362804] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f0350 00:29:43.402 [2024-04-23 05:14:22.363946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:11717 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.402 [2024-04-23 05:14:22.363976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:001f p:0 m:0 dnr:0 00:29:43.402 [2024-04-23 05:14:22.376504] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190de038 00:29:43.402 [2024-04-23 05:14:22.377985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:6652 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.402 [2024-04-23 05:14:22.378016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:29:43.402 [2024-04-23 05:14:22.390222] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e88f8 00:29:43.402 [2024-04-23 05:14:22.391771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:5216 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.402 [2024-04-23 05:14:22.391798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.404026] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e7c50 00:29:43.403 [2024-04-23 05:14:22.405773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:12960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.405800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.417731] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f0350 00:29:43.403 [2024-04-23 05:14:22.419598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:14371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.419640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.431606] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f6458 00:29:43.403 [2024-04-23 05:14:22.433703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:2358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.433731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.445333] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f2d80 00:29:43.403 [2024-04-23 05:14:22.447577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:12659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.447605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.454694] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f1430 00:29:43.403 [2024-04-23 05:14:22.455772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:22081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.455800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.468075] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f5378 00:29:43.403 [2024-04-23 05:14:22.469042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:15710 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.469073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.481638] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190eee38 00:29:43.403 [2024-04-23 05:14:22.482779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:22061 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.482805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.495394] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e7c50 00:29:43.403 [2024-04-23 05:14:22.496804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:12247 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.496832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.508497] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ef270 00:29:43.403 [2024-04-23 05:14:22.509990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:12539 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.510021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.522245] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f57b0 00:29:43.403 [2024-04-23 05:14:22.523915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:17629 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.523946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.535939] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e1b48 00:29:43.403 [2024-04-23 05:14:22.537852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:20725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.537883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.549665] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f7100 00:29:43.403 [2024-04-23 05:14:22.551805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:2224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.551832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:43.403 [2024-04-23 05:14:22.563451] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190efae0 00:29:43.403 [2024-04-23 05:14:22.565850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:24667 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.403 [2024-04-23 05:14:22.565877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.576972] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f2948 00:29:43.662 [2024-04-23 05:14:22.579191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:9980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.579227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.586366] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e1b48 00:29:43.662 [2024-04-23 05:14:22.587341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:11796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.587372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.599999] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fa3a0 00:29:43.662 [2024-04-23 05:14:22.601126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:13583 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.601157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.615045] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e4de8 00:29:43.662 [2024-04-23 05:14:22.616873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:20831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.616903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.627189] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f4b08 00:29:43.662 [2024-04-23 05:14:22.628493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:24324 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.628530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.640571] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f2948 00:29:43.662 [2024-04-23 05:14:22.641744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:21632 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.641771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.652917] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e27f0 00:29:43.662 [2024-04-23 05:14:22.654723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:6134 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.654751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.664135] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f8e88 00:29:43.662 [2024-04-23 05:14:22.665052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.665082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.677760] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e4140 00:29:43.662 [2024-04-23 05:14:22.678904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:10542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.678934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:001d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.691594] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f9b30 00:29:43.662 [2024-04-23 05:14:22.692882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:10141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.692913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.705280] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e01f8 00:29:43.662 [2024-04-23 05:14:22.706775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:12373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.706817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.719079] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fd640 00:29:43.662 [2024-04-23 05:14:22.720737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:14711 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.720764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.732801] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e4140 00:29:43.662 [2024-04-23 05:14:22.734703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:5283 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.734730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.746675] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e99d8 00:29:43.662 [2024-04-23 05:14:22.748705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:16706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.748732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.760431] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190df988 00:29:43.662 [2024-04-23 05:14:22.762708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:25359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.762735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.769743] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e8d30 00:29:43.662 [2024-04-23 05:14:22.770795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:4535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.770822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.782140] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190dfdc0 00:29:43.662 [2024-04-23 05:14:22.783098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:20861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.783128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.796007] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e4578 00:29:43.662 [2024-04-23 05:14:22.797122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:7092 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.797152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:001d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.809703] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fda78 00:29:43.662 [2024-04-23 05:14:22.811024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:19700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.811053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:29:43.662 [2024-04-23 05:14:22.823441] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f92c0 00:29:43.662 [2024-04-23 05:14:22.825001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.662 [2024-04-23 05:14:22.825031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:43.921 [2024-04-23 05:14:22.837495] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f0bc0 00:29:43.921 [2024-04-23 05:14:22.839148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:22214 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.921 [2024-04-23 05:14:22.839178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:43.921 [2024-04-23 05:14:22.851204] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e4578 00:29:43.922 [2024-04-23 05:14:22.853035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:4009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.853065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.864924] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f6890 00:29:43.922 [2024-04-23 05:14:22.866902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:17607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.866933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.878642] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e84c0 00:29:43.922 [2024-04-23 05:14:22.880825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:9809 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.880852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.887917] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e9168 00:29:43.922 [2024-04-23 05:14:22.888880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:17527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.888910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.901665] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e1b48 00:29:43.922 [2024-04-23 05:14:22.902876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:21061 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.902906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.914978] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190eaab8 00:29:43.922 [2024-04-23 05:14:22.916109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:23864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.916146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.928070] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e6300 00:29:43.922 [2024-04-23 05:14:22.929202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:14966 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.929232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.941642] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e7c50 00:29:43.922 [2024-04-23 05:14:22.942938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:20858 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.942968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.955401] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e6738 00:29:43.922 [2024-04-23 05:14:22.956897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:19231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.956928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.968858] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fd640 00:29:43.922 [2024-04-23 05:14:22.970420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:23275 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.970448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.978924] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190feb58 00:29:43.922 [2024-04-23 05:14:22.979902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:13166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.979929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:22.990015] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f1430 00:29:43.922 [2024-04-23 05:14:22.990861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:19879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:22.990888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:23.002638] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190dece0 00:29:43.922 [2024-04-23 05:14:23.003649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:19004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:23.003677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:001c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:23.015428] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e5220 00:29:43.922 [2024-04-23 05:14:23.016565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:4718 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:23.016592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:23.027906] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e6300 00:29:43.922 [2024-04-23 05:14:23.029271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:6582 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:23.029299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:23.040550] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190dfdc0 00:29:43.922 [2024-04-23 05:14:23.042130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:13257 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:23.042157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:23.053272] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190dece0 00:29:43.922 [2024-04-23 05:14:23.055018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:3601 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:23.055046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:23.065949] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ea680 00:29:43.922 [2024-04-23 05:14:23.067728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:3653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:23.067756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:43.922 [2024-04-23 05:14:23.078609] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e4140 00:29:43.922 [2024-04-23 05:14:23.080677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:18234 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.922 [2024-04-23 05:14:23.080705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:44.181 [2024-04-23 05:14:23.087818] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e7818 00:29:44.182 [2024-04-23 05:14:23.088701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:1947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.088728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.100681] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fb048 00:29:44.182 [2024-04-23 05:14:23.101718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:20868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.101746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.113340] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f7970 00:29:44.182 [2024-04-23 05:14:23.114598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:2273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.114626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.124765] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f92c0 00:29:44.182 [2024-04-23 05:14:23.125970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:4441 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.125997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.137477] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e3498 00:29:44.182 [2024-04-23 05:14:23.138878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:10179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.138906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.150171] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fbcf0 00:29:44.182 [2024-04-23 05:14:23.151672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.151699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.162975] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e3d08 00:29:44.182 [2024-04-23 05:14:23.164639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.164667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.175181] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f6458 00:29:44.182 [2024-04-23 05:14:23.176828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:5857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.176856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.185708] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fc128 00:29:44.182 [2024-04-23 05:14:23.187481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:7131 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.187509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.196115] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f6890 00:29:44.182 [2024-04-23 05:14:23.197028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:4363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.197055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.208893] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f9b30 00:29:44.182 [2024-04-23 05:14:23.210063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.210097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:001c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.221734] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f46d0 00:29:44.182 [2024-04-23 05:14:23.222970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.222997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.234527] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f7970 00:29:44.182 [2024-04-23 05:14:23.235894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:11887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.235928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.247212] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e12d8 00:29:44.182 [2024-04-23 05:14:23.248747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:2842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.248775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.259920] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f9b30 00:29:44.182 [2024-04-23 05:14:23.261567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.261594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.272691] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fc128 00:29:44.182 [2024-04-23 05:14:23.274501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.274535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.285293] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190eea00 00:29:44.182 [2024-04-23 05:14:23.287300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:16120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.287328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.293984] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e0a68 00:29:44.182 [2024-04-23 05:14:23.294891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:12475 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.294918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.305464] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f7da8 00:29:44.182 [2024-04-23 05:14:23.306409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:25008 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.306436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.318220] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f96f8 00:29:44.182 [2024-04-23 05:14:23.319300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:1920 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.319327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:001c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.330958] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e23b8 00:29:44.182 [2024-04-23 05:14:23.332221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:22493 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.332249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:29:44.182 [2024-04-23 05:14:23.343941] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e38d0 00:29:44.182 [2024-04-23 05:14:23.345379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:7431 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.182 [2024-04-23 05:14:23.345407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.357317] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e38d0 00:29:44.440 [2024-04-23 05:14:23.358674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:2204 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.358702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.370959] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190e38d0 00:29:44.440 [2024-04-23 05:14:23.372978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.373006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.379734] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f31b8 00:29:44.440 [2024-04-23 05:14:23.380563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:19578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.380605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.392511] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f0350 00:29:44.440 [2024-04-23 05:14:23.393586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:18306 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.393614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.406305] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f6cc8 00:29:44.440 [2024-04-23 05:14:23.407981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:23460 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.408009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.419147] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190de8a8 00:29:44.440 [2024-04-23 05:14:23.420974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:22620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.421002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.431770] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190eaef0 00:29:44.440 [2024-04-23 05:14:23.433730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12055 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.433758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.440343] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ea680 00:29:44.440 [2024-04-23 05:14:23.441210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:18977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.441238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.453125] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f35f0 00:29:44.440 [2024-04-23 05:14:23.454195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:2252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.454223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.464739] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fda78 00:29:44.440 [2024-04-23 05:14:23.465745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:14768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.465772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.477367] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ff3c8 00:29:44.440 [2024-04-23 05:14:23.478619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:13038 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.478646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:002a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.490210] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fc998 00:29:44.440 [2024-04-23 05:14:23.491581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:24394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.491609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.502951] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fbcf0 00:29:44.440 [2024-04-23 05:14:23.504507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6661 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.440 [2024-04-23 05:14:23.504540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:44.440 [2024-04-23 05:14:23.515762] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190fda78 00:29:44.441 [2024-04-23 05:14:23.517433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:5707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.441 [2024-04-23 05:14:23.517461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:44.441 [2024-04-23 05:14:23.528258] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f7538 00:29:44.441 [2024-04-23 05:14:23.530103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:18985 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.441 [2024-04-23 05:14:23.530130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:44.441 [2024-04-23 05:14:23.540962] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190f31b8 00:29:44.441 [2024-04-23 05:14:23.542937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:9171 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.441 [2024-04-23 05:14:23.542964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:44.441 [2024-04-23 05:14:23.549488] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1a90) with pdu=0x2000190ed920 00:29:44.441 [2024-04-23 05:14:23.550379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:17200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:44.441 [2024-04-23 05:14:23.550406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:29:44.441 00:29:44.441 Latency(us) 00:29:44.441 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.441 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:44.441 nvme0n1 : 2.01 19827.82 77.45 0.00 0.00 6445.71 3082.62 16699.54 00:29:44.441 =================================================================================================================== 00:29:44.441 Total : 19827.82 77.45 0.00 0.00 6445.71 3082.62 16699.54 00:29:44.441 0 00:29:44.441 05:14:23 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:44.441 05:14:23 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:44.441 05:14:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:44.441 05:14:23 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:44.441 | .driver_specific 00:29:44.441 | .nvme_error 00:29:44.441 | .status_code 00:29:44.441 | .command_transient_transport_error' 00:29:44.698 05:14:23 -- host/digest.sh@71 -- # (( 156 > 0 )) 00:29:44.698 05:14:23 -- host/digest.sh@73 -- # killprocess 2519764 00:29:44.698 05:14:23 -- common/autotest_common.sh@936 -- # '[' -z 2519764 ']' 00:29:44.698 05:14:23 -- common/autotest_common.sh@940 -- # kill -0 2519764 00:29:44.698 05:14:23 -- common/autotest_common.sh@941 -- # uname 00:29:44.698 05:14:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:44.698 05:14:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2519764 00:29:44.698 05:14:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:44.698 05:14:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:44.698 05:14:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2519764' 00:29:44.698 killing process with pid 2519764 00:29:44.698 05:14:23 -- common/autotest_common.sh@955 -- # kill 2519764 00:29:44.698 Received shutdown signal, test time was about 2.000000 seconds 00:29:44.698 00:29:44.698 Latency(us) 00:29:44.698 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.698 =================================================================================================================== 00:29:44.698 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:44.698 05:14:23 -- common/autotest_common.sh@960 -- # wait 2519764 00:29:44.956 05:14:24 -- host/digest.sh@115 -- # run_bperf_err randwrite 131072 16 00:29:44.956 05:14:24 -- host/digest.sh@54 -- # local rw bs qd 00:29:44.956 05:14:24 -- host/digest.sh@56 -- # rw=randwrite 00:29:44.956 05:14:24 -- host/digest.sh@56 -- # bs=131072 00:29:44.956 05:14:24 -- host/digest.sh@56 -- # qd=16 00:29:44.956 05:14:24 -- host/digest.sh@58 -- # bperfpid=2520174 00:29:44.956 05:14:24 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:44.956 05:14:24 -- host/digest.sh@60 -- # waitforlisten 2520174 /var/tmp/bperf.sock 00:29:44.956 05:14:24 -- common/autotest_common.sh@817 -- # '[' -z 2520174 ']' 00:29:44.956 05:14:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:44.956 05:14:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:44.956 05:14:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:44.956 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:44.956 05:14:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:44.956 05:14:24 -- common/autotest_common.sh@10 -- # set +x 00:29:44.956 [2024-04-23 05:14:24.117713] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:44.956 [2024-04-23 05:14:24.117785] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2520174 ] 00:29:44.956 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:44.956 Zero copy mechanism will not be used. 00:29:45.213 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.213 [2024-04-23 05:14:24.148342] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:45.213 [2024-04-23 05:14:24.179508] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:45.213 [2024-04-23 05:14:24.265261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:45.213 05:14:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:45.213 05:14:24 -- common/autotest_common.sh@850 -- # return 0 00:29:45.213 05:14:24 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:45.213 05:14:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:45.779 05:14:24 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:45.779 05:14:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:45.779 05:14:24 -- common/autotest_common.sh@10 -- # set +x 00:29:45.779 05:14:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:45.779 05:14:24 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:45.779 05:14:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:45.779 nvme0n1 00:29:46.038 05:14:24 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:46.038 05:14:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:46.038 05:14:24 -- common/autotest_common.sh@10 -- # set +x 00:29:46.038 05:14:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:46.038 05:14:24 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:46.038 05:14:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:46.038 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:46.038 Zero copy mechanism will not be used. 00:29:46.038 Running I/O for 2 seconds... 00:29:46.038 [2024-04-23 05:14:25.082196] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.038 [2024-04-23 05:14:25.082570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.038 [2024-04-23 05:14:25.082612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.038 [2024-04-23 05:14:25.089912] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.038 [2024-04-23 05:14:25.090246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.038 [2024-04-23 05:14:25.090277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.099083] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.099432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.099462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.108293] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.108609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.108648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.115706] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.116028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.116071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.123111] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.123208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.123235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.131139] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.131448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.131478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.139320] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.139635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.139665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.147955] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.148264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.148293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.157436] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.157757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.157787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.166114] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.166421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.166450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.174280] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.174611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.174641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.183170] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.183492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.183535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.192407] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.192766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.192795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.039 [2024-04-23 05:14:25.200438] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.039 [2024-04-23 05:14:25.200578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.039 [2024-04-23 05:14:25.200606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.208220] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.208572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.208600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.215682] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.216034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.216063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.223341] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.223728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.223757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.231562] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.231885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.231913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.239656] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.239981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.240009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.246694] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.247000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.247028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.254197] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.254565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.254593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.262212] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.262546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.262574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.269653] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.269989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.270018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.277199] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.277544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.277572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.284624] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.299 [2024-04-23 05:14:25.284948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.299 [2024-04-23 05:14:25.284977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.299 [2024-04-23 05:14:25.291683] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.292004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.292046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.299490] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.299818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.299847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.307863] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.308210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.308238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.316688] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.317012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.317041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.325391] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.325743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.325772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.333200] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.333503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.333538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.340942] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.341264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.341294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.349065] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.349401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.349445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.358108] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.358415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.358444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.367665] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.367985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.368014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.375836] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.376154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.376183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.384314] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.384671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.384700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.393548] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.393868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.393904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.402539] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.402862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.402891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.410592] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.410900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.410928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.419331] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.419686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.419716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.428644] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.428964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.428993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.437904] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.438211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.438240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.446371] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.446714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.446758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.455067] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.300 [2024-04-23 05:14:25.455388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.300 [2024-04-23 05:14:25.455431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.300 [2024-04-23 05:14:25.463976] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.464284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.464312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.472124] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.472484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.472513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.479689] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.480039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.480067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.487407] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.487736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.487764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.495321] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.495650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.495679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.502818] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.503164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.503192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.510890] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.511211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.511240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.519546] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.519867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.519896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.529025] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.529376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.529405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.537088] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.537419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.537448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.544970] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.545306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.545334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.560 [2024-04-23 05:14:25.553853] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.560 [2024-04-23 05:14:25.554159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.560 [2024-04-23 05:14:25.554187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.562653] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.562973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.563000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.572198] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.572528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.572556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.580991] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.581313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.581342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.588701] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.589008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.589036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.597636] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.597966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.597995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.606286] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.606670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.606698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.615364] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.615691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.615727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.624685] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.624993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.625022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.632484] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.632606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.632635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.640730] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.641038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.641067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.648094] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.648415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.648444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.655259] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.655628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.655656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.662621] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.662938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.662967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.670186] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.670541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.670578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.677767] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.678123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.678150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.685544] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.685905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.685947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.693194] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.693571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.693600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.700968] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.701303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.701332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.708705] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.709023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.709052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.716289] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.716630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.716658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.561 [2024-04-23 05:14:25.723709] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.561 [2024-04-23 05:14:25.724016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.561 [2024-04-23 05:14:25.724044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.731426] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.731739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.731767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.739108] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.739472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.739501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.746495] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.746829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.746878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.754056] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.754361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.754389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.761380] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.761477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.761505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.768994] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.769287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.769315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.775796] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.776092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.776120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.783085] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.783374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.783403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.790189] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.790478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.790506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.797140] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.797435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.797463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.804066] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.804361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.821 [2024-04-23 05:14:25.804389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.821 [2024-04-23 05:14:25.810804] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.821 [2024-04-23 05:14:25.811108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.811137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.817462] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.817689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.817717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.824170] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.824460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.824488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.831116] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.831421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.831449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.837865] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.838155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.838183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.844806] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.845096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.845132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.851735] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.852028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.852056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.858982] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.859271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.859299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.866177] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.866458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.866485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.873275] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.873558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.873585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.880443] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.880718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.880747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.887110] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.887385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.887413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.893873] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.894153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.894181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.900943] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.901219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.901247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.907721] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.907997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.908025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.914720] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.914996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.915026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.921240] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.921526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.921553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.928454] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.928759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.928794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.935334] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.935622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.935650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.942198] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.942472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.942500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.949381] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.949666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.949694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.956121] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.956397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.956425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.963329] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.963617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.963645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.970380] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.970664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.970692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.977315] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.822 [2024-04-23 05:14:25.977602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.822 [2024-04-23 05:14:25.977631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.822 [2024-04-23 05:14:25.984435] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:46.823 [2024-04-23 05:14:25.984727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.823 [2024-04-23 05:14:25.984756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.085 [2024-04-23 05:14:25.991405] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.085 [2024-04-23 05:14:25.991708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.085 [2024-04-23 05:14:25.991737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.085 [2024-04-23 05:14:25.998305] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.085 [2024-04-23 05:14:25.998594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.085 [2024-04-23 05:14:25.998623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.005360] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.005645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.005673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.012426] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.012707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.012736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.019659] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.019948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.019976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.026452] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.026733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.026761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.033412] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.033716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.033744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.040362] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.040620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.040649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.046999] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.047244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.047271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.053686] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.053932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.053959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.060941] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.061216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.061244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.069449] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.069791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.069819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.077532] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.077779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.077807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.085602] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.085973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.086001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.093740] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.094115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.094145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.102395] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.102735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.102764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.110810] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.111172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.111200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.119573] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.119955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.120005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.127132] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.127391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.127434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.135143] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.135512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.135547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.143651] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.143925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.143953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.151145] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.151529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.151557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.159809] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.160198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.160225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.168073] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.168333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.168361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.176346] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.176730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.086 [2024-04-23 05:14:26.176773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.086 [2024-04-23 05:14:26.184563] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.086 [2024-04-23 05:14:26.184835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.184863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.087 [2024-04-23 05:14:26.192443] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.087 [2024-04-23 05:14:26.192838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.192867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.087 [2024-04-23 05:14:26.200845] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.087 [2024-04-23 05:14:26.201163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.201205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.087 [2024-04-23 05:14:26.209259] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.087 [2024-04-23 05:14:26.209559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.209587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.087 [2024-04-23 05:14:26.217388] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.087 [2024-04-23 05:14:26.217718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.217746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.087 [2024-04-23 05:14:26.225616] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.087 [2024-04-23 05:14:26.225858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.225885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.087 [2024-04-23 05:14:26.233420] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.087 [2024-04-23 05:14:26.233787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.233815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.087 [2024-04-23 05:14:26.241489] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.087 [2024-04-23 05:14:26.241936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.087 [2024-04-23 05:14:26.241963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.249456] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.249893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.249923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.258238] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.258662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.258691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.266093] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.266345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.266374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.272779] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.273032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.273061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.279663] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.280073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.280099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.288378] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.288687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.288716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.296771] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.297195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.297221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.305261] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.305542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.305570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.313118] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.313544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.313571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.322007] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.322392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.322419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.330592] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.330977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.331023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.339346] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.339643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.339671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.347825] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.348203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.348230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.356484] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.356836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.356864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.366 [2024-04-23 05:14:26.364984] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.366 [2024-04-23 05:14:26.365374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.366 [2024-04-23 05:14:26.365416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.373664] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.373965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.373993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.382071] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.382410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.382437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.389775] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.390041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.390083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.396280] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.396621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.396649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.402885] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.403160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.403188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.410020] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.410312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.410354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.416705] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.416966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.416993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.423980] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.424260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.424287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.430876] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.431149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.431176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.437929] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.438180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.438222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.444916] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.445213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.445255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.451798] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.452073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.452101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.458978] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.459253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.459289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.466368] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.466634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.466662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.473502] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.473769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.473797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.480330] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.480600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.480627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.487560] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.487826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.487853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.494678] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.494967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.494994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.502742] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.503047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.503088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.367 [2024-04-23 05:14:26.510966] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.367 [2024-04-23 05:14:26.511356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.367 [2024-04-23 05:14:26.511384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.518791] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.519039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.519067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.525765] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.526054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.526098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.532576] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.532823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.532851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.540202] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.540634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.540661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.548990] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.549263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.549305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.556291] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.556685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.556727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.564464] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.564857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.564885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.572778] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.573090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.573134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.579637] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.579884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.579911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.586623] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.586912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.586940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.594908] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.595246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.595275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.603365] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.603731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.603760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.612032] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.612406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.612434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.620535] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.620801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.620829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.628973] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.630 [2024-04-23 05:14:26.629363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.630 [2024-04-23 05:14:26.629407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.630 [2024-04-23 05:14:26.637448] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.637725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.637754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.645758] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.646062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.646105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.654387] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.654740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.654769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.662801] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.663181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.663214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.671057] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.671473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.671505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.679760] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.680159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.680187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.687796] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.688196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.688224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.696072] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.696404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.696447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.704228] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.704599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.704628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.712345] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.712689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.712718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.720249] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.720546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.720575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.727302] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.727597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.727626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.734610] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.734880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.734907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.741622] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.741883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.741910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.748555] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.748812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.748854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.755690] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.755938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.755981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.762654] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.762903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.762944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.769396] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.769664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.769692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.776299] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.776625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.776653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.783270] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.783551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.783598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.631 [2024-04-23 05:14:26.790109] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.631 [2024-04-23 05:14:26.790369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.631 [2024-04-23 05:14:26.790397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.890 [2024-04-23 05:14:26.797131] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.890 [2024-04-23 05:14:26.797467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.890 [2024-04-23 05:14:26.797495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.890 [2024-04-23 05:14:26.804241] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.890 [2024-04-23 05:14:26.804502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.890 [2024-04-23 05:14:26.804537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.890 [2024-04-23 05:14:26.811195] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.890 [2024-04-23 05:14:26.811453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.890 [2024-04-23 05:14:26.811481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.890 [2024-04-23 05:14:26.818105] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.890 [2024-04-23 05:14:26.818364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.818407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.824866] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.825126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.825168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.831704] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.831953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.831981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.838869] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.839150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.839177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.846057] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.846317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.846345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.852926] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.853207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.853240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.859443] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.859732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.859760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.866097] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.866362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.866390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.873157] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.873478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.873528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.880355] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.880621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.880650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.887075] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.887350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.887376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.893832] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.894114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.894142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.900641] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.900887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.900915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.907485] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.907759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.907787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.914310] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.914580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.914608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.921217] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.921491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.921540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.928283] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.928565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.928593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.935368] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.935636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.935664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.942148] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.942407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.942435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.949331] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.949600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.949633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.956472] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.956750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.956778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.963260] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.963533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.963561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.970013] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.970273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.970306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.976870] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.977142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.977170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.984038] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.984351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.984378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.991158] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.991419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.991447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:26.997841] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.891 [2024-04-23 05:14:26.998120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.891 [2024-04-23 05:14:26.998148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.891 [2024-04-23 05:14:27.004657] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.004911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.004939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.892 [2024-04-23 05:14:27.011904] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.012199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.012227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.892 [2024-04-23 05:14:27.019125] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.019386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.019414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.892 [2024-04-23 05:14:27.026123] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.026382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.026410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:47.892 [2024-04-23 05:14:27.032658] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.032910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.032938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:47.892 [2024-04-23 05:14:27.039498] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.039768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.039796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.892 [2024-04-23 05:14:27.046473] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.046746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.046775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:47.892 [2024-04-23 05:14:27.053508] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:47.892 [2024-04-23 05:14:27.053764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.892 [2024-04-23 05:14:27.053793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:48.150 [2024-04-23 05:14:27.060243] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:48.150 [2024-04-23 05:14:27.060487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.150 [2024-04-23 05:14:27.060525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:48.150 [2024-04-23 05:14:27.066642] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:48.150 [2024-04-23 05:14:27.066889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.150 [2024-04-23 05:14:27.066917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.150 [2024-04-23 05:14:27.073309] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22b1dd0) with pdu=0x2000190fef90 00:29:48.150 [2024-04-23 05:14:27.073579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.150 [2024-04-23 05:14:27.073607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:48.150 00:29:48.150 Latency(us) 00:29:48.150 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:48.150 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:48.150 nvme0n1 : 2.00 4047.99 506.00 0.00 0.00 3944.41 2864.17 10000.31 00:29:48.150 =================================================================================================================== 00:29:48.150 Total : 4047.99 506.00 0.00 0.00 3944.41 2864.17 10000.31 00:29:48.150 0 00:29:48.151 05:14:27 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:48.151 05:14:27 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:48.151 05:14:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:48.151 05:14:27 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:48.151 | .driver_specific 00:29:48.151 | .nvme_error 00:29:48.151 | .status_code 00:29:48.151 | .command_transient_transport_error' 00:29:48.409 05:14:27 -- host/digest.sh@71 -- # (( 261 > 0 )) 00:29:48.409 05:14:27 -- host/digest.sh@73 -- # killprocess 2520174 00:29:48.409 05:14:27 -- common/autotest_common.sh@936 -- # '[' -z 2520174 ']' 00:29:48.409 05:14:27 -- common/autotest_common.sh@940 -- # kill -0 2520174 00:29:48.409 05:14:27 -- common/autotest_common.sh@941 -- # uname 00:29:48.409 05:14:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:48.409 05:14:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2520174 00:29:48.409 05:14:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:48.409 05:14:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:48.409 05:14:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2520174' 00:29:48.409 killing process with pid 2520174 00:29:48.409 05:14:27 -- common/autotest_common.sh@955 -- # kill 2520174 00:29:48.409 Received shutdown signal, test time was about 2.000000 seconds 00:29:48.409 00:29:48.409 Latency(us) 00:29:48.409 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:48.409 =================================================================================================================== 00:29:48.409 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:48.409 05:14:27 -- common/autotest_common.sh@960 -- # wait 2520174 00:29:48.409 05:14:27 -- host/digest.sh@116 -- # killprocess 2518807 00:29:48.409 05:14:27 -- common/autotest_common.sh@936 -- # '[' -z 2518807 ']' 00:29:48.409 05:14:27 -- common/autotest_common.sh@940 -- # kill -0 2518807 00:29:48.409 05:14:27 -- common/autotest_common.sh@941 -- # uname 00:29:48.409 05:14:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:48.409 05:14:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2518807 00:29:48.667 05:14:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:48.667 05:14:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:48.667 05:14:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2518807' 00:29:48.667 killing process with pid 2518807 00:29:48.667 05:14:27 -- common/autotest_common.sh@955 -- # kill 2518807 00:29:48.667 05:14:27 -- common/autotest_common.sh@960 -- # wait 2518807 00:29:48.667 00:29:48.667 real 0m15.104s 00:29:48.667 user 0m30.171s 00:29:48.667 sys 0m4.059s 00:29:48.667 05:14:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:48.667 05:14:27 -- common/autotest_common.sh@10 -- # set +x 00:29:48.667 ************************************ 00:29:48.667 END TEST nvmf_digest_error 00:29:48.667 ************************************ 00:29:48.667 05:14:27 -- host/digest.sh@149 -- # trap - SIGINT SIGTERM EXIT 00:29:48.667 05:14:27 -- host/digest.sh@150 -- # nvmftestfini 00:29:48.667 05:14:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:29:48.667 05:14:27 -- nvmf/common.sh@117 -- # sync 00:29:48.667 05:14:27 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:29:48.667 05:14:27 -- nvmf/common.sh@120 -- # set +e 00:29:48.667 05:14:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:29:48.667 05:14:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:29:48.926 rmmod nvme_tcp 00:29:48.926 rmmod nvme_fabrics 00:29:48.926 rmmod nvme_keyring 00:29:48.926 05:14:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:29:48.926 05:14:27 -- nvmf/common.sh@124 -- # set -e 00:29:48.926 05:14:27 -- nvmf/common.sh@125 -- # return 0 00:29:48.926 05:14:27 -- nvmf/common.sh@478 -- # '[' -n 2518807 ']' 00:29:48.926 05:14:27 -- nvmf/common.sh@479 -- # killprocess 2518807 00:29:48.926 05:14:27 -- common/autotest_common.sh@936 -- # '[' -z 2518807 ']' 00:29:48.926 05:14:27 -- common/autotest_common.sh@940 -- # kill -0 2518807 00:29:48.926 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2518807) - No such process 00:29:48.926 05:14:27 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2518807 is not found' 00:29:48.926 Process with pid 2518807 is not found 00:29:48.926 05:14:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:29:48.926 05:14:27 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:29:48.926 05:14:27 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:29:48.926 05:14:27 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:48.926 05:14:27 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:29:48.926 05:14:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:48.926 05:14:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:48.926 05:14:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:50.832 05:14:29 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:29:50.833 00:29:50.833 real 0m34.940s 00:29:50.833 user 1m0.643s 00:29:50.833 sys 0m9.930s 00:29:50.833 05:14:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:50.833 05:14:29 -- common/autotest_common.sh@10 -- # set +x 00:29:50.833 ************************************ 00:29:50.833 END TEST nvmf_digest 00:29:50.833 ************************************ 00:29:50.833 05:14:29 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:29:50.833 05:14:29 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:29:50.833 05:14:29 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:29:50.833 05:14:29 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:50.833 05:14:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:50.833 05:14:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:50.833 05:14:29 -- common/autotest_common.sh@10 -- # set +x 00:29:51.095 ************************************ 00:29:51.095 START TEST nvmf_bdevperf 00:29:51.095 ************************************ 00:29:51.095 05:14:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:51.095 * Looking for test storage... 00:29:51.095 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:51.095 05:14:30 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:51.095 05:14:30 -- nvmf/common.sh@7 -- # uname -s 00:29:51.095 05:14:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:51.095 05:14:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:51.095 05:14:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:51.095 05:14:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:51.095 05:14:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:51.095 05:14:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:51.095 05:14:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:51.095 05:14:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:51.095 05:14:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:51.095 05:14:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:51.095 05:14:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:51.095 05:14:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:51.095 05:14:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:51.095 05:14:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:51.095 05:14:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:51.095 05:14:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:29:51.095 05:14:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:51.095 05:14:30 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:51.095 05:14:30 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:51.095 05:14:30 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:51.095 05:14:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.095 05:14:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.095 05:14:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.095 05:14:30 -- paths/export.sh@5 -- # export PATH 00:29:51.095 05:14:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.095 05:14:30 -- nvmf/common.sh@47 -- # : 0 00:29:51.095 05:14:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:29:51.095 05:14:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:29:51.095 05:14:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:29:51.095 05:14:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:51.095 05:14:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:51.096 05:14:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:29:51.096 05:14:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:29:51.096 05:14:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:29:51.096 05:14:30 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:51.096 05:14:30 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:51.096 05:14:30 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:51.096 05:14:30 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:29:51.096 05:14:30 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:51.096 05:14:30 -- nvmf/common.sh@437 -- # prepare_net_devs 00:29:51.096 05:14:30 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:29:51.096 05:14:30 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:29:51.096 05:14:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:51.096 05:14:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:51.096 05:14:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:51.096 05:14:30 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:29:51.096 05:14:30 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:29:51.096 05:14:30 -- nvmf/common.sh@285 -- # xtrace_disable 00:29:51.096 05:14:30 -- common/autotest_common.sh@10 -- # set +x 00:29:53.629 05:14:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:53.629 05:14:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:29:53.629 05:14:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:29:53.629 05:14:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:29:53.629 05:14:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:29:53.629 05:14:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:29:53.629 05:14:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:29:53.629 05:14:32 -- nvmf/common.sh@295 -- # net_devs=() 00:29:53.629 05:14:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:29:53.629 05:14:32 -- nvmf/common.sh@296 -- # e810=() 00:29:53.629 05:14:32 -- nvmf/common.sh@296 -- # local -ga e810 00:29:53.629 05:14:32 -- nvmf/common.sh@297 -- # x722=() 00:29:53.629 05:14:32 -- nvmf/common.sh@297 -- # local -ga x722 00:29:53.629 05:14:32 -- nvmf/common.sh@298 -- # mlx=() 00:29:53.629 05:14:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:29:53.629 05:14:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:53.629 05:14:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:29:53.629 05:14:32 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:29:53.629 05:14:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:29:53.629 05:14:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:53.629 05:14:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:53.629 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:53.629 05:14:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:53.629 05:14:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:53.629 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:53.629 05:14:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:29:53.629 05:14:32 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:53.629 05:14:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:53.629 05:14:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:53.629 05:14:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:53.629 05:14:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:53.629 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:53.629 05:14:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:53.629 05:14:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:53.629 05:14:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:53.629 05:14:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:53.629 05:14:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:53.629 05:14:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:53.629 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:53.629 05:14:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:53.629 05:14:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:29:53.629 05:14:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:29:53.629 05:14:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:29:53.629 05:14:32 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:29:53.629 05:14:32 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:53.629 05:14:32 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:53.629 05:14:32 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:53.629 05:14:32 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:29:53.629 05:14:32 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:53.629 05:14:32 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:53.629 05:14:32 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:29:53.629 05:14:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:53.629 05:14:32 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:53.629 05:14:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:29:53.629 05:14:32 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:29:53.629 05:14:32 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:29:53.629 05:14:32 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:53.629 05:14:32 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:53.629 05:14:32 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:53.629 05:14:32 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:29:53.629 05:14:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:53.629 05:14:32 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:53.629 05:14:32 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:53.629 05:14:32 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:29:53.629 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:53.629 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.165 ms 00:29:53.629 00:29:53.629 --- 10.0.0.2 ping statistics --- 00:29:53.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:53.629 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:29:53.629 05:14:32 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:53.629 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:53.629 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:29:53.629 00:29:53.630 --- 10.0.0.1 ping statistics --- 00:29:53.630 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:53.630 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:29:53.630 05:14:32 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:53.630 05:14:32 -- nvmf/common.sh@411 -- # return 0 00:29:53.630 05:14:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:29:53.630 05:14:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:53.630 05:14:32 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:29:53.630 05:14:32 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:29:53.630 05:14:32 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:53.630 05:14:32 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:29:53.630 05:14:32 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:29:53.630 05:14:32 -- host/bdevperf.sh@25 -- # tgt_init 00:29:53.630 05:14:32 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:53.630 05:14:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:29:53.630 05:14:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:53.630 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.630 05:14:32 -- nvmf/common.sh@470 -- # nvmfpid=2522630 00:29:53.630 05:14:32 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:53.630 05:14:32 -- nvmf/common.sh@471 -- # waitforlisten 2522630 00:29:53.630 05:14:32 -- common/autotest_common.sh@817 -- # '[' -z 2522630 ']' 00:29:53.630 05:14:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:53.630 05:14:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:53.630 05:14:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:53.630 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:53.630 05:14:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:53.630 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.630 [2024-04-23 05:14:32.429423] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:53.630 [2024-04-23 05:14:32.429511] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:53.630 EAL: No free 2048 kB hugepages reported on node 1 00:29:53.630 [2024-04-23 05:14:32.468404] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:53.630 [2024-04-23 05:14:32.501738] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:53.630 [2024-04-23 05:14:32.594937] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:53.630 [2024-04-23 05:14:32.595011] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:53.630 [2024-04-23 05:14:32.595038] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:53.630 [2024-04-23 05:14:32.595052] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:53.630 [2024-04-23 05:14:32.595065] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:53.630 [2024-04-23 05:14:32.595159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:53.630 [2024-04-23 05:14:32.595193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:53.630 [2024-04-23 05:14:32.595196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:53.630 05:14:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:53.630 05:14:32 -- common/autotest_common.sh@850 -- # return 0 00:29:53.630 05:14:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:29:53.630 05:14:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:53.630 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.630 05:14:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:53.630 05:14:32 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:53.630 05:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:53.630 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.630 [2024-04-23 05:14:32.744802] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:53.630 05:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:53.630 05:14:32 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:53.630 05:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:53.630 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.630 Malloc0 00:29:53.630 05:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:53.630 05:14:32 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:53.630 05:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:53.630 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.888 05:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:53.888 05:14:32 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:53.888 05:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:53.888 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.888 05:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:53.888 05:14:32 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:53.888 05:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:53.888 05:14:32 -- common/autotest_common.sh@10 -- # set +x 00:29:53.888 [2024-04-23 05:14:32.808826] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:53.888 05:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:53.888 05:14:32 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:53.888 05:14:32 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:53.888 05:14:32 -- nvmf/common.sh@521 -- # config=() 00:29:53.888 05:14:32 -- nvmf/common.sh@521 -- # local subsystem config 00:29:53.889 05:14:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:29:53.889 05:14:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:29:53.889 { 00:29:53.889 "params": { 00:29:53.889 "name": "Nvme$subsystem", 00:29:53.889 "trtype": "$TEST_TRANSPORT", 00:29:53.889 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:53.889 "adrfam": "ipv4", 00:29:53.889 "trsvcid": "$NVMF_PORT", 00:29:53.889 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:53.889 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:53.889 "hdgst": ${hdgst:-false}, 00:29:53.889 "ddgst": ${ddgst:-false} 00:29:53.889 }, 00:29:53.889 "method": "bdev_nvme_attach_controller" 00:29:53.889 } 00:29:53.889 EOF 00:29:53.889 )") 00:29:53.889 05:14:32 -- nvmf/common.sh@543 -- # cat 00:29:53.889 05:14:32 -- nvmf/common.sh@545 -- # jq . 00:29:53.889 05:14:32 -- nvmf/common.sh@546 -- # IFS=, 00:29:53.889 05:14:32 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:29:53.889 "params": { 00:29:53.889 "name": "Nvme1", 00:29:53.889 "trtype": "tcp", 00:29:53.889 "traddr": "10.0.0.2", 00:29:53.889 "adrfam": "ipv4", 00:29:53.889 "trsvcid": "4420", 00:29:53.889 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:53.889 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:53.889 "hdgst": false, 00:29:53.889 "ddgst": false 00:29:53.889 }, 00:29:53.889 "method": "bdev_nvme_attach_controller" 00:29:53.889 }' 00:29:53.889 [2024-04-23 05:14:32.856883] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:53.889 [2024-04-23 05:14:32.856958] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2522675 ] 00:29:53.889 EAL: No free 2048 kB hugepages reported on node 1 00:29:53.889 [2024-04-23 05:14:32.888861] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:53.889 [2024-04-23 05:14:32.917039] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:53.889 [2024-04-23 05:14:33.004588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:54.146 Running I/O for 1 seconds... 00:29:55.078 00:29:55.078 Latency(us) 00:29:55.078 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:55.078 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:55.078 Verification LBA range: start 0x0 length 0x4000 00:29:55.078 Nvme1n1 : 1.00 8448.96 33.00 0.00 0.00 15087.92 1183.29 15340.28 00:29:55.078 =================================================================================================================== 00:29:55.078 Total : 8448.96 33.00 0.00 0.00 15087.92 1183.29 15340.28 00:29:55.334 05:14:34 -- host/bdevperf.sh@30 -- # bdevperfpid=2522820 00:29:55.334 05:14:34 -- host/bdevperf.sh@32 -- # sleep 3 00:29:55.334 05:14:34 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:55.334 05:14:34 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:55.334 05:14:34 -- nvmf/common.sh@521 -- # config=() 00:29:55.334 05:14:34 -- nvmf/common.sh@521 -- # local subsystem config 00:29:55.334 05:14:34 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:29:55.334 05:14:34 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:29:55.334 { 00:29:55.334 "params": { 00:29:55.334 "name": "Nvme$subsystem", 00:29:55.334 "trtype": "$TEST_TRANSPORT", 00:29:55.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:55.334 "adrfam": "ipv4", 00:29:55.334 "trsvcid": "$NVMF_PORT", 00:29:55.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:55.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:55.334 "hdgst": ${hdgst:-false}, 00:29:55.334 "ddgst": ${ddgst:-false} 00:29:55.334 }, 00:29:55.334 "method": "bdev_nvme_attach_controller" 00:29:55.334 } 00:29:55.334 EOF 00:29:55.334 )") 00:29:55.334 05:14:34 -- nvmf/common.sh@543 -- # cat 00:29:55.334 05:14:34 -- nvmf/common.sh@545 -- # jq . 00:29:55.334 05:14:34 -- nvmf/common.sh@546 -- # IFS=, 00:29:55.334 05:14:34 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:29:55.334 "params": { 00:29:55.334 "name": "Nvme1", 00:29:55.334 "trtype": "tcp", 00:29:55.334 "traddr": "10.0.0.2", 00:29:55.334 "adrfam": "ipv4", 00:29:55.334 "trsvcid": "4420", 00:29:55.334 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:55.334 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:55.334 "hdgst": false, 00:29:55.335 "ddgst": false 00:29:55.335 }, 00:29:55.335 "method": "bdev_nvme_attach_controller" 00:29:55.335 }' 00:29:55.592 [2024-04-23 05:14:34.507764] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:29:55.592 [2024-04-23 05:14:34.507843] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2522820 ] 00:29:55.592 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.592 [2024-04-23 05:14:34.540508] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:29:55.592 [2024-04-23 05:14:34.569487] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:55.592 [2024-04-23 05:14:34.653397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:55.849 Running I/O for 15 seconds... 00:29:58.382 05:14:37 -- host/bdevperf.sh@33 -- # kill -9 2522630 00:29:58.382 05:14:37 -- host/bdevperf.sh@35 -- # sleep 3 00:29:58.383 [2024-04-23 05:14:37.476601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:28136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:28144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:28160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:28168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:28176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:28184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.476968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.476986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:28200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:28256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:28264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:28328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:28336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:28344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:28352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:28376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:28384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.383 [2024-04-23 05:14:37.477786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:28392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.383 [2024-04-23 05:14:37.477801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.477833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:28400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.477849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.477867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.477882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.477900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.477915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.477932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:28424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.477949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.477967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.477984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:28456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:28464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:28472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:28488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:28496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:28504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:28512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:28520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:28528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:28536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:28544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:28576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:28584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:28600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:28608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:28624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:28632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:28640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:28648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:28656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.478969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.478989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.479008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.479023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.384 [2024-04-23 05:14:37.479041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:28680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.384 [2024-04-23 05:14:37.479058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:28688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:28704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:28712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:28720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:28744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:28752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:28760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:28768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:28776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:28784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:28800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:28808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:28816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:28824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:28840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:28848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:28864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:28880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:28888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.479968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.479983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.480000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:28904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.480016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.480033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.480049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.480066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.480082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.480099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.480114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.480131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:28936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.480147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.385 [2024-04-23 05:14:37.480164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:28944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.385 [2024-04-23 05:14:37.480180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:28960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:28968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:28976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:28984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:28992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:29000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:29008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:29016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:29032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:29040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:29048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:29056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:29104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:58.386 [2024-04-23 05:14:37.480690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:29112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:58.386 [2024-04-23 05:14:37.480720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:29120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:58.386 [2024-04-23 05:14:37.480750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:29128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:58.386 [2024-04-23 05:14:37.480779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:29136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:58.386 [2024-04-23 05:14:37.480824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:29144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:58.386 [2024-04-23 05:14:37.480857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:29152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:58.386 [2024-04-23 05:14:37.480889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:29072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.480973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:29080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.480989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.481006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:29088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.386 [2024-04-23 05:14:37.481022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.481039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23bfcc0 is same with the state(5) to be set 00:29:58.386 [2024-04-23 05:14:37.481059] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:58.386 [2024-04-23 05:14:37.481073] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:58.386 [2024-04-23 05:14:37.481087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29096 len:8 PRP1 0x0 PRP2 0x0 00:29:58.386 [2024-04-23 05:14:37.481102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.481175] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x23bfcc0 was disconnected and freed. reset controller. 00:29:58.386 [2024-04-23 05:14:37.481258] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:58.386 [2024-04-23 05:14:37.481281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.481299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:58.386 [2024-04-23 05:14:37.481315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.481330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:58.386 [2024-04-23 05:14:37.481346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.481376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:58.386 [2024-04-23 05:14:37.481389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:58.386 [2024-04-23 05:14:37.481402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.386 [2024-04-23 05:14:37.485012] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.386 [2024-04-23 05:14:37.485054] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.386 [2024-04-23 05:14:37.485760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.386 [2024-04-23 05:14:37.485984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.386 [2024-04-23 05:14:37.486010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.387 [2024-04-23 05:14:37.486027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.387 [2024-04-23 05:14:37.486289] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.387 [2024-04-23 05:14:37.486543] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.387 [2024-04-23 05:14:37.486582] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.387 [2024-04-23 05:14:37.486600] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.387 [2024-04-23 05:14:37.490106] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.387 [2024-04-23 05:14:37.499141] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.387 [2024-04-23 05:14:37.499570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.499722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.499750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.387 [2024-04-23 05:14:37.499768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.387 [2024-04-23 05:14:37.500006] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.387 [2024-04-23 05:14:37.500248] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.387 [2024-04-23 05:14:37.500272] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.387 [2024-04-23 05:14:37.500293] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.387 [2024-04-23 05:14:37.503856] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.387 [2024-04-23 05:14:37.513090] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.387 [2024-04-23 05:14:37.513484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.513649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.513678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.387 [2024-04-23 05:14:37.513696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.387 [2024-04-23 05:14:37.513935] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.387 [2024-04-23 05:14:37.514176] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.387 [2024-04-23 05:14:37.514200] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.387 [2024-04-23 05:14:37.514215] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.387 [2024-04-23 05:14:37.517782] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.387 [2024-04-23 05:14:37.527015] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.387 [2024-04-23 05:14:37.527400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.527557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.527583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.387 [2024-04-23 05:14:37.527599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.387 [2024-04-23 05:14:37.527846] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.387 [2024-04-23 05:14:37.528088] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.387 [2024-04-23 05:14:37.528112] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.387 [2024-04-23 05:14:37.528128] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.387 [2024-04-23 05:14:37.531692] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.387 [2024-04-23 05:14:37.540964] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.387 [2024-04-23 05:14:37.541384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.541559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.387 [2024-04-23 05:14:37.541589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.387 [2024-04-23 05:14:37.541608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.387 [2024-04-23 05:14:37.541873] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.387 [2024-04-23 05:14:37.542130] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.387 [2024-04-23 05:14:37.542156] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.387 [2024-04-23 05:14:37.542172] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.647 [2024-04-23 05:14:37.545982] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.647 [2024-04-23 05:14:37.554946] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.647 [2024-04-23 05:14:37.555404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.555555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.555585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.647 [2024-04-23 05:14:37.555604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.647 [2024-04-23 05:14:37.555863] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.647 [2024-04-23 05:14:37.556117] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.647 [2024-04-23 05:14:37.556142] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.647 [2024-04-23 05:14:37.556159] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.647 [2024-04-23 05:14:37.559740] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.647 [2024-04-23 05:14:37.568842] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.647 [2024-04-23 05:14:37.569243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.569403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.569432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.647 [2024-04-23 05:14:37.569450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.647 [2024-04-23 05:14:37.569699] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.647 [2024-04-23 05:14:37.569941] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.647 [2024-04-23 05:14:37.569964] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.647 [2024-04-23 05:14:37.569980] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.647 [2024-04-23 05:14:37.573538] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.647 [2024-04-23 05:14:37.582773] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.647 [2024-04-23 05:14:37.583185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.583317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.583345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.647 [2024-04-23 05:14:37.583363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.647 [2024-04-23 05:14:37.583612] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.647 [2024-04-23 05:14:37.583854] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.647 [2024-04-23 05:14:37.583878] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.647 [2024-04-23 05:14:37.583894] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.647 [2024-04-23 05:14:37.587447] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.647 [2024-04-23 05:14:37.596705] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.647 [2024-04-23 05:14:37.597099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.597253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.597282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.647 [2024-04-23 05:14:37.597300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.647 [2024-04-23 05:14:37.597549] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.647 [2024-04-23 05:14:37.597791] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.647 [2024-04-23 05:14:37.597815] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.647 [2024-04-23 05:14:37.597831] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.647 [2024-04-23 05:14:37.601383] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.647 [2024-04-23 05:14:37.610617] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.647 [2024-04-23 05:14:37.611030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.611194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.611222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.647 [2024-04-23 05:14:37.611239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.647 [2024-04-23 05:14:37.611476] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.647 [2024-04-23 05:14:37.611728] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.647 [2024-04-23 05:14:37.611753] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.647 [2024-04-23 05:14:37.611768] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.647 [2024-04-23 05:14:37.615323] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.647 [2024-04-23 05:14:37.624569] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.647 [2024-04-23 05:14:37.624977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.625156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.647 [2024-04-23 05:14:37.625184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.647 [2024-04-23 05:14:37.625201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.647 [2024-04-23 05:14:37.625439] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.625691] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.625716] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.625732] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.629285] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.638513] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.638934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.639094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.639122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.639140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.639378] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.639630] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.639655] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.639671] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.643225] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.652460] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.652826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.652981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.653009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.653026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.653264] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.653505] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.653539] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.653556] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.657108] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.666410] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.666830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.666985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.667013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.667031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.667269] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.667510] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.667546] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.667562] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.671116] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.680345] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.680737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.680918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.680952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.680971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.681209] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.681449] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.681473] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.681489] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.685051] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.694285] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.694702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.694835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.694864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.694882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.695119] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.695360] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.695384] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.695399] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.698960] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.708186] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.708614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.708734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.708762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.708780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.709017] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.709258] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.709282] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.709298] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.712861] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.722137] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.722530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.722682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.722710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.722734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.722972] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.648 [2024-04-23 05:14:37.723213] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.648 [2024-04-23 05:14:37.723237] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.648 [2024-04-23 05:14:37.723253] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.648 [2024-04-23 05:14:37.726819] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.648 [2024-04-23 05:14:37.736058] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.648 [2024-04-23 05:14:37.736469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.736620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.648 [2024-04-23 05:14:37.736649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.648 [2024-04-23 05:14:37.736667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.648 [2024-04-23 05:14:37.736905] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.649 [2024-04-23 05:14:37.737147] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.649 [2024-04-23 05:14:37.737171] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.649 [2024-04-23 05:14:37.737187] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.649 [2024-04-23 05:14:37.740749] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.649 [2024-04-23 05:14:37.749981] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.649 [2024-04-23 05:14:37.750393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.750571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.750600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.649 [2024-04-23 05:14:37.750619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.649 [2024-04-23 05:14:37.750857] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.649 [2024-04-23 05:14:37.751099] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.649 [2024-04-23 05:14:37.751122] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.649 [2024-04-23 05:14:37.751137] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.649 [2024-04-23 05:14:37.754697] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.649 [2024-04-23 05:14:37.763932] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.649 [2024-04-23 05:14:37.764337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.764523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.764552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.649 [2024-04-23 05:14:37.764570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.649 [2024-04-23 05:14:37.764813] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.649 [2024-04-23 05:14:37.765055] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.649 [2024-04-23 05:14:37.765078] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.649 [2024-04-23 05:14:37.765094] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.649 [2024-04-23 05:14:37.768651] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.649 [2024-04-23 05:14:37.777922] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.649 [2024-04-23 05:14:37.778311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.778468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.778496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.649 [2024-04-23 05:14:37.778524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.649 [2024-04-23 05:14:37.778765] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.649 [2024-04-23 05:14:37.779006] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.649 [2024-04-23 05:14:37.779030] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.649 [2024-04-23 05:14:37.779046] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.649 [2024-04-23 05:14:37.782606] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.649 [2024-04-23 05:14:37.791867] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.649 [2024-04-23 05:14:37.792270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.792449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.792478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.649 [2024-04-23 05:14:37.792497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.649 [2024-04-23 05:14:37.792745] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.649 [2024-04-23 05:14:37.792988] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.649 [2024-04-23 05:14:37.793012] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.649 [2024-04-23 05:14:37.793028] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.649 [2024-04-23 05:14:37.796587] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.649 [2024-04-23 05:14:37.805811] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.649 [2024-04-23 05:14:37.806222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.806481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.649 [2024-04-23 05:14:37.806551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.649 [2024-04-23 05:14:37.806570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.649 [2024-04-23 05:14:37.806807] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.649 [2024-04-23 05:14:37.807054] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.649 [2024-04-23 05:14:37.807078] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.649 [2024-04-23 05:14:37.807094] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.649 [2024-04-23 05:14:37.810867] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.909 [2024-04-23 05:14:37.819818] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.909 [2024-04-23 05:14:37.820250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.820497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.820601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.909 [2024-04-23 05:14:37.820621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.909 [2024-04-23 05:14:37.820860] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.909 [2024-04-23 05:14:37.821101] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.909 [2024-04-23 05:14:37.821125] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.909 [2024-04-23 05:14:37.821141] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.909 [2024-04-23 05:14:37.824704] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.909 [2024-04-23 05:14:37.833734] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.909 [2024-04-23 05:14:37.834116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.834407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.834455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.909 [2024-04-23 05:14:37.834473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.909 [2024-04-23 05:14:37.834722] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.909 [2024-04-23 05:14:37.834966] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.909 [2024-04-23 05:14:37.834990] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.909 [2024-04-23 05:14:37.835005] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.909 [2024-04-23 05:14:37.838566] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.909 [2024-04-23 05:14:37.847591] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.909 [2024-04-23 05:14:37.848014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.848207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.848259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.909 [2024-04-23 05:14:37.848278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.909 [2024-04-23 05:14:37.848525] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.909 [2024-04-23 05:14:37.848768] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.909 [2024-04-23 05:14:37.848797] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.909 [2024-04-23 05:14:37.848813] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.909 [2024-04-23 05:14:37.852364] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.909 [2024-04-23 05:14:37.861611] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.909 [2024-04-23 05:14:37.862030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.862208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.909 [2024-04-23 05:14:37.862237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.909 [2024-04-23 05:14:37.862255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.909 [2024-04-23 05:14:37.862493] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.862745] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.862769] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.862785] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.866338] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.875523] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.875920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.876101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.876129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.910 [2024-04-23 05:14:37.876148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.910 [2024-04-23 05:14:37.876387] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.876641] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.876666] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.876682] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.880235] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.889464] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.889880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.890029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.890058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.910 [2024-04-23 05:14:37.890076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.910 [2024-04-23 05:14:37.890314] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.890566] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.890591] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.890612] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.894165] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.903393] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.903785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.904008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.904038] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.910 [2024-04-23 05:14:37.904056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.910 [2024-04-23 05:14:37.904294] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.904546] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.904571] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.904587] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.908137] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.917374] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.917792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.918046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.918100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.910 [2024-04-23 05:14:37.918118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.910 [2024-04-23 05:14:37.918356] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.918609] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.918634] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.918649] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.922200] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.931218] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.931629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.931782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.931810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.910 [2024-04-23 05:14:37.931828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.910 [2024-04-23 05:14:37.932067] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.932309] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.932332] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.932348] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.935921] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.945165] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.945550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.945716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.945745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.910 [2024-04-23 05:14:37.945763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.910 [2024-04-23 05:14:37.946001] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.946242] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.946266] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.946281] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.949844] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.959084] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.959492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.959654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.959683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.910 [2024-04-23 05:14:37.959703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.910 [2024-04-23 05:14:37.959941] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.910 [2024-04-23 05:14:37.960182] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.910 [2024-04-23 05:14:37.960206] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.910 [2024-04-23 05:14:37.960222] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.910 [2024-04-23 05:14:37.963808] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.910 [2024-04-23 05:14:37.973047] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.910 [2024-04-23 05:14:37.973455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.973616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.910 [2024-04-23 05:14:37.973646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:37.973664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:37.973902] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:37.974144] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:37.974168] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:37.974184] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.911 [2024-04-23 05:14:37.977747] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.911 [2024-04-23 05:14:37.987058] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.911 [2024-04-23 05:14:37.987446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:37.987599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:37.987630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:37.987649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:37.987888] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:37.988129] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:37.988153] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:37.988168] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.911 [2024-04-23 05:14:37.991733] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.911 [2024-04-23 05:14:38.000973] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.911 [2024-04-23 05:14:38.001392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.001542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.001572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:38.001590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:38.001828] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:38.002069] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:38.002093] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:38.002109] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.911 [2024-04-23 05:14:38.005674] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.911 [2024-04-23 05:14:38.014914] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.911 [2024-04-23 05:14:38.015334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.015510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.015548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:38.015566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:38.015804] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:38.016045] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:38.016069] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:38.016084] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.911 [2024-04-23 05:14:38.019649] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.911 [2024-04-23 05:14:38.028890] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.911 [2024-04-23 05:14:38.029324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.029505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.029541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:38.029560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:38.029798] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:38.030040] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:38.030063] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:38.030079] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.911 [2024-04-23 05:14:38.033642] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.911 [2024-04-23 05:14:38.042880] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.911 [2024-04-23 05:14:38.043331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.043532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.043561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:38.043580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:38.043817] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:38.044059] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:38.044082] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:38.044098] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.911 [2024-04-23 05:14:38.047664] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.911 [2024-04-23 05:14:38.056897] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.911 [2024-04-23 05:14:38.057346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.057498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.057532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:38.057551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:38.057789] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:38.058030] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:38.058054] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:38.058069] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.911 [2024-04-23 05:14:38.061634] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.911 [2024-04-23 05:14:38.070972] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.911 [2024-04-23 05:14:38.071455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.071643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.911 [2024-04-23 05:14:38.071689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:58.911 [2024-04-23 05:14:38.071712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:58.911 [2024-04-23 05:14:38.071952] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:58.911 [2024-04-23 05:14:38.072211] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.911 [2024-04-23 05:14:38.072237] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.911 [2024-04-23 05:14:38.072253] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.170 [2024-04-23 05:14:38.075999] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.170 [2024-04-23 05:14:38.084966] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.170 [2024-04-23 05:14:38.085452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.170 [2024-04-23 05:14:38.085614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.170 [2024-04-23 05:14:38.085643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.170 [2024-04-23 05:14:38.085662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.170 [2024-04-23 05:14:38.085900] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.170 [2024-04-23 05:14:38.086142] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.170 [2024-04-23 05:14:38.086166] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.170 [2024-04-23 05:14:38.086182] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.170 [2024-04-23 05:14:38.089743] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.170 [2024-04-23 05:14:38.098976] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.170 [2024-04-23 05:14:38.099454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.170 [2024-04-23 05:14:38.099572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.170 [2024-04-23 05:14:38.099602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.099620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.099858] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.100100] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.100123] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.100139] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.103705] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.112943] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.113354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.113531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.113561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.113587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.113827] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.114068] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.114091] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.114107] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.117671] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.126904] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.127294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.127474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.127503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.127531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.127771] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.128013] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.128036] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.128052] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.131612] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.140840] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.141227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.141372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.141401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.141418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.141668] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.141910] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.141934] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.141949] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.145504] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.154740] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.155149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.155326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.155354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.155372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.155626] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.155869] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.155893] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.155908] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.159459] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.168693] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.169117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.169316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.169361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.169379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.169652] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.169895] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.169918] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.169934] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.173490] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.182523] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.182944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.183065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.183094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.183112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.183349] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.183602] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.183627] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.183642] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.187236] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.196467] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.196888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.197071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.197100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.197118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.197356] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.197615] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.197640] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.197655] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.201209] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.210439] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.210856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.211012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.211042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.211060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.211298] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.211552] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.211576] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.171 [2024-04-23 05:14:38.211592] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.171 [2024-04-23 05:14:38.215146] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.171 [2024-04-23 05:14:38.224384] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.171 [2024-04-23 05:14:38.224804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.224952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.171 [2024-04-23 05:14:38.224981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.171 [2024-04-23 05:14:38.224999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.171 [2024-04-23 05:14:38.225236] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.171 [2024-04-23 05:14:38.225477] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.171 [2024-04-23 05:14:38.225501] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.225524] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.229081] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.172 [2024-04-23 05:14:38.238314] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.172 [2024-04-23 05:14:38.238704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.238863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.238891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.172 [2024-04-23 05:14:38.238909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.172 [2024-04-23 05:14:38.239146] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.172 [2024-04-23 05:14:38.239388] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.172 [2024-04-23 05:14:38.239416] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.239433] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.242997] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.172 [2024-04-23 05:14:38.252233] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.172 [2024-04-23 05:14:38.252624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.252782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.252811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.172 [2024-04-23 05:14:38.252828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.172 [2024-04-23 05:14:38.253065] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.172 [2024-04-23 05:14:38.253306] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.172 [2024-04-23 05:14:38.253329] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.253345] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.256910] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.172 [2024-04-23 05:14:38.266142] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.172 [2024-04-23 05:14:38.266574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.266736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.266764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.172 [2024-04-23 05:14:38.266783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.172 [2024-04-23 05:14:38.267020] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.172 [2024-04-23 05:14:38.267261] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.172 [2024-04-23 05:14:38.267284] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.267300] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.270863] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.172 [2024-04-23 05:14:38.280094] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.172 [2024-04-23 05:14:38.280576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.280729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.280758] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.172 [2024-04-23 05:14:38.280776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.172 [2024-04-23 05:14:38.281014] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.172 [2024-04-23 05:14:38.281255] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.172 [2024-04-23 05:14:38.281278] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.281299] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.284864] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.172 [2024-04-23 05:14:38.294098] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.172 [2024-04-23 05:14:38.294484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.294669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.294698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.172 [2024-04-23 05:14:38.294717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.172 [2024-04-23 05:14:38.294955] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.172 [2024-04-23 05:14:38.295197] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.172 [2024-04-23 05:14:38.295221] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.295237] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.298796] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.172 [2024-04-23 05:14:38.308037] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.172 [2024-04-23 05:14:38.308458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.308655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.308683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.172 [2024-04-23 05:14:38.308702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.172 [2024-04-23 05:14:38.308939] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.172 [2024-04-23 05:14:38.309181] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.172 [2024-04-23 05:14:38.309205] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.309221] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.312783] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.172 [2024-04-23 05:14:38.322032] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.172 [2024-04-23 05:14:38.322422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.322580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.172 [2024-04-23 05:14:38.322609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.172 [2024-04-23 05:14:38.322628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.172 [2024-04-23 05:14:38.322865] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.172 [2024-04-23 05:14:38.323107] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.172 [2024-04-23 05:14:38.323130] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.172 [2024-04-23 05:14:38.323146] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.172 [2024-04-23 05:14:38.326713] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.432 [2024-04-23 05:14:38.336293] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.432 [2024-04-23 05:14:38.336730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.336917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.336947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.432 [2024-04-23 05:14:38.336966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.432 [2024-04-23 05:14:38.337205] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.432 [2024-04-23 05:14:38.337447] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.432 [2024-04-23 05:14:38.337470] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.432 [2024-04-23 05:14:38.337486] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.432 [2024-04-23 05:14:38.341222] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.432 [2024-04-23 05:14:38.350276] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.432 [2024-04-23 05:14:38.350678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.350927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.350956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.432 [2024-04-23 05:14:38.350976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.432 [2024-04-23 05:14:38.351215] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.432 [2024-04-23 05:14:38.351456] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.432 [2024-04-23 05:14:38.351480] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.432 [2024-04-23 05:14:38.351496] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.432 [2024-04-23 05:14:38.355060] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.432 [2024-04-23 05:14:38.364292] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.432 [2024-04-23 05:14:38.364684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.364868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.364897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.432 [2024-04-23 05:14:38.364915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.432 [2024-04-23 05:14:38.365153] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.432 [2024-04-23 05:14:38.365395] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.432 [2024-04-23 05:14:38.365419] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.432 [2024-04-23 05:14:38.365435] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.432 [2024-04-23 05:14:38.368997] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.432 [2024-04-23 05:14:38.378232] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.432 [2024-04-23 05:14:38.378666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.378879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.378926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.432 [2024-04-23 05:14:38.378945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.432 [2024-04-23 05:14:38.379182] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.432 [2024-04-23 05:14:38.379424] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.432 [2024-04-23 05:14:38.379448] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.432 [2024-04-23 05:14:38.379463] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.432 [2024-04-23 05:14:38.383033] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.432 [2024-04-23 05:14:38.392066] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.432 [2024-04-23 05:14:38.392481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.392642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.392671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.432 [2024-04-23 05:14:38.392689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.432 [2024-04-23 05:14:38.392927] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.432 [2024-04-23 05:14:38.393168] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.432 [2024-04-23 05:14:38.393193] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.432 [2024-04-23 05:14:38.393208] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.432 [2024-04-23 05:14:38.396812] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.432 [2024-04-23 05:14:38.406043] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.432 [2024-04-23 05:14:38.406463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.406647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.406677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.432 [2024-04-23 05:14:38.406695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.432 [2024-04-23 05:14:38.406934] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.432 [2024-04-23 05:14:38.407175] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.432 [2024-04-23 05:14:38.407199] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.432 [2024-04-23 05:14:38.407215] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.432 [2024-04-23 05:14:38.410777] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.432 [2024-04-23 05:14:38.420041] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.432 [2024-04-23 05:14:38.420460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.420630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.432 [2024-04-23 05:14:38.420660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.420679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.420917] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.421158] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.421182] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.421197] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.424771] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.434059] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.434442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.434603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.434633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.434651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.434889] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.435130] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.435154] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.435170] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.438733] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.447978] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.448387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.448538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.448568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.448586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.448824] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.449065] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.449089] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.449104] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.452672] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.461902] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.462292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.462443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.462476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.462495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.462740] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.462983] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.463006] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.463022] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.466576] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.475808] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.476218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.476363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.476391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.476409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.476658] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.476901] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.476924] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.476940] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.480495] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.489753] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.490164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.490295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.490324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.490342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.490591] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.490833] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.490858] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.490873] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.494426] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.503672] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.504062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.504237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.504266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.504289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.504537] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.504789] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.504813] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.504829] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.508386] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.517643] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.518044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.518167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.518195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.518214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.518450] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.518702] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.518727] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.518742] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.522298] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.531548] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.531954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.532135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.532163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.532181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.532418] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.532673] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.433 [2024-04-23 05:14:38.532697] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.433 [2024-04-23 05:14:38.532713] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.433 [2024-04-23 05:14:38.536271] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.433 [2024-04-23 05:14:38.545512] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.433 [2024-04-23 05:14:38.545883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.546039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.433 [2024-04-23 05:14:38.546067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.433 [2024-04-23 05:14:38.546085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.433 [2024-04-23 05:14:38.546329] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.433 [2024-04-23 05:14:38.546587] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.434 [2024-04-23 05:14:38.546612] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.434 [2024-04-23 05:14:38.546628] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.434 [2024-04-23 05:14:38.550181] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.434 [2024-04-23 05:14:38.559413] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.434 [2024-04-23 05:14:38.559835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.434 [2024-04-23 05:14:38.559956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.434 [2024-04-23 05:14:38.559986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.434 [2024-04-23 05:14:38.560004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.434 [2024-04-23 05:14:38.560242] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.434 [2024-04-23 05:14:38.560483] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.434 [2024-04-23 05:14:38.560506] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.434 [2024-04-23 05:14:38.560534] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.434 [2024-04-23 05:14:38.564093] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.434 [2024-04-23 05:14:38.573333] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.434 [2024-04-23 05:14:38.573730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.434 [2024-04-23 05:14:38.573858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.434 [2024-04-23 05:14:38.573888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.434 [2024-04-23 05:14:38.573906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.434 [2024-04-23 05:14:38.574144] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.434 [2024-04-23 05:14:38.574385] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.434 [2024-04-23 05:14:38.574408] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.434 [2024-04-23 05:14:38.574424] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.434 [2024-04-23 05:14:38.577989] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.434 [2024-04-23 05:14:38.587227] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.434 [2024-04-23 05:14:38.587647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.434 [2024-04-23 05:14:38.587813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.434 [2024-04-23 05:14:38.587841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.434 [2024-04-23 05:14:38.587859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.434 [2024-04-23 05:14:38.588096] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.434 [2024-04-23 05:14:38.588344] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.434 [2024-04-23 05:14:38.588367] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.434 [2024-04-23 05:14:38.588383] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.434 [2024-04-23 05:14:38.591950] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.601186] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.601600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.601786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.601821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.601841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.602123] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.602368] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.602392] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.602408] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.606012] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.615050] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.615534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.615745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.615794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.615813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.616051] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.616292] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.616316] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.616332] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.619905] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.628941] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.629354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.629509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.629546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.629565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.629803] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.630045] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.630074] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.630091] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.633659] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.642901] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.643289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.643469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.643497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.643524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.643766] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.644007] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.644029] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.644044] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.647615] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.656867] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.657293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.657447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.657475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.657493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.657740] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.657983] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.658006] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.658022] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.661586] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.670835] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.671360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.671545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.671575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.671593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.671830] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.672072] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.672096] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.672117] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.675693] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.684799] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.685187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.685340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.685370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.685388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.685638] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.685880] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.685903] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.685919] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.689478] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.698720] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.694 [2024-04-23 05:14:38.699115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.699348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-04-23 05:14:38.699399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.694 [2024-04-23 05:14:38.699418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.694 [2024-04-23 05:14:38.699668] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.694 [2024-04-23 05:14:38.699910] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.694 [2024-04-23 05:14:38.699933] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.694 [2024-04-23 05:14:38.699949] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.694 [2024-04-23 05:14:38.703505] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.694 [2024-04-23 05:14:38.712537] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.712945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.713104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.713132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.713150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.713388] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.713641] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.713666] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.713682] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.717250] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.726482] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.726896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.727053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.727081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.727099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.727337] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.727591] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.727616] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.727632] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.731187] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.740442] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.740837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.741029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.741058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.741076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.741313] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.741566] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.741591] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.741607] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.745163] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.754432] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.754828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.754973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.755001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.755019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.755257] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.755499] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.755533] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.755551] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.759107] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.768365] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.768783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.768981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.769030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.769048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.769286] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.769537] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.769561] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.769577] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.773136] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.782365] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.782863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.783113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.783142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.783160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.783398] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.783651] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.783675] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.783691] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.787246] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.796272] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.796771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.796948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.796976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.796994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.797232] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.797473] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.797496] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.797512] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.801085] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.810168] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.810563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.810696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.810725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.810743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.810981] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.811223] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.811247] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.811263] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.814830] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.824071] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.824537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.824804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.824862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.824880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.695 [2024-04-23 05:14:38.825118] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.695 [2024-04-23 05:14:38.825359] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.695 [2024-04-23 05:14:38.825383] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.695 [2024-04-23 05:14:38.825399] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.695 [2024-04-23 05:14:38.828963] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.695 [2024-04-23 05:14:38.838002] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.695 [2024-04-23 05:14:38.838469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.838693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-04-23 05:14:38.838721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.695 [2024-04-23 05:14:38.838739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.696 [2024-04-23 05:14:38.838977] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.696 [2024-04-23 05:14:38.839218] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.696 [2024-04-23 05:14:38.839241] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.696 [2024-04-23 05:14:38.839257] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.696 [2024-04-23 05:14:38.842823] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.696 [2024-04-23 05:14:38.851851] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.696 [2024-04-23 05:14:38.852256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-04-23 05:14:38.852409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-04-23 05:14:38.852443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.696 [2024-04-23 05:14:38.852462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.696 [2024-04-23 05:14:38.852712] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.696 [2024-04-23 05:14:38.852953] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.696 [2024-04-23 05:14:38.852977] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.696 [2024-04-23 05:14:38.852993] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.696 [2024-04-23 05:14:38.856753] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.865912] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.866347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.866473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.866503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.956 [2024-04-23 05:14:38.866533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.956 [2024-04-23 05:14:38.866775] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.956 [2024-04-23 05:14:38.867017] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.956 [2024-04-23 05:14:38.867041] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.956 [2024-04-23 05:14:38.867057] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.956 [2024-04-23 05:14:38.870625] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.879862] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.880252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.880432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.880461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.956 [2024-04-23 05:14:38.880478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.956 [2024-04-23 05:14:38.880727] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.956 [2024-04-23 05:14:38.880969] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.956 [2024-04-23 05:14:38.880993] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.956 [2024-04-23 05:14:38.881009] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.956 [2024-04-23 05:14:38.884573] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.893897] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.894310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.894466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.894495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.956 [2024-04-23 05:14:38.894527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.956 [2024-04-23 05:14:38.894769] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.956 [2024-04-23 05:14:38.895011] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.956 [2024-04-23 05:14:38.895035] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.956 [2024-04-23 05:14:38.895051] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.956 [2024-04-23 05:14:38.898614] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.907854] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.908269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.908422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.908450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.956 [2024-04-23 05:14:38.908468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.956 [2024-04-23 05:14:38.908716] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.956 [2024-04-23 05:14:38.908958] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.956 [2024-04-23 05:14:38.908982] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.956 [2024-04-23 05:14:38.908998] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.956 [2024-04-23 05:14:38.912561] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.921796] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.922206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.922383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.922411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.956 [2024-04-23 05:14:38.922429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.956 [2024-04-23 05:14:38.922678] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.956 [2024-04-23 05:14:38.922920] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.956 [2024-04-23 05:14:38.922944] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.956 [2024-04-23 05:14:38.922960] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.956 [2024-04-23 05:14:38.926523] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.935760] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.936189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.936405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.936453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.956 [2024-04-23 05:14:38.936472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.956 [2024-04-23 05:14:38.936727] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.956 [2024-04-23 05:14:38.936970] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.956 [2024-04-23 05:14:38.936994] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.956 [2024-04-23 05:14:38.937010] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.956 [2024-04-23 05:14:38.940574] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.949601] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.950115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.950407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.950456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.956 [2024-04-23 05:14:38.950474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.956 [2024-04-23 05:14:38.950723] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.956 [2024-04-23 05:14:38.950966] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.956 [2024-04-23 05:14:38.950990] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.956 [2024-04-23 05:14:38.951005] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.956 [2024-04-23 05:14:38.954569] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.956 [2024-04-23 05:14:38.963598] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.956 [2024-04-23 05:14:38.963980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.964113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.956 [2024-04-23 05:14:38.964142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:38.964160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:38.964397] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:38.964650] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:38.964675] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:38.964691] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:38.968245] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:38.977482] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:38.977896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:38.978041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:38.978069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:38.978088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:38.978325] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:38.978584] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:38.978609] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:38.978625] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:38.982180] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:38.991431] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:38.991825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:38.992010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:38.992038] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:38.992056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:38.992294] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:38.992546] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:38.992571] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:38.992587] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:38.996143] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:39.005385] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:39.005924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.006165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.006196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:39.006214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:39.006452] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:39.006704] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:39.006728] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:39.006744] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:39.010300] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:39.019388] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:39.019902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.020079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.020108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:39.020126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:39.020364] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:39.020617] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:39.020647] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:39.020663] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:39.024223] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:39.033252] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:39.033657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.033902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.033953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:39.033971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:39.034209] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:39.034452] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:39.034475] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:39.034491] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:39.038054] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:39.047079] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:39.047505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.047692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.047721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:39.047739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:39.047976] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:39.048219] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:39.048242] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:39.048258] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:39.051821] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:39.061065] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:39.061472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.061660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.061689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:39.061707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:39.061945] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:39.062187] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:39.062211] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:39.062231] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:39.065803] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:39.075059] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:39.075450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.075618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.075648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:39.075666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:39.075904] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:39.076146] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.957 [2024-04-23 05:14:39.076170] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.957 [2024-04-23 05:14:39.076185] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.957 [2024-04-23 05:14:39.079753] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.957 [2024-04-23 05:14:39.089010] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.957 [2024-04-23 05:14:39.089394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.089576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.957 [2024-04-23 05:14:39.089607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.957 [2024-04-23 05:14:39.089626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.957 [2024-04-23 05:14:39.089863] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.957 [2024-04-23 05:14:39.090106] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.958 [2024-04-23 05:14:39.090130] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.958 [2024-04-23 05:14:39.090145] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.958 [2024-04-23 05:14:39.093733] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.958 [2024-04-23 05:14:39.102983] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.958 [2024-04-23 05:14:39.103401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.958 [2024-04-23 05:14:39.103557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.958 [2024-04-23 05:14:39.103586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.958 [2024-04-23 05:14:39.103605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.958 [2024-04-23 05:14:39.103842] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.958 [2024-04-23 05:14:39.104084] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.958 [2024-04-23 05:14:39.104108] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.958 [2024-04-23 05:14:39.104124] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.958 [2024-04-23 05:14:39.107700] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.958 [2024-04-23 05:14:39.117060] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.958 [2024-04-23 05:14:39.117494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.958 [2024-04-23 05:14:39.117668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.958 [2024-04-23 05:14:39.117698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:29:59.958 [2024-04-23 05:14:39.117717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:29:59.958 [2024-04-23 05:14:39.117979] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:29:59.958 [2024-04-23 05:14:39.118262] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.958 [2024-04-23 05:14:39.118288] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.958 [2024-04-23 05:14:39.118304] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.217 [2024-04-23 05:14:39.122089] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.217 [2024-04-23 05:14:39.131101] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.217 [2024-04-23 05:14:39.131508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.217 [2024-04-23 05:14:39.131653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.217 [2024-04-23 05:14:39.131683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.217 [2024-04-23 05:14:39.131701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.217 [2024-04-23 05:14:39.131940] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.217 [2024-04-23 05:14:39.132182] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.217 [2024-04-23 05:14:39.132205] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.217 [2024-04-23 05:14:39.132221] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.217 [2024-04-23 05:14:39.135799] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.217 [2024-04-23 05:14:39.145073] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.217 [2024-04-23 05:14:39.145462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.217 [2024-04-23 05:14:39.145656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.217 [2024-04-23 05:14:39.145685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.217 [2024-04-23 05:14:39.145704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.145942] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.146184] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.146208] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.146223] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.149796] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.159054] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.159468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.159632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.159661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.159679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.159917] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.160158] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.160182] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.160197] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.163769] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.173039] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.173429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.173587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.173617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.173635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.173872] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.174114] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.174137] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.174153] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.177727] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.186981] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.187398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.187552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.187581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.187599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.187836] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.188078] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.188102] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.188117] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.191689] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.200945] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.201437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.201631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.201660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.201679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.201917] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.202158] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.202182] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.202197] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.205767] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.214819] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.215280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.215458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.215486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.215504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.215752] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.215994] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.216018] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.216033] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.219604] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.228684] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.229075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.229255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.229283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.229302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.229548] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.229797] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.229821] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.229837] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.233398] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.242661] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.243169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.243340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.243373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.243392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.243640] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.243882] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.243906] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.243922] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.247491] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.256547] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.256999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.257176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.257204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.257222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.257459] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.257710] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.257735] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.257750] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.218 [2024-04-23 05:14:39.261310] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.218 [2024-04-23 05:14:39.270575] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.218 [2024-04-23 05:14:39.270934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.271058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.218 [2024-04-23 05:14:39.271086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.218 [2024-04-23 05:14:39.271104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.218 [2024-04-23 05:14:39.271341] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.218 [2024-04-23 05:14:39.271597] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.218 [2024-04-23 05:14:39.271621] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.218 [2024-04-23 05:14:39.271637] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.275197] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.219 [2024-04-23 05:14:39.284447] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.219 [2024-04-23 05:14:39.284868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.285058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.285086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.219 [2024-04-23 05:14:39.285110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.219 [2024-04-23 05:14:39.285348] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.219 [2024-04-23 05:14:39.285602] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.219 [2024-04-23 05:14:39.285626] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.219 [2024-04-23 05:14:39.285642] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.289197] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.219 [2024-04-23 05:14:39.298434] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.219 [2024-04-23 05:14:39.298861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.299052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.299081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.219 [2024-04-23 05:14:39.299098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.219 [2024-04-23 05:14:39.299337] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.219 [2024-04-23 05:14:39.299590] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.219 [2024-04-23 05:14:39.299614] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.219 [2024-04-23 05:14:39.299630] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.303183] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.219 [2024-04-23 05:14:39.312418] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.219 [2024-04-23 05:14:39.312822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.313045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.313073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.219 [2024-04-23 05:14:39.313091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.219 [2024-04-23 05:14:39.313329] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.219 [2024-04-23 05:14:39.313586] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.219 [2024-04-23 05:14:39.313610] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.219 [2024-04-23 05:14:39.313626] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.317185] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.219 [2024-04-23 05:14:39.326419] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.219 [2024-04-23 05:14:39.326836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.327012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.327059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.219 [2024-04-23 05:14:39.327077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.219 [2024-04-23 05:14:39.327321] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.219 [2024-04-23 05:14:39.327578] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.219 [2024-04-23 05:14:39.327603] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.219 [2024-04-23 05:14:39.327619] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.331175] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.219 [2024-04-23 05:14:39.340413] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.219 [2024-04-23 05:14:39.340827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.340983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.341013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.219 [2024-04-23 05:14:39.341031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.219 [2024-04-23 05:14:39.341270] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.219 [2024-04-23 05:14:39.341511] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.219 [2024-04-23 05:14:39.341546] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.219 [2024-04-23 05:14:39.341563] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.345122] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.219 [2024-04-23 05:14:39.354362] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.219 [2024-04-23 05:14:39.354769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.354957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.354986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.219 [2024-04-23 05:14:39.355004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.219 [2024-04-23 05:14:39.355243] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.219 [2024-04-23 05:14:39.355485] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.219 [2024-04-23 05:14:39.355508] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.219 [2024-04-23 05:14:39.355535] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.359092] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.219 [2024-04-23 05:14:39.368327] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.219 [2024-04-23 05:14:39.368727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.368932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.219 [2024-04-23 05:14:39.368966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.219 [2024-04-23 05:14:39.368999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.219 [2024-04-23 05:14:39.369238] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.219 [2024-04-23 05:14:39.369484] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.219 [2024-04-23 05:14:39.369508] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.219 [2024-04-23 05:14:39.369535] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.219 [2024-04-23 05:14:39.373096] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.479 [2024-04-23 05:14:39.382416] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.479 [2024-04-23 05:14:39.382835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.383005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.383035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.479 [2024-04-23 05:14:39.383053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.479 [2024-04-23 05:14:39.383293] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.479 [2024-04-23 05:14:39.383547] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.479 [2024-04-23 05:14:39.383572] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.479 [2024-04-23 05:14:39.383596] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.479 [2024-04-23 05:14:39.387234] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.479 [2024-04-23 05:14:39.396352] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.479 [2024-04-23 05:14:39.396777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.396933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.396962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.479 [2024-04-23 05:14:39.396980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.479 [2024-04-23 05:14:39.397219] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.479 [2024-04-23 05:14:39.397460] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.479 [2024-04-23 05:14:39.397484] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.479 [2024-04-23 05:14:39.397500] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.479 [2024-04-23 05:14:39.401069] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.479 [2024-04-23 05:14:39.410317] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.479 [2024-04-23 05:14:39.410714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.410859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.410888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.479 [2024-04-23 05:14:39.410905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.479 [2024-04-23 05:14:39.411144] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.479 [2024-04-23 05:14:39.411385] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.479 [2024-04-23 05:14:39.411416] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.479 [2024-04-23 05:14:39.411432] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.479 [2024-04-23 05:14:39.415011] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.479 [2024-04-23 05:14:39.424268] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.479 [2024-04-23 05:14:39.424695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.424846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.479 [2024-04-23 05:14:39.424874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.479 [2024-04-23 05:14:39.424893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.479 [2024-04-23 05:14:39.425131] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.479 [2024-04-23 05:14:39.425373] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.479 [2024-04-23 05:14:39.425396] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.425412] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.428986] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.438273] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.438701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.438842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.438890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.438909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.439147] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.439389] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.439412] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.439428] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.442993] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.452258] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.452677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.452801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.452829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.452847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.453085] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.453327] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.453351] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.453372] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.456941] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.466195] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.466601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.466782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.466811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.466829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.467067] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.467308] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.467332] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.467347] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.470922] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.480196] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.480621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.480803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.480831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.480850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.481087] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.481329] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.481352] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.481368] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.484938] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.494176] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.494577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.494722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.494750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.494769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.495006] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.495248] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.495272] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.495288] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.498858] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.508096] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.508481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.508642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.508672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.508690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.508928] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.509169] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.509193] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.509209] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.512774] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.522017] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.522426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.522598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.522626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.522644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.522889] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.523131] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.523155] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.523171] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.526732] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.535965] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.536388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.536540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.536569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.536587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.536825] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.537067] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.537091] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.537107] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.540669] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.549918] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.550313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.550467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.550495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.480 [2024-04-23 05:14:39.550513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.480 [2024-04-23 05:14:39.550760] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.480 [2024-04-23 05:14:39.551002] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.480 [2024-04-23 05:14:39.551026] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.480 [2024-04-23 05:14:39.551042] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.480 [2024-04-23 05:14:39.554628] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.480 [2024-04-23 05:14:39.563876] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.480 [2024-04-23 05:14:39.564269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.480 [2024-04-23 05:14:39.564404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.564432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.481 [2024-04-23 05:14:39.564450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.481 [2024-04-23 05:14:39.564698] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.481 [2024-04-23 05:14:39.564940] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.481 [2024-04-23 05:14:39.564965] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.481 [2024-04-23 05:14:39.564981] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.481 [2024-04-23 05:14:39.568546] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.481 [2024-04-23 05:14:39.577789] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.481 [2024-04-23 05:14:39.578171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.578351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.578380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.481 [2024-04-23 05:14:39.578398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.481 [2024-04-23 05:14:39.578645] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.481 [2024-04-23 05:14:39.578887] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.481 [2024-04-23 05:14:39.578910] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.481 [2024-04-23 05:14:39.578926] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.481 [2024-04-23 05:14:39.582481] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.481 [2024-04-23 05:14:39.591722] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.481 [2024-04-23 05:14:39.592136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.592282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.592310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.481 [2024-04-23 05:14:39.592328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.481 [2024-04-23 05:14:39.592576] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.481 [2024-04-23 05:14:39.592817] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.481 [2024-04-23 05:14:39.592841] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.481 [2024-04-23 05:14:39.592857] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.481 [2024-04-23 05:14:39.596408] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.481 [2024-04-23 05:14:39.605652] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.481 [2024-04-23 05:14:39.606038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.606191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.606221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.481 [2024-04-23 05:14:39.606240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.481 [2024-04-23 05:14:39.606478] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.481 [2024-04-23 05:14:39.606732] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.481 [2024-04-23 05:14:39.606758] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.481 [2024-04-23 05:14:39.606774] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.481 [2024-04-23 05:14:39.610324] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.481 [2024-04-23 05:14:39.619571] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.481 [2024-04-23 05:14:39.619957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.620111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.620141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.481 [2024-04-23 05:14:39.620160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.481 [2024-04-23 05:14:39.620398] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.481 [2024-04-23 05:14:39.620651] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.481 [2024-04-23 05:14:39.620675] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.481 [2024-04-23 05:14:39.620691] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.481 [2024-04-23 05:14:39.624245] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.481 [2024-04-23 05:14:39.633480] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.481 [2024-04-23 05:14:39.633874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.634030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.481 [2024-04-23 05:14:39.634059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.481 [2024-04-23 05:14:39.634077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.481 [2024-04-23 05:14:39.634315] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.481 [2024-04-23 05:14:39.634566] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.481 [2024-04-23 05:14:39.634590] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.481 [2024-04-23 05:14:39.634605] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.481 [2024-04-23 05:14:39.638159] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.741 [2024-04-23 05:14:39.647640] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.741 [2024-04-23 05:14:39.648062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.648235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.648276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.741 [2024-04-23 05:14:39.648309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.741 [2024-04-23 05:14:39.648575] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.741 [2024-04-23 05:14:39.648818] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.741 [2024-04-23 05:14:39.648842] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.741 [2024-04-23 05:14:39.648858] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.741 [2024-04-23 05:14:39.652511] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.741 [2024-04-23 05:14:39.661550] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.741 [2024-04-23 05:14:39.661951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.662113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.662142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.741 [2024-04-23 05:14:39.662160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.741 [2024-04-23 05:14:39.662399] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.741 [2024-04-23 05:14:39.662653] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.741 [2024-04-23 05:14:39.662678] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.741 [2024-04-23 05:14:39.662693] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.741 [2024-04-23 05:14:39.666247] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.741 [2024-04-23 05:14:39.675481] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.741 [2024-04-23 05:14:39.675902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.676060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.676088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.741 [2024-04-23 05:14:39.676112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.741 [2024-04-23 05:14:39.676350] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.741 [2024-04-23 05:14:39.676603] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.741 [2024-04-23 05:14:39.676628] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.741 [2024-04-23 05:14:39.676643] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.741 [2024-04-23 05:14:39.680196] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.741 [2024-04-23 05:14:39.689432] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.741 [2024-04-23 05:14:39.689809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.689958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.741 [2024-04-23 05:14:39.689987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.741 [2024-04-23 05:14:39.690005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.741 [2024-04-23 05:14:39.690243] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.741 [2024-04-23 05:14:39.690484] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.741 [2024-04-23 05:14:39.690507] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.741 [2024-04-23 05:14:39.690534] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.741 [2024-04-23 05:14:39.694089] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.741 [2024-04-23 05:14:39.703321] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.703747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.703890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.703918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.703936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.704174] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.704415] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.704439] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.704454] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.708017] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.717252] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.717611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.717778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.717806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.717824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.718067] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.718308] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.718332] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.718348] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.721909] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.731141] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.731528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.731685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.731714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.731732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.731970] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.732211] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.732235] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.732251] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.735816] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.745051] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.745416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.745580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.745609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.745627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.745864] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.746106] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.746129] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.746145] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.749708] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.758938] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.759323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.759481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.759510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.759538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.759777] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.760024] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.760048] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.760064] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.763622] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.772866] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.773246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.773373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.773401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.773419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.773666] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.773908] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.773931] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.773947] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.777503] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.786738] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.787142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.787325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.787353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.787370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.787618] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.787860] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.787884] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.787900] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.791453] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.800692] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.801115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.801263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.801291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.801309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.801557] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.801799] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.801828] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.801845] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.805398] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.814642] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.815051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.815204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.815234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.815252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.742 [2024-04-23 05:14:39.815489] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.742 [2024-04-23 05:14:39.815741] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.742 [2024-04-23 05:14:39.815765] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.742 [2024-04-23 05:14:39.815781] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.742 [2024-04-23 05:14:39.819338] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.742 [2024-04-23 05:14:39.828573] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.742 [2024-04-23 05:14:39.828963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.829146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.742 [2024-04-23 05:14:39.829174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.742 [2024-04-23 05:14:39.829192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.743 [2024-04-23 05:14:39.829429] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.743 [2024-04-23 05:14:39.829680] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.743 [2024-04-23 05:14:39.829705] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.743 [2024-04-23 05:14:39.829721] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.743 [2024-04-23 05:14:39.833272] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.743 [2024-04-23 05:14:39.842539] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.743 [2024-04-23 05:14:39.842947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.843104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.843132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.743 [2024-04-23 05:14:39.843150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.743 [2024-04-23 05:14:39.843387] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.743 [2024-04-23 05:14:39.843640] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.743 [2024-04-23 05:14:39.843664] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.743 [2024-04-23 05:14:39.843685] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.743 [2024-04-23 05:14:39.847240] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.743 [2024-04-23 05:14:39.856527] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.743 [2024-04-23 05:14:39.856918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.857097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.857125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.743 [2024-04-23 05:14:39.857143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.743 [2024-04-23 05:14:39.857380] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.743 [2024-04-23 05:14:39.857633] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.743 [2024-04-23 05:14:39.857658] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.743 [2024-04-23 05:14:39.857674] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.743 [2024-04-23 05:14:39.861225] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.743 [2024-04-23 05:14:39.870459] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.743 [2024-04-23 05:14:39.870863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.871018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.871047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.743 [2024-04-23 05:14:39.871065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.743 [2024-04-23 05:14:39.871302] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.743 [2024-04-23 05:14:39.871556] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.743 [2024-04-23 05:14:39.871581] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.743 [2024-04-23 05:14:39.871597] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.743 [2024-04-23 05:14:39.875151] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.743 [2024-04-23 05:14:39.884383] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.743 [2024-04-23 05:14:39.884777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.884941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.884969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.743 [2024-04-23 05:14:39.884987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.743 [2024-04-23 05:14:39.885225] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.743 [2024-04-23 05:14:39.885466] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.743 [2024-04-23 05:14:39.885489] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.743 [2024-04-23 05:14:39.885505] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.743 [2024-04-23 05:14:39.889075] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.743 [2024-04-23 05:14:39.898307] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.743 [2024-04-23 05:14:39.898702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.898857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.743 [2024-04-23 05:14:39.898887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:00.743 [2024-04-23 05:14:39.898905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:00.743 [2024-04-23 05:14:39.899143] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:00.743 [2024-04-23 05:14:39.899384] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.743 [2024-04-23 05:14:39.899408] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.743 [2024-04-23 05:14:39.899423] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.743 [2024-04-23 05:14:39.903093] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.003 [2024-04-23 05:14:39.912332] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.003 [2024-04-23 05:14:39.912771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.912924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.912953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.003 [2024-04-23 05:14:39.912971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.003 [2024-04-23 05:14:39.913210] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.003 [2024-04-23 05:14:39.913453] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.003 [2024-04-23 05:14:39.913477] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.003 [2024-04-23 05:14:39.913492] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.003 [2024-04-23 05:14:39.917067] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.003 [2024-04-23 05:14:39.926334] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.003 [2024-04-23 05:14:39.926740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.926895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.926923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.003 [2024-04-23 05:14:39.926941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.003 [2024-04-23 05:14:39.927179] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.003 [2024-04-23 05:14:39.927421] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.003 [2024-04-23 05:14:39.927444] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.003 [2024-04-23 05:14:39.927460] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.003 [2024-04-23 05:14:39.931023] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.003 [2024-04-23 05:14:39.940262] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.003 [2024-04-23 05:14:39.940656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.940802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.940830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.003 [2024-04-23 05:14:39.940848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.003 [2024-04-23 05:14:39.941086] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.003 [2024-04-23 05:14:39.941328] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.003 [2024-04-23 05:14:39.941352] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.003 [2024-04-23 05:14:39.941367] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.003 [2024-04-23 05:14:39.944929] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.003 [2024-04-23 05:14:39.954173] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.003 [2024-04-23 05:14:39.954561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.954696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.954726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.003 [2024-04-23 05:14:39.954744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.003 [2024-04-23 05:14:39.954982] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.003 [2024-04-23 05:14:39.955223] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.003 [2024-04-23 05:14:39.955247] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.003 [2024-04-23 05:14:39.955263] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.003 [2024-04-23 05:14:39.958825] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.003 [2024-04-23 05:14:39.968082] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.003 [2024-04-23 05:14:39.968505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.968661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.003 [2024-04-23 05:14:39.968689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.003 [2024-04-23 05:14:39.968707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:39.968945] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:39.969186] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:39.969210] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:39.969225] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:39.972790] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:39.982038] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:39.982453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:39.982608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:39.982639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:39.982657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:39.982895] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:39.983136] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:39.983160] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:39.983176] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:39.986740] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:39.995974] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:39.996385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:39.996536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:39.996566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:39.996584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:39.996822] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:39.997063] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:39.997087] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:39.997103] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:40.000663] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:40.009538] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:40.009979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.010123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.010148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:40.010165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:40.010395] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:40.010649] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:40.010671] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:40.010686] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:40.013839] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:40.023143] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:40.023535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.023707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.023733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:40.023749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:40.023993] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:40.024198] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:40.024219] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:40.024232] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:40.027458] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:40.036458] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:40.036859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.037008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.037034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:40.037050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:40.037278] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:40.037499] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:40.037544] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:40.037561] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:40.040643] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:40.049925] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:40.050330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.050473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.050499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:40.050522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:40.050738] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:40.050976] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:40.050997] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:40.051010] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:40.054135] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:40.063359] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:40.063745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.063916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.063943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:40.063968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:40.064223] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:40.064422] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:40.064441] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:40.064454] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:40.067626] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:40.076782] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:40.077143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.077294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.077321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:40.077337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:40.077592] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:40.077811] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:40.077833] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:40.077847] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.004 [2024-04-23 05:14:40.081039] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.004 [2024-04-23 05:14:40.090086] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.004 [2024-04-23 05:14:40.090552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.090671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.004 [2024-04-23 05:14:40.090697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.004 [2024-04-23 05:14:40.090714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.004 [2024-04-23 05:14:40.090944] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.004 [2024-04-23 05:14:40.091176] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.004 [2024-04-23 05:14:40.091197] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.004 [2024-04-23 05:14:40.091210] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.005 [2024-04-23 05:14:40.094224] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.005 [2024-04-23 05:14:40.103400] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.005 [2024-04-23 05:14:40.103786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.103925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.103949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.005 [2024-04-23 05:14:40.103965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.005 [2024-04-23 05:14:40.104176] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.005 [2024-04-23 05:14:40.104397] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.005 [2024-04-23 05:14:40.104417] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.005 [2024-04-23 05:14:40.104430] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.005 [2024-04-23 05:14:40.107498] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.005 [2024-04-23 05:14:40.116757] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.005 [2024-04-23 05:14:40.117123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.117274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.117299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.005 [2024-04-23 05:14:40.117315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.005 [2024-04-23 05:14:40.117539] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.005 [2024-04-23 05:14:40.117757] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.005 [2024-04-23 05:14:40.117778] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.005 [2024-04-23 05:14:40.117806] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.005 [2024-04-23 05:14:40.120978] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.005 [2024-04-23 05:14:40.130157] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.005 [2024-04-23 05:14:40.130553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.130670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.130696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.005 [2024-04-23 05:14:40.130713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.005 [2024-04-23 05:14:40.130941] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.005 [2024-04-23 05:14:40.131155] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.005 [2024-04-23 05:14:40.131174] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.005 [2024-04-23 05:14:40.131187] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.005 [2024-04-23 05:14:40.134282] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.005 [2024-04-23 05:14:40.143508] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.005 [2024-04-23 05:14:40.143896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.144005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.144030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.005 [2024-04-23 05:14:40.144047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.005 [2024-04-23 05:14:40.144298] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.005 [2024-04-23 05:14:40.144525] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.005 [2024-04-23 05:14:40.144547] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.005 [2024-04-23 05:14:40.144575] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.005 [2024-04-23 05:14:40.147685] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.005 [2024-04-23 05:14:40.156966] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.005 [2024-04-23 05:14:40.157432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.157574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.005 [2024-04-23 05:14:40.157601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.005 [2024-04-23 05:14:40.157617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.005 [2024-04-23 05:14:40.157845] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.005 [2024-04-23 05:14:40.158077] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.005 [2024-04-23 05:14:40.158098] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.005 [2024-04-23 05:14:40.158111] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.005 [2024-04-23 05:14:40.161189] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.170609] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.171038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.171175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.171201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.171218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.171460] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.171706] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.171728] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.265 [2024-04-23 05:14:40.171742] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.265 [2024-04-23 05:14:40.175109] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.184090] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.184552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.184674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.184700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.184717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.184946] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.185161] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.185185] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.265 [2024-04-23 05:14:40.185199] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.265 [2024-04-23 05:14:40.188291] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.197547] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.197973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.198126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.198152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.198168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.198409] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.198683] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.198705] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.265 [2024-04-23 05:14:40.198720] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.265 [2024-04-23 05:14:40.201820] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.210787] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.211213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.211360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.211385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.211401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.211656] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.211891] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.211926] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.265 [2024-04-23 05:14:40.211939] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.265 [2024-04-23 05:14:40.215097] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.224171] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.224615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.224734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.224762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.224778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.225024] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.225229] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.225249] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.265 [2024-04-23 05:14:40.225267] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.265 [2024-04-23 05:14:40.228394] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.237561] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.237948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.238105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.238131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.238147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.238376] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.238615] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.238638] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.265 [2024-04-23 05:14:40.238651] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.265 [2024-04-23 05:14:40.242056] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.251221] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.251612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.251777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.251803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.251820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.252062] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.252261] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.252280] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.265 [2024-04-23 05:14:40.252293] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.265 [2024-04-23 05:14:40.255414] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.265 [2024-04-23 05:14:40.264668] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.265 [2024-04-23 05:14:40.265090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.265242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.265 [2024-04-23 05:14:40.265267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.265 [2024-04-23 05:14:40.265283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.265 [2024-04-23 05:14:40.265619] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.265 [2024-04-23 05:14:40.265864] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.265 [2024-04-23 05:14:40.265886] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.265918] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.269044] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.278079] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.278536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.278661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.278689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.278705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.278949] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.279147] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.279167] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.279180] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.282183] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.291499] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.291903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.292096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.292121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.292137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.292392] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.292635] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.292656] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.292670] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.295755] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.304871] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.305251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.305407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.305432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.305449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.305685] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.305946] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.305966] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.305979] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.309045] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.318204] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.318603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.318721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.318746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.318763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.319019] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.319224] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.319243] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.319256] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.322414] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.331630] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.332023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.332206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.332231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.332247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.332489] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.332723] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.332745] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.332758] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.335932] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.345136] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.345558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.345684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.345709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.345725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.345967] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.346166] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.346186] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.346198] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.349336] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.358684] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.359103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.359248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.359273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.359289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.359538] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.359771] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.359793] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.359807] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.266 [2024-04-23 05:14:40.362990] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.266 [2024-04-23 05:14:40.372108] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.266 [2024-04-23 05:14:40.372567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.372717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.266 [2024-04-23 05:14:40.372742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.266 [2024-04-23 05:14:40.372758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.266 [2024-04-23 05:14:40.372995] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.266 [2024-04-23 05:14:40.373211] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.266 [2024-04-23 05:14:40.373231] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.266 [2024-04-23 05:14:40.373244] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.267 [2024-04-23 05:14:40.376394] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.267 [2024-04-23 05:14:40.385442] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.267 [2024-04-23 05:14:40.385864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.385980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.386007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.267 [2024-04-23 05:14:40.386023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.267 [2024-04-23 05:14:40.386260] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.267 [2024-04-23 05:14:40.386474] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.267 [2024-04-23 05:14:40.386508] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.267 [2024-04-23 05:14:40.386531] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.267 [2024-04-23 05:14:40.389685] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.267 [2024-04-23 05:14:40.398780] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.267 [2024-04-23 05:14:40.399251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.399413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.399438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.267 [2024-04-23 05:14:40.399454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.267 [2024-04-23 05:14:40.399717] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.267 [2024-04-23 05:14:40.399936] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.267 [2024-04-23 05:14:40.399956] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.267 [2024-04-23 05:14:40.399968] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.267 [2024-04-23 05:14:40.402958] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.267 [2024-04-23 05:14:40.412064] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.267 [2024-04-23 05:14:40.412425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.412620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.412646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.267 [2024-04-23 05:14:40.412662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.267 [2024-04-23 05:14:40.412906] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.267 [2024-04-23 05:14:40.413104] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.267 [2024-04-23 05:14:40.413124] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.267 [2024-04-23 05:14:40.413136] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.267 [2024-04-23 05:14:40.416102] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.267 [2024-04-23 05:14:40.425404] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.267 [2024-04-23 05:14:40.425827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.426019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.267 [2024-04-23 05:14:40.426045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.267 [2024-04-23 05:14:40.426061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.267 [2024-04-23 05:14:40.426313] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.267 [2024-04-23 05:14:40.426538] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.267 [2024-04-23 05:14:40.426559] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.267 [2024-04-23 05:14:40.426587] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.527 [2024-04-23 05:14:40.430043] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.527 [2024-04-23 05:14:40.438750] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.527 [2024-04-23 05:14:40.439231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.527 [2024-04-23 05:14:40.439398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.527 [2024-04-23 05:14:40.439424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.527 [2024-04-23 05:14:40.439446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.527 [2024-04-23 05:14:40.439685] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.527 [2024-04-23 05:14:40.439907] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.527 [2024-04-23 05:14:40.439927] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.527 [2024-04-23 05:14:40.439940] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.527 [2024-04-23 05:14:40.442907] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.527 [2024-04-23 05:14:40.452079] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.527 [2024-04-23 05:14:40.452503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.527 [2024-04-23 05:14:40.452663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.527 [2024-04-23 05:14:40.452689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.527 [2024-04-23 05:14:40.452705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.527 [2024-04-23 05:14:40.452948] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.527 [2024-04-23 05:14:40.453146] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.453165] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.453178] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.456144] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-04-23 05:14:40.465379] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.465759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.465924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.465950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.465966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.466209] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.466407] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.466426] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.466439] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.469440] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2522630 Killed "${NVMF_APP[@]}" "$@" 00:30:01.528 05:14:40 -- host/bdevperf.sh@36 -- # tgt_init 00:30:01.528 05:14:40 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:01.528 05:14:40 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:30:01.528 05:14:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:01.528 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.528 05:14:40 -- nvmf/common.sh@470 -- # nvmfpid=2523600 00:30:01.528 05:14:40 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:01.528 05:14:40 -- nvmf/common.sh@471 -- # waitforlisten 2523600 00:30:01.528 05:14:40 -- common/autotest_common.sh@817 -- # '[' -z 2523600 ']' 00:30:01.528 05:14:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:01.528 05:14:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:01.528 05:14:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:01.528 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:01.528 05:14:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:01.528 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.528 [2024-04-23 05:14:40.478811] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.479224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.479377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.479403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.479420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.479645] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.479893] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.479914] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.479928] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.482958] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-04-23 05:14:40.492172] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.492670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.492785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.492810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.492827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.493068] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.493293] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.493314] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.493328] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.496639] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-04-23 05:14:40.505433] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.505919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.506049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.506075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.506091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.506334] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.506562] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.506583] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.506597] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.509571] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-04-23 05:14:40.518675] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.519086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.519253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.519278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.519295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.519557] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.519768] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.519789] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.519803] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.521701] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:30:01.528 [2024-04-23 05:14:40.521773] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:01.528 [2024-04-23 05:14:40.522913] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-04-23 05:14:40.531976] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.532385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.532552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.532578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.532595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.532823] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.533060] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.533080] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.533093] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.536085] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 [2024-04-23 05:14:40.545198] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.545633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.545775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.545800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.545822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.546052] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.546266] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.528 [2024-04-23 05:14:40.546286] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.528 [2024-04-23 05:14:40.546299] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.528 [2024-04-23 05:14:40.549275] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.528 EAL: No free 2048 kB hugepages reported on node 1 00:30:01.528 [2024-04-23 05:14:40.558406] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.528 [2024-04-23 05:14:40.558873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.559034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.528 [2024-04-23 05:14:40.559060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.528 [2024-04-23 05:14:40.559076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.528 [2024-04-23 05:14:40.559317] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.528 [2024-04-23 05:14:40.559579] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.559601] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.559615] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.561032] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:30:01.529 [2024-04-23 05:14:40.562899] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.571780] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.572161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.572309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.572334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.572351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.572611] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.572829] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.572865] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.572879] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.575933] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.585180] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.585567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.585707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.585733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.585754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.585997] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.586202] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.586222] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.586235] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.589330] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.589713] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:01.529 [2024-04-23 05:14:40.598487] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.599148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.599331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.599361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.599383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.599670] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.599923] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.599949] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.599968] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.603509] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.612346] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.612894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.613029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.613057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.613077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.613319] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.613596] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.613634] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.613650] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.617166] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.626296] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.626809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.627008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.627036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.627064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.627303] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.627572] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.627594] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.627609] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.631098] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.640194] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.640890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.641089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.641121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.641143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.641396] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.641660] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.641683] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.641700] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.645208] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.654086] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.654628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.654802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.654840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.654877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.655121] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.655369] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.655393] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.655410] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.658927] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.668069] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.668470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.668665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.668691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.529 [2024-04-23 05:14:40.668708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.529 [2024-04-23 05:14:40.668963] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.529 [2024-04-23 05:14:40.669206] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.529 [2024-04-23 05:14:40.669231] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.529 [2024-04-23 05:14:40.669247] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.529 [2024-04-23 05:14:40.672789] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.529 [2024-04-23 05:14:40.679993] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:01.529 [2024-04-23 05:14:40.680027] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:01.529 [2024-04-23 05:14:40.680056] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:01.529 [2024-04-23 05:14:40.680067] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:01.529 [2024-04-23 05:14:40.680078] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:01.529 [2024-04-23 05:14:40.680171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:01.529 [2024-04-23 05:14:40.680215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:01.529 [2024-04-23 05:14:40.680216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:01.529 [2024-04-23 05:14:40.681808] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.529 [2024-04-23 05:14:40.682215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.529 [2024-04-23 05:14:40.682391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.530 [2024-04-23 05:14:40.682418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.530 [2024-04-23 05:14:40.682436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.530 [2024-04-23 05:14:40.682662] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.530 [2024-04-23 05:14:40.682892] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.530 [2024-04-23 05:14:40.682913] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.530 [2024-04-23 05:14:40.682927] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.530 [2024-04-23 05:14:40.686123] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.790 [2024-04-23 05:14:40.695627] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.790 [2024-04-23 05:14:40.696251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.696417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.696446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.790 [2024-04-23 05:14:40.696467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.790 [2024-04-23 05:14:40.696754] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.790 [2024-04-23 05:14:40.697003] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.790 [2024-04-23 05:14:40.697041] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.790 [2024-04-23 05:14:40.697058] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.790 [2024-04-23 05:14:40.700422] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.790 [2024-04-23 05:14:40.709206] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.790 [2024-04-23 05:14:40.709773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.709945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.709973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.790 [2024-04-23 05:14:40.709994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.790 [2024-04-23 05:14:40.710247] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.790 [2024-04-23 05:14:40.710458] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.790 [2024-04-23 05:14:40.710479] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.790 [2024-04-23 05:14:40.710496] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.790 [2024-04-23 05:14:40.713665] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.790 [2024-04-23 05:14:40.722889] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.790 [2024-04-23 05:14:40.723535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.723693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.723720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.790 [2024-04-23 05:14:40.723742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.790 [2024-04-23 05:14:40.723997] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.790 [2024-04-23 05:14:40.724208] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.790 [2024-04-23 05:14:40.724229] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.790 [2024-04-23 05:14:40.724247] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.790 [2024-04-23 05:14:40.727371] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.790 [2024-04-23 05:14:40.736390] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.790 [2024-04-23 05:14:40.736904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.737035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.737061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.790 [2024-04-23 05:14:40.737081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.790 [2024-04-23 05:14:40.737332] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.790 [2024-04-23 05:14:40.737567] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.790 [2024-04-23 05:14:40.737590] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.790 [2024-04-23 05:14:40.737606] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.790 [2024-04-23 05:14:40.740770] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.790 [2024-04-23 05:14:40.749892] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.790 [2024-04-23 05:14:40.750531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.750729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.750757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.790 [2024-04-23 05:14:40.750778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.790 [2024-04-23 05:14:40.751034] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.790 [2024-04-23 05:14:40.751245] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.790 [2024-04-23 05:14:40.751266] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.790 [2024-04-23 05:14:40.751283] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.790 [2024-04-23 05:14:40.754553] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.790 [2024-04-23 05:14:40.763611] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.790 [2024-04-23 05:14:40.764063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.764234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.790 [2024-04-23 05:14:40.764260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.790 [2024-04-23 05:14:40.764281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.790 [2024-04-23 05:14:40.764527] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.790 [2024-04-23 05:14:40.764778] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.790 [2024-04-23 05:14:40.764800] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.764817] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.768079] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 [2024-04-23 05:14:40.777046] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.777423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.777550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.777578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.791 [2024-04-23 05:14:40.777595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.791 [2024-04-23 05:14:40.777824] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.791 [2024-04-23 05:14:40.778029] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.791 [2024-04-23 05:14:40.778049] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.778063] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.781286] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 [2024-04-23 05:14:40.790640] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.791014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.791166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.791192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.791 [2024-04-23 05:14:40.791209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.791 [2024-04-23 05:14:40.791423] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.791 [2024-04-23 05:14:40.791678] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.791 [2024-04-23 05:14:40.791701] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.791715] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.794955] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 05:14:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:01.791 05:14:40 -- common/autotest_common.sh@850 -- # return 0 00:30:01.791 05:14:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:30:01.791 05:14:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:01.791 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.791 [2024-04-23 05:14:40.804224] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.804638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.804768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.804794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.791 [2024-04-23 05:14:40.804811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.791 [2024-04-23 05:14:40.805054] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.791 [2024-04-23 05:14:40.805260] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.791 [2024-04-23 05:14:40.805281] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.805295] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.808462] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 [2024-04-23 05:14:40.817657] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.818104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.818262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.818288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.791 [2024-04-23 05:14:40.818305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.791 [2024-04-23 05:14:40.818568] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.791 [2024-04-23 05:14:40.818786] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.791 [2024-04-23 05:14:40.818823] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.818836] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.822053] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 05:14:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:01.791 05:14:40 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:01.791 05:14:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:01.791 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.791 [2024-04-23 05:14:40.830758] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:01.791 [2024-04-23 05:14:40.831091] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.831438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.831588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.831615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.791 [2024-04-23 05:14:40.831631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.791 [2024-04-23 05:14:40.831859] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.791 [2024-04-23 05:14:40.832078] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.791 [2024-04-23 05:14:40.832098] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.832111] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.835243] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 05:14:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:01.791 05:14:40 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:01.791 05:14:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:01.791 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.791 [2024-04-23 05:14:40.844599] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.845066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.845185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.845213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.791 [2024-04-23 05:14:40.845229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.791 [2024-04-23 05:14:40.845456] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.791 [2024-04-23 05:14:40.845709] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.791 [2024-04-23 05:14:40.845732] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.845746] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.848863] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 [2024-04-23 05:14:40.858096] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.858555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.858700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.791 [2024-04-23 05:14:40.858726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.791 [2024-04-23 05:14:40.858743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.791 [2024-04-23 05:14:40.858973] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.791 [2024-04-23 05:14:40.859203] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.791 [2024-04-23 05:14:40.859224] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.791 [2024-04-23 05:14:40.859238] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.791 [2024-04-23 05:14:40.862448] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.791 [2024-04-23 05:14:40.871614] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.791 [2024-04-23 05:14:40.872197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.792 [2024-04-23 05:14:40.872352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.792 [2024-04-23 05:14:40.872378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.792 [2024-04-23 05:14:40.872400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.792 [2024-04-23 05:14:40.872634] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.792 [2024-04-23 05:14:40.872889] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.792 [2024-04-23 05:14:40.872911] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.792 [2024-04-23 05:14:40.872928] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.792 Malloc0 00:30:01.792 05:14:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:01.792 05:14:40 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:01.792 05:14:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:01.792 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.792 [2024-04-23 05:14:40.876132] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.792 05:14:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:01.792 05:14:40 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:01.792 05:14:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:01.792 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.792 [2024-04-23 05:14:40.885296] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.792 [2024-04-23 05:14:40.885675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.792 [2024-04-23 05:14:40.885796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.792 [2024-04-23 05:14:40.885821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218f610 with addr=10.0.0.2, port=4420 00:30:01.792 [2024-04-23 05:14:40.885837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x218f610 is same with the state(5) to be set 00:30:01.792 [2024-04-23 05:14:40.886079] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x218f610 (9): Bad file descriptor 00:30:01.792 [2024-04-23 05:14:40.886284] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.792 [2024-04-23 05:14:40.886304] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.792 [2024-04-23 05:14:40.886317] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.792 [2024-04-23 05:14:40.889673] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.792 05:14:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:01.792 05:14:40 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:01.792 05:14:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:01.792 05:14:40 -- common/autotest_common.sh@10 -- # set +x 00:30:01.792 [2024-04-23 05:14:40.894983] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:01.792 [2024-04-23 05:14:40.898808] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.792 05:14:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:01.792 05:14:40 -- host/bdevperf.sh@38 -- # wait 2522820 00:30:02.050 [2024-04-23 05:14:40.972623] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:12.082 00:30:12.082 Latency(us) 00:30:12.082 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.082 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:12.082 Verification LBA range: start 0x0 length 0x4000 00:30:12.082 Nvme1n1 : 15.01 6270.58 24.49 8738.53 0.00 8503.45 1092.27 23981.32 00:30:12.082 =================================================================================================================== 00:30:12.082 Total : 6270.58 24.49 8738.53 0.00 8503.45 1092.27 23981.32 00:30:12.082 05:14:50 -- host/bdevperf.sh@39 -- # sync 00:30:12.082 05:14:50 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:12.082 05:14:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:12.082 05:14:50 -- common/autotest_common.sh@10 -- # set +x 00:30:12.082 05:14:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:12.082 05:14:50 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:12.082 05:14:50 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:12.082 05:14:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:30:12.082 05:14:50 -- nvmf/common.sh@117 -- # sync 00:30:12.082 05:14:50 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:30:12.082 05:14:50 -- nvmf/common.sh@120 -- # set +e 00:30:12.082 05:14:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:30:12.082 05:14:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:30:12.082 rmmod nvme_tcp 00:30:12.082 rmmod nvme_fabrics 00:30:12.082 rmmod nvme_keyring 00:30:12.082 05:14:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:30:12.082 05:14:50 -- nvmf/common.sh@124 -- # set -e 00:30:12.082 05:14:50 -- nvmf/common.sh@125 -- # return 0 00:30:12.082 05:14:50 -- nvmf/common.sh@478 -- # '[' -n 2523600 ']' 00:30:12.082 05:14:50 -- nvmf/common.sh@479 -- # killprocess 2523600 00:30:12.082 05:14:50 -- common/autotest_common.sh@936 -- # '[' -z 2523600 ']' 00:30:12.082 05:14:50 -- common/autotest_common.sh@940 -- # kill -0 2523600 00:30:12.082 05:14:50 -- common/autotest_common.sh@941 -- # uname 00:30:12.083 05:14:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:12.083 05:14:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2523600 00:30:12.083 05:14:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:12.083 05:14:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:12.083 05:14:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2523600' 00:30:12.083 killing process with pid 2523600 00:30:12.083 05:14:50 -- common/autotest_common.sh@955 -- # kill 2523600 00:30:12.083 05:14:50 -- common/autotest_common.sh@960 -- # wait 2523600 00:30:12.083 05:14:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:30:12.083 05:14:50 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:30:12.083 05:14:50 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:30:12.083 05:14:50 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:12.083 05:14:50 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:30:12.083 05:14:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:12.083 05:14:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:12.083 05:14:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:13.461 05:14:52 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:30:13.461 00:30:13.461 real 0m22.492s 00:30:13.461 user 0m59.498s 00:30:13.461 sys 0m4.459s 00:30:13.461 05:14:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:13.461 05:14:52 -- common/autotest_common.sh@10 -- # set +x 00:30:13.461 ************************************ 00:30:13.461 END TEST nvmf_bdevperf 00:30:13.461 ************************************ 00:30:13.461 05:14:52 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:13.461 05:14:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:13.461 05:14:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:13.461 05:14:52 -- common/autotest_common.sh@10 -- # set +x 00:30:13.719 ************************************ 00:30:13.719 START TEST nvmf_target_disconnect 00:30:13.719 ************************************ 00:30:13.719 05:14:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:13.719 * Looking for test storage... 00:30:13.719 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:13.719 05:14:52 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:13.719 05:14:52 -- nvmf/common.sh@7 -- # uname -s 00:30:13.719 05:14:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:13.719 05:14:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:13.719 05:14:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:13.719 05:14:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:13.719 05:14:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:13.719 05:14:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:13.719 05:14:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:13.719 05:14:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:13.719 05:14:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:13.719 05:14:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:13.719 05:14:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:13.719 05:14:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:13.719 05:14:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:13.719 05:14:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:13.719 05:14:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:13.719 05:14:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:30:13.719 05:14:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:13.719 05:14:52 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:13.719 05:14:52 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:13.719 05:14:52 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:13.719 05:14:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:13.720 05:14:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:13.720 05:14:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:13.720 05:14:52 -- paths/export.sh@5 -- # export PATH 00:30:13.720 05:14:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:13.720 05:14:52 -- nvmf/common.sh@47 -- # : 0 00:30:13.720 05:14:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:30:13.720 05:14:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:30:13.720 05:14:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:30:13.720 05:14:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:13.720 05:14:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:13.720 05:14:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:30:13.720 05:14:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:30:13.720 05:14:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:30:13.720 05:14:52 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:13.720 05:14:52 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:13.720 05:14:52 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:13.720 05:14:52 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:13.720 05:14:52 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:30:13.720 05:14:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:13.720 05:14:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:30:13.720 05:14:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:30:13.720 05:14:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:30:13.720 05:14:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:13.720 05:14:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:13.720 05:14:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:13.720 05:14:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:30:13.720 05:14:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:30:13.720 05:14:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:30:13.720 05:14:52 -- common/autotest_common.sh@10 -- # set +x 00:30:15.621 05:14:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:15.621 05:14:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:30:15.621 05:14:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:30:15.621 05:14:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:30:15.621 05:14:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:30:15.621 05:14:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:30:15.621 05:14:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:30:15.621 05:14:54 -- nvmf/common.sh@295 -- # net_devs=() 00:30:15.621 05:14:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:30:15.621 05:14:54 -- nvmf/common.sh@296 -- # e810=() 00:30:15.621 05:14:54 -- nvmf/common.sh@296 -- # local -ga e810 00:30:15.621 05:14:54 -- nvmf/common.sh@297 -- # x722=() 00:30:15.621 05:14:54 -- nvmf/common.sh@297 -- # local -ga x722 00:30:15.621 05:14:54 -- nvmf/common.sh@298 -- # mlx=() 00:30:15.621 05:14:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:30:15.621 05:14:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:15.621 05:14:54 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:30:15.621 05:14:54 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:30:15.621 05:14:54 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:30:15.621 05:14:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:15.621 05:14:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:15.621 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:15.621 05:14:54 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:15.621 05:14:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:15.621 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:15.621 05:14:54 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:30:15.621 05:14:54 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:15.621 05:14:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:15.621 05:14:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:15.621 05:14:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:15.621 05:14:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:15.621 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:15.621 05:14:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:15.621 05:14:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:15.621 05:14:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:15.621 05:14:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:15.621 05:14:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:15.621 05:14:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:15.621 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:15.621 05:14:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:15.621 05:14:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:30:15.621 05:14:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:30:15.621 05:14:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:30:15.621 05:14:54 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:30:15.621 05:14:54 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:15.621 05:14:54 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:15.621 05:14:54 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:15.621 05:14:54 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:30:15.621 05:14:54 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:15.621 05:14:54 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:15.621 05:14:54 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:30:15.621 05:14:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:15.621 05:14:54 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:15.621 05:14:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:30:15.621 05:14:54 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:30:15.621 05:14:54 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:30:15.621 05:14:54 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:15.621 05:14:54 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:15.621 05:14:54 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:15.622 05:14:54 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:30:15.622 05:14:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:15.880 05:14:54 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:15.880 05:14:54 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:15.880 05:14:54 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:30:15.880 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:15.880 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:30:15.880 00:30:15.880 --- 10.0.0.2 ping statistics --- 00:30:15.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:15.880 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:30:15.880 05:14:54 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:15.880 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:15.880 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:30:15.880 00:30:15.880 --- 10.0.0.1 ping statistics --- 00:30:15.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:15.880 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:30:15.880 05:14:54 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:15.880 05:14:54 -- nvmf/common.sh@411 -- # return 0 00:30:15.880 05:14:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:30:15.880 05:14:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:15.880 05:14:54 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:30:15.880 05:14:54 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:30:15.880 05:14:54 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:15.880 05:14:54 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:30:15.880 05:14:54 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:30:15.880 05:14:54 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:15.880 05:14:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:15.880 05:14:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:15.880 05:14:54 -- common/autotest_common.sh@10 -- # set +x 00:30:15.880 ************************************ 00:30:15.880 START TEST nvmf_target_disconnect_tc1 00:30:15.880 ************************************ 00:30:15.880 05:14:54 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:30:15.880 05:14:54 -- host/target_disconnect.sh@32 -- # set +e 00:30:15.880 05:14:54 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:15.880 EAL: No free 2048 kB hugepages reported on node 1 00:30:15.880 [2024-04-23 05:14:55.036901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.880 [2024-04-23 05:14:55.037110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.880 [2024-04-23 05:14:55.037141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d96d80 with addr=10.0.0.2, port=4420 00:30:15.880 [2024-04-23 05:14:55.037188] nvme_tcp.c:2699:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:15.880 [2024-04-23 05:14:55.037211] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:15.880 [2024-04-23 05:14:55.037224] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:15.880 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:15.880 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:15.880 Initializing NVMe Controllers 00:30:16.139 05:14:55 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:16.139 05:14:55 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:16.139 05:14:55 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:30:16.139 05:14:55 -- common/autotest_common.sh@1139 -- # return 0 00:30:16.139 05:14:55 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:16.139 05:14:55 -- host/target_disconnect.sh@41 -- # set -e 00:30:16.139 00:30:16.139 real 0m0.094s 00:30:16.139 user 0m0.040s 00:30:16.139 sys 0m0.053s 00:30:16.139 05:14:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:16.139 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.139 ************************************ 00:30:16.139 END TEST nvmf_target_disconnect_tc1 00:30:16.139 ************************************ 00:30:16.139 05:14:55 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:16.139 05:14:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:16.139 05:14:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:16.139 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.139 ************************************ 00:30:16.139 START TEST nvmf_target_disconnect_tc2 00:30:16.139 ************************************ 00:30:16.139 05:14:55 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:30:16.139 05:14:55 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:16.139 05:14:55 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:16.139 05:14:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:30:16.139 05:14:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:16.139 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.139 05:14:55 -- nvmf/common.sh@470 -- # nvmfpid=2526765 00:30:16.139 05:14:55 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:16.139 05:14:55 -- nvmf/common.sh@471 -- # waitforlisten 2526765 00:30:16.139 05:14:55 -- common/autotest_common.sh@817 -- # '[' -z 2526765 ']' 00:30:16.139 05:14:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:16.139 05:14:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:16.139 05:14:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:16.139 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:16.139 05:14:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:16.139 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.139 [2024-04-23 05:14:55.219187] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:30:16.139 [2024-04-23 05:14:55.219261] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:16.139 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.139 [2024-04-23 05:14:55.257653] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:30:16.139 [2024-04-23 05:14:55.290214] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:16.397 [2024-04-23 05:14:55.385266] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:16.397 [2024-04-23 05:14:55.385335] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:16.397 [2024-04-23 05:14:55.385352] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:16.397 [2024-04-23 05:14:55.385366] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:16.397 [2024-04-23 05:14:55.385378] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:16.398 [2024-04-23 05:14:55.385496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:16.398 [2024-04-23 05:14:55.385604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:16.398 [2024-04-23 05:14:55.385657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:16.398 [2024-04-23 05:14:55.385661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:16.398 05:14:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:16.398 05:14:55 -- common/autotest_common.sh@850 -- # return 0 00:30:16.398 05:14:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:30:16.398 05:14:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:16.398 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.398 05:14:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:16.398 05:14:55 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:16.398 05:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.398 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.398 Malloc0 00:30:16.398 05:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.398 05:14:55 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:16.398 05:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.398 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.656 [2024-04-23 05:14:55.564413] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:16.656 05:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.656 05:14:55 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:16.656 05:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.656 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.656 05:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.656 05:14:55 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:16.656 05:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.656 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.656 05:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.656 05:14:55 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:16.656 05:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.656 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.656 [2024-04-23 05:14:55.592680] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:16.656 05:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.656 05:14:55 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:16.656 05:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.656 05:14:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.656 05:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.656 05:14:55 -- host/target_disconnect.sh@50 -- # reconnectpid=2526801 00:30:16.656 05:14:55 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:16.656 05:14:55 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:16.656 EAL: No free 2048 kB hugepages reported on node 1 00:30:18.566 05:14:57 -- host/target_disconnect.sh@53 -- # kill -9 2526765 00:30:18.566 05:14:57 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:18.566 Read completed with error (sct=0, sc=8) 00:30:18.566 starting I/O failed 00:30:18.566 Read completed with error (sct=0, sc=8) 00:30:18.566 starting I/O failed 00:30:18.566 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 [2024-04-23 05:14:57.619170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 [2024-04-23 05:14:57.619558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 [2024-04-23 05:14:57.619864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Read completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.567 starting I/O failed 00:30:18.567 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Read completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 Write completed with error (sct=0, sc=8) 00:30:18.568 starting I/O failed 00:30:18.568 [2024-04-23 05:14:57.620161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:18.568 [2024-04-23 05:14:57.620460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.620599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.620635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.620764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.620913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.620939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.621130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.621296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.621321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.621437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.621556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.621582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.621721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.621831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.621857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.621996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.622105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.622130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.622239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.622470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.622509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.622652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.622784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.622809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.622986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.623145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.623170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.623278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.623385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.623410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.623566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.623709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.623734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.623933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.624156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.624196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.624391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.624599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.624642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.624779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.624940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.624965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.625149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.625279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.625303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.625510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.625664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.625689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.625800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.626054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.626112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.626306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.626472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.626499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.626698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.626817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.626842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.627001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.627102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.627127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.568 [2024-04-23 05:14:57.627310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.627549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.568 [2024-04-23 05:14:57.627577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.568 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.627695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.627837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.627862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.627997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.628156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.628180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.628389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.628539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.628574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.628688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.628850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.628874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.629012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.629151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.629176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.629318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.629481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.629507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.629640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.629757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.629782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.629891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.630189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.630559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.630827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.630984] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.631158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.631315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.631340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.631508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.631653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.631678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.631822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.631981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.632007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.632188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.632349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.632374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.632511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.632638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.632665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.632806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.632962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.632987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.633112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.633252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.633277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.633439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.633579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.633606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.633750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.633909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.633934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.634047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.634186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.634212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.634373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.634502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.634545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.634656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.634796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.634823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.634991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.635128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.635154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.635264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.635405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.635431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.635595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.635756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.569 [2024-04-23 05:14:57.635781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.569 qpair failed and we were unable to recover it. 00:30:18.569 [2024-04-23 05:14:57.635919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.636211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.636535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.636811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.636996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.637128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.637295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.637320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.637453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.637589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.637615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.637789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.637930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.637954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.638115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.638220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.638246] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.638356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.638464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.638490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.638634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.638780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.638807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.638917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.639231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.639553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.639826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.639987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.640090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.640227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.640253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.640416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.640556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.640585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.640724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.640893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.640921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.641081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.641215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.641242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.641379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.641525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.641552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.641681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.641817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.641844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.641942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.642080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.642107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.642275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.642388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.642414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.642578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.642691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.642719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.642880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.642982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.643009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.643144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.643277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.643304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.643407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.643565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.643593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.570 qpair failed and we were unable to recover it. 00:30:18.570 [2024-04-23 05:14:57.643701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.570 [2024-04-23 05:14:57.643834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.643860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.644028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.644297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.644570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.644808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.644971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.645114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.645249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.645277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.645439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.645574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.645602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.645768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.645899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.645926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.646092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.646197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.646223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.646357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.646491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.646527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.646630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.646758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.646784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.646913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.647180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.647500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.647834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.647972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.648087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.648233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.648260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.648391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.648529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.648557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.648716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.648876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.648903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.649069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.649200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.649227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.649389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.649528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.649571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.649691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.649795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.649820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.649980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.650129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.650156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.650289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.650455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.650482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.650661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.650770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.571 [2024-04-23 05:14:57.650796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.571 qpair failed and we were unable to recover it. 00:30:18.571 [2024-04-23 05:14:57.650941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.651222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.651495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.651831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.651990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.652127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.652261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.652288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.652456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.652594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.652623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.652736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.652869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.652897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.653061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.653230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.653258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.653393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.653529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.653558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.653671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.653811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.653838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.653976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.654116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.654143] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.654307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.654450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.654477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.654641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.654749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.654775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.654913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.655240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.655521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.655785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.655958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.656059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.656184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.656210] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.656315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.656451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.656478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.656630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.656765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.656792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.656930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.657211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.657535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.657842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.657976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.658117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.658254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.658281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.572 qpair failed and we were unable to recover it. 00:30:18.572 [2024-04-23 05:14:57.658446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.572 [2024-04-23 05:14:57.658582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.658611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.658746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.658875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.658902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.659008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.659113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.659140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.659303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.659470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.659497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.659646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.659780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.659807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.659950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.660057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.660084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.660185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.660316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.660347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.660511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.660682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.660709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.660848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.660986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.661013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.661148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.661284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.661310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.661474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.661596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.661624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.661731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.661864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.661891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.662030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.662141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.662168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.662304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.662402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.662428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.662543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.662679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.662706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.662844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.663191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.663463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.663795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.663933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.664043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.664147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.664175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.664291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.664455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.664482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.664629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.664791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.664818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.664988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.665122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.665149] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.665309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.665444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.665472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.665621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.665729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.665756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.665898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.666174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.666502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.573 [2024-04-23 05:14:57.666800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.573 [2024-04-23 05:14:57.666992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.573 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.667154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.667317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.667345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.667452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.667586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.667614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.667780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.667884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.667912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.668047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.668180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.668207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.668341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.668492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.668526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.668632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.668776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.668803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.668973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.669095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.669122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.669255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.669386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.669418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.669580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.669717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.669744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.669883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.670146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.670448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.670713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.670846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.670978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.671119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.671146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.671307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.671444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.671471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.671654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.671797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.671824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.671927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.672238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.672537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.672800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.672963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.673123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.673259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.673286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.673423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.673594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.673623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.673764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.673937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.673963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.674123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.674223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.674249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.674360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.674492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.674527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.674634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.674796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.674823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.674954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.675089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.675115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.675278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.675414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.675440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.574 qpair failed and we were unable to recover it. 00:30:18.574 [2024-04-23 05:14:57.675586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.675723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.574 [2024-04-23 05:14:57.675751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.675913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.676083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.676109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.676245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.676384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.676411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.676548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.676688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.676716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.676852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.676982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.677009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.677119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.677255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.677282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.677417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.677551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.677580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.677695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.677863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.677890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.678022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.678155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.678182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.678318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.678422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.678448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.678570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.678740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.678768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.678907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.679210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.679482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.679764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.679922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.680086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.680251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.680278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.680393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.680527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.680554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.680690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.680802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.680830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.680969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.681078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.681105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.681238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.681346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.681377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.681499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.681680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.681709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.681838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.681976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.682003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.682131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.682269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.682297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.682438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.682574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.682602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.682775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.682904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.682931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.683038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.683176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.683204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.683340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.683500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.683535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.683698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.683829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.683856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.683992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.684151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.684177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.575 qpair failed and we were unable to recover it. 00:30:18.575 [2024-04-23 05:14:57.684306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.575 [2024-04-23 05:14:57.684433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.684460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.684630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.684744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.684771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.684911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.685182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.685485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.685795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.685980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.686083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.686243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.686269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.686372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.686475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.686501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.686652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.686793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.686820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.686984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.687126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.687154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.687318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.687457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.687484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.687637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.687806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.687833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.687971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.688112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.688139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.688309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.688444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.688471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.688640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.688776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.688804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.688934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.689260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.689503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.689811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.689947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.690058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.690201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.690227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.690365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.690472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.690498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.690645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.690806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.690833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.690999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.691137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.691166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.691325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.691488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.691523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.691661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.691797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.576 [2024-04-23 05:14:57.691824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.576 qpair failed and we were unable to recover it. 00:30:18.576 [2024-04-23 05:14:57.691957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.692248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.692536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.692816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.692982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.693116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.693255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.693282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.693444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.693608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.693636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.693780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.693915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.693942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.694041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.694142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.694168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.694301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.694410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.694438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.694570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.694703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.694730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.694861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.694993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.695021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.695163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.695268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.695296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.695435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.695574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.695603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.695736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.695907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.695934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.696101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.696236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.696263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.696398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.696566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.696593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.696732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.696848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.696875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.696982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.697108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.697135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.697297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.697460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.697487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.697606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.697764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.697791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.697925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.698224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.698469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.698748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.698936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.699080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.699216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.699243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.699378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.699519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.699548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.699682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.699827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.699854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.699957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.700060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.577 [2024-04-23 05:14:57.700085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.577 qpair failed and we were unable to recover it. 00:30:18.577 [2024-04-23 05:14:57.700244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.700383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.700410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.700552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.700659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.700686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.700794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.700926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.700953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.701065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.701198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.701225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.701389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.701538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.701566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.701675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.701840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.701867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.701976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.702103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.702130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.702247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.702410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.702437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.702611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.702779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.702806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.702923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.703054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.703080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.703189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.703301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.703327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.703492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.703659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.703687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.703823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.704013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.704040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.704210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.704372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.704398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.704568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.704681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.704708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.704810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.704973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.705000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.705170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.705302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.705329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.705463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.705643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.705671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.705787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.705970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.705998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.706142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.706316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.706344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.706509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.706715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.706742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.706878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.707199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.707531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.707816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.707942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.708107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.708246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.708272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.708373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.708538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.708566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.708673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.708806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.708832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.708941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.709078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.578 [2024-04-23 05:14:57.709109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.578 qpair failed and we were unable to recover it. 00:30:18.578 [2024-04-23 05:14:57.709271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.709429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.709456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.709561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.709723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.709749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.709894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.710164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.710492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.710838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.710994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.711173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.711341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.711368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.711496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.711609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.711635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.711761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.711938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.711965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.712161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.712369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.712416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.712598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.712725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.712752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.712890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.713222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.713486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.713794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.713960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.714121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.714284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.714311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.714445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.714583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.714611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.714716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.714855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.714882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.715021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.715184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.715211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.715376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.715540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.715572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.715736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.715879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.715906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.716068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.716205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.716232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.716374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.716484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.716512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.716664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.716804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.716833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.716943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.717056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.717084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.717221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.717361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.717387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.717556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.717698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.717726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.717885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.718022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.718049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.579 qpair failed and we were unable to recover it. 00:30:18.579 [2024-04-23 05:14:57.718190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.718333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.579 [2024-04-23 05:14:57.718360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.718468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.718609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.718641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.718747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.718878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.718906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.719040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.719153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.719181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.719341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.719477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.719504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.719673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.719805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.719832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.719990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.720119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.720146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.720307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.720443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.720471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.720588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.720724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.720752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.720873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.721150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.721482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.721749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.721876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.721996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.722155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.722182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.722294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.722405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.722432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.722571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.722681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.722708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.722840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.722975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.723001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.723111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.723245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.723289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.723425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.723567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.723595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.723707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.723849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.723876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.724017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.724131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.724159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.724298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.724457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.724484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.724599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.724736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.724763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.724873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.724980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.725007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.580 [2024-04-23 05:14:57.725120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.725231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.580 [2024-04-23 05:14:57.725258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.580 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.725369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.725507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.725559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.725674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.725840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.725867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.725979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.726236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.726473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.726761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.726929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.727066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.727197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.727225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.727346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.727482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.727509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.727660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.727802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.727829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.727938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.728101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.728127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.728285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.728422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.728448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.728584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.728700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.728727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.728863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.729033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.729060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.729221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.729358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.729386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-04-23 05:14:57.729547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.729710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-04-23 05:14:57.729736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.729868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.730167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.730444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.730739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.730899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.731065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.731237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.731264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.731372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.731540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.731568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.731698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.731836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.731862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.731989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.732159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.732185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.732351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.732485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.732512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.732659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.732827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.732853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.732965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.733244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.733568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.733845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.733969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.734135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.734273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.734301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.734409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.734575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.734603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.734739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.734907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.734934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.735044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.735192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.735219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.735353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.735490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.735524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.735673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.735836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.735862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.736001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.736133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.736160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.736298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.736435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.736462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.736579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.736717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.736744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.736880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.737214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.737486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.737831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.737995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.738129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.738264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.738292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-04-23 05:14:57.738427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-04-23 05:14:57.738567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.738595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.738759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.738899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.738925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.739062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.739177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.739206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.739311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.739469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.739496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.739614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.739775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.739802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.739937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.740217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.740525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.740809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.740970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.741105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.741263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.741290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.741404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.741522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.741549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.741687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.741801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.741829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.741937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.742096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.742124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.742233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.742375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.742403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.742572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.742721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.742749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.742911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.743047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.743074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.743206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.743344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.743371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.743502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.743647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.743676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.743841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.743978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.744004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.744139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.744251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.744278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.744417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.744592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.744619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.744755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.744916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.744942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.745049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.745154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.745180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.745313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.745447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.745474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.745615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.745761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.745789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.745906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.746242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.746503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.746805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.746989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-04-23 05:14:57.747096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-04-23 05:14:57.747229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.747255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.747365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.747537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.747565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.747698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.747837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.747865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.747983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.748222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.748500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.748817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.748982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.749119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.749276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.749303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.749441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.749581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.749609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.749743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.749882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.749908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.750044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.750179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.750205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.750302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.750441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.750467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.750625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.750757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.750783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.750942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.751253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.751545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.751821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.751985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.752123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.752259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.752285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.752422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.752556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.752584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.752725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.752887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.752913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.753048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.753178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.753208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.753337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.753480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.753506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.753669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.753800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.753827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.753942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.754081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.754108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.754275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.754417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.754444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.754577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.754745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.754771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.754904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.755011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.755037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.755171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.755277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.755303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-04-23 05:14:57.755462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.755631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-04-23 05:14:57.755658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.755762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.755903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.755929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.756030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.756189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.756215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.756344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.756456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.756482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.756626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.756735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.756763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.756928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.757089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.757115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.757278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.757437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.757463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.757570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.757729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.757759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.757894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.757994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.758020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.758183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.758296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.758323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.758461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.758600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.758628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.758768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.758878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.758906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.759046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.759186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.759213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.759354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.759456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.759482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.759656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.759767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.759794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.759962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.760097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.760124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.760289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.760432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.760458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.760590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.760690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.760720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.760893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.761056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.761083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.761221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.761380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.761407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.761548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.761688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.761715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.761851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.762178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.762477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.762789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.762927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.763043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.763181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.763208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.763344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.763506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.763541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-04-23 05:14:57.763652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-04-23 05:14:57.763788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.763819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.763953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.764221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.764528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.764786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.764927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.765030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.765189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.765215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.765326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.765441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.765468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.765613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.765723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.765749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.765848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.765987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.766014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.766126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.766257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.766284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.766420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.766548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.766577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.766727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.766841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.766868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.767007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.767144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.767171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.767304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.767471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.767498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.767618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.767755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.767781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.767920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.768209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.768491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.768760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.768950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.769081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.769188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.769214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.769381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.769489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.769526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.769694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.769831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.769857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.769994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.770099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.770127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.770268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.770432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.770459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.770594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.770735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.770762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.770926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.771032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.771057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-04-23 05:14:57.771192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-04-23 05:14:57.771322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.771348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.771511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.771686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.771712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.771850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.771991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.772017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.772178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.772313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.772338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.772498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.772639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.772666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.772807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.772973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.773000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.773133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.773271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.773297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.773437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.773563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.773590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.773760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.773896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.773922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.774030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.774184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.774212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.774339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.774476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.774503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.774700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.774861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.774887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.775016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.775175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.775201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.775335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.775439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.775466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.775610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.775772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.775799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.775941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.776050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.776077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.776219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.776384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.776409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.776572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.776732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.776757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.776898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.777226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.777479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.777817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.777979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.778111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.778244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.778271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.778407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.778574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.778601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.778705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.778839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.778865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.779001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.779105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.779132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.779271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.779407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.779433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.779572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.779684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.779710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.779814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.779978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.780004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-04-23 05:14:57.780143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-04-23 05:14:57.780308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.780335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.780496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.780637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.780664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.780774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.780937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.780964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.781068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.781206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.781232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.781359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.781460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.781488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.781632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.781773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.781800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.781968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.782106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.782131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.782238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.782366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.782392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.782545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.782701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.782727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.782888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.782995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.783023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.783187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.783323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.783350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.783491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.783616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.783644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.783780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.783915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.783941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.784050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.784186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.784213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.784375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.784537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.784564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.784702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.784843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.784869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.785005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.785110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.785137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.785296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.785432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.785459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.785594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.785727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.785753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.785862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.786027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.786053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.786228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.786366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.786394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.786533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.786680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.786705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.786859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.786996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.787023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.787153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.787289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.787317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.787479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.787624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.787651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.787812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.787947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.787973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.788145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.788286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.788334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.788504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.788665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.788691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.788857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.789062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.789109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-04-23 05:14:57.789295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-04-23 05:14:57.789451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.789478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.789639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.789834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.789878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.790033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.790208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.790252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.790410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.790573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.790603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.790772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.790960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.791003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.791161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.791340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.791366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.791522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.791702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.791746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.791899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.792050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.792094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.792240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.792348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.792374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.792559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.792730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.792783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.792938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.793094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.793120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.793226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.793388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.793415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.793598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.793779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.793823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.793934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.794167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.794400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.794708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.794901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.795040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.795213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.795240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.795373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.795565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.795612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.795745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.795976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.796002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.796165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.796303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.796330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.796468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.796582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.796608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.796769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.796907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.796934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.797103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.797238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.797265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.797374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.797512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.797544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.797734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.797907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.797951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.798114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.798250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.798276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.798413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.798597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.798643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.798767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.798964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-04-23 05:14:57.798991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-04-23 05:14:57.799129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.799269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.799296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.799437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.799589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.799616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.799832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.799990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.800034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.800170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.800314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.800341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.800512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.800664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.800709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.800868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.801070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.801099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.801249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.801411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.801437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.801609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.801765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.801792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.801959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.802131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.802159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.802289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.802458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.802485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.802632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.802766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.802805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.802933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.803096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.803123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.803281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.803454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.803481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.803611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.803758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.803810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.804002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.804201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.804231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.804379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.804508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.804542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.804705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.804919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.804966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.805121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.805285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.805312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.805479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.805649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.805699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.805882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.806084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.806128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.806261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.806368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.806396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.806535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.806667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.806696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.806880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.807004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.807031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.807163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.807295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.807321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-04-23 05:14:57.807467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.807592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-04-23 05:14:57.807637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.807804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.807941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.807970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.808123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.808262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.808288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.808428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.808525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.808553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.808713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.808905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.808952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.809128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.809266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.809293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.809425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.809579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.809623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.809768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.809952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.809996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.810157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.810292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.810319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.810449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.810576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.810606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.810767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.810956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.810985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.811117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.811280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.811307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.811444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.811621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.811667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.811852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.812051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.812095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.812202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.812363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.812395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.812575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.812756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.812809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.812958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.813091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.813119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.813269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.813381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.813410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.813567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.813740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.813786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.813977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.814102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.814129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.814269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.814427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.814454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.814609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.814810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.814853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.815008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.815170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.815198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.815361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.815501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.815536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.815700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.815874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.815921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.816064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.816203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.816230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.816360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.816495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.816529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.816702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.816884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.816929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.817092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.817212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.817238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-04-23 05:14:57.817370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.817480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-04-23 05:14:57.817508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.817669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.817839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.817883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.818013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.818135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.818162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.818299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.818437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.818465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.818642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.818802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.818829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.818986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.819164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.819191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.819358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.819495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.819527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.819660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.819863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.819906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.820127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.820305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.820331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.820569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.820738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.820789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.820946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.821101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.821128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.821260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.821374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.821401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.821589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.821760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.821813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.821938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.822097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.822124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.822260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.822398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.822424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.822564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.822782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.822831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.823026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.823182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.823208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.823310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.823416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.823442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.823624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.823803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.823850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.824010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.824195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.824221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.824359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.824465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.824492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.824673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.824865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.824909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.825068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.825225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.825251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.825410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.825526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.825554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.825706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.825884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.825927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.826110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.826236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.826272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.826412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.826544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.826576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.826798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.827002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.827045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.827176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.827317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.827342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-04-23 05:14:57.827476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.827621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-04-23 05:14:57.827648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.827812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.827973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.827999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.828161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.828273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.828299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.828441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.828554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.828590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.828754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.828917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.828960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.829119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.829267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.829294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.829403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.829538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.829575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.829775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.829953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.829996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.830127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.830240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.830267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.830408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.830551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.830578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.830731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.830927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.830969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.831107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.831242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.831267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.831375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.831565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.831612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.831797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.831974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.832017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.832164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.832291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.832316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.832446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.832566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.832611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.832783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.832915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.832941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.833081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.833221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.833247] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.833360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.833495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.833534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.833687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.833822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.833848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.833957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.834125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.834151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.834282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.834440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.834466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.834632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.834783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.834827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.834949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.835070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.835096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.835224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.835361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.835388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.835526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.835739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.835765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.835873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.836200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.836525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-04-23 05:14:57.836825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-04-23 05:14:57.836987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.837123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.837259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.837287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.837420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.837582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.837609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.837755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.837916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.837942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.838047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.838184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.838211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.838323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.838459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.838486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.838623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.838794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.838843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.839030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.839198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.839224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.839368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.839525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.839568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.839758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.839954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.839998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.840155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.840313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.840338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.840473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.840665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.840709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.840881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.841043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.841092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.841246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.841384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.841410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.841550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.841683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.841709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.841868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.842049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.842092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.842226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.842373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.842399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.842536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.842697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.842740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.842872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.843041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.843085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.843215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.843349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.843375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.843520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.843672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.843715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.843877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.844210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.844456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.844786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.844983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.845124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.845272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.845298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.845408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.845588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.845632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.845770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.845900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.845926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.846056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.846223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.846249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-04-23 05:14:57.846385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-04-23 05:14:57.846510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.846541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.846676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.846810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.846837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.847000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.847135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.847161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.847316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.847448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.847474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.847606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.847788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.847817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.847986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.848161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.848188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.848323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.848456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.848483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.848674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.848852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.848894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.849055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.849205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.849231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.849363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.849541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.849569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.849760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.849932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.849977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.850140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.850246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.850272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.850408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.850570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.850598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.850736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.850874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.850900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.851012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.851143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.851169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.851303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.851464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.851490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.851634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.851769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.851798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.851999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.852147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.852173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.852312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.852446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.852472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.852631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.852816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.852859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.853012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.853178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.853221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.853381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.853539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.853565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.853718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.853890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.853933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.854069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.854229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.854255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.854386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.854563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.854592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-04-23 05:14:57.854727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-04-23 05:14:57.854932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.854975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.855109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.855214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.855241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.855398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.855510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.855541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.855686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.855843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.855886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.856038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.856193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.856219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.856353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.856490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.856521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.856677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.856850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.856895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.857015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.857194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.857220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.857356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.857463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.857490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.857674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.857847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.857890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.858076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.858203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.858230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.858344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.858453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.858480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.858682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.858820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.858864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.859034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.859196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.859223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.859386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.859526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.859558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.859723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.859889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.859915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.860021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.860120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.860146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.860297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.860433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.860458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.860576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.860752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.860781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.860979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.861136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.861162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.861309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.861442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.861467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.861627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.861825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.861869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.862030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.862205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.862232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.862366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.862484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.862511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.862726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.862925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.862973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.863128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.863304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.863330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.863498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.863628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.863673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.863799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.863944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.863987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.864165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.864322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.864347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-04-23 05:14:57.864480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-04-23 05:14:57.864644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.864689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.864849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.865007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.865033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.865168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.865337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.865363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.865512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.865670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.865713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.865897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.866064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.866094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.866246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.866353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.866383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.866542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.866680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.866724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.866916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.867103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.867130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.867263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.867375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.867401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.867508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.867680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.867707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.867870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.868033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.868060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.868196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.868329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.868355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.868491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.868640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.868684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.868855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.869032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.869058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.869221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.869392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.869418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.869536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.869730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.869779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.869940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.870106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.870133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.870264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.870436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.870463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.870642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.870838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.870865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.871021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.871189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.871216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.871364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.871493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.871528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.871716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.871892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.871937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.872099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.872277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.872303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.872446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.872580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.872608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.872791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.872961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.872990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.873114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.873219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.873245] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.873367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.873507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.873539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.873680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.873830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.873859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.874034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.874200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.874227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-04-23 05:14:57.874335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-04-23 05:14:57.874436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.874464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.874625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.874797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.874826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.874968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.875135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.875162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.875277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.875449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.875476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.875656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.875868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.875913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.876065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.876248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.876275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.876410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.876566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.876595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.876782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.876990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.877035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.877192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.877323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.877350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.877462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.877624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.877669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.877864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.878014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.878044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.878189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.878321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.878347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.878487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.878643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.878687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.878843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.879011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.879055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.879189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.879316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.879341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.879498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.879677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.879704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.879854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.879990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.880017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.880129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.880291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.880318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.880457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.880591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.880619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.880729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.880831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.880857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.880984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.881096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.881124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.881237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.881378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.881405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.881535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.881691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.881737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.881893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.882075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.882102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.882213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.882342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.882369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.882536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.882690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.882737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.882862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.882977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.883003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.883142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.883275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.883302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.883440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.883574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-04-23 05:14:57.883601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-04-23 05:14:57.883737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.883846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.883872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.884002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.884170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.884197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.884309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.884441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.884468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.884629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.884833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.884877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.885002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.885156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.885183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.885292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.885447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.885474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.885642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.885826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.885870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.886022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.886179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.886206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.886337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.886450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.886477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.886616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.886821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.886863] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.887027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.887157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.887183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.887321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.887441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.887469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.887615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.887779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.887805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.887937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.888078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.888105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.888214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.888324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.888350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.888482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.888655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.888701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.888843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.888977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.889025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.889184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.889326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.889353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.889494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.889686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.889730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.889866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.890144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.890407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.890734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.890878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.891041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.891173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.891199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-04-23 05:14:57.891372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.891480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-04-23 05:14:57.891507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.891661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.891792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.891819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.891948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.892108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.892134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.892275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.892411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.892438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.892559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.892689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.892733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.892891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.893048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.893091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.893224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.893379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.893406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.893534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.893703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.893747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.893891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.894077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.894104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.894214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.894354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.894381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.894529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.894694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.894739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.894886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.895085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.895114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.895267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.895404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.895431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.895582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.895719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.895745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.895882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.896173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.896480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.896757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.896919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.897297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.897443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.897471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.897625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.897767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.897804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.897914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.898251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.898576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.898829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.898991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.899133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.899245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.899272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.899383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.899547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.899575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.899719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.899876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.899906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.900084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.900220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.900247] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.900384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.900570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.900600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-04-23 05:14:57.900733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.900865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-04-23 05:14:57.900892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.901057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.901168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.901196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.901352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.901485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.901512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.901676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.901848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.901892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.902011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.902162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.902189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.902346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.902512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.902548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.902693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.902868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.902916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.903102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.903249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.903294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.903435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.903558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.903586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.903738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.903920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.903947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.904050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.904189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.904217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.904352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.904484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.904511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.904624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.904787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.904832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.905009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.905186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.905213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.905351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.905460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.905487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.905644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.905866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.905910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.906034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.906160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.906189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.906329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.906439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.906465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.906579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.906734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.906777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.906963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.907120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.907146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.907309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.907448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.907475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.907632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.907775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.907819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.908005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.908161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.908188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.908298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.908432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.908458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.908622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.908860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.908907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.909128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.909282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.909309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.909471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.909632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.909676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.909809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.909974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.910003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.910201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.910357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.910384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-04-23 05:14:57.910534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.910657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-04-23 05:14:57.910700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.910844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.911018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.911061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.911226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.911367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.911393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.911533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.911671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.911716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.911868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.912032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.912066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.912207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.912314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.912341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.912482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.912675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.912729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.912890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.913153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.913208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.913341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.913472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.913500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.913621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.913791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.913839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.914008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.914140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.914174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.914292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.914426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.914454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.914610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.914749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.914775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.914939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.915076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.915103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.915237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.915380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.915408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.915571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.915689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.915715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.915892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.916059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.916089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.916230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.916390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.916417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.916590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.916769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.916816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.916972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.917126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.917158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.917289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.917420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.917446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.917578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.917779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.917824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.917967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.918141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.918187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.918295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.918421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.918456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.918620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.918815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.918842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.919029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.919178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.919205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.919325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.919460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.919491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.919688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.919892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.919925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.920080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.920275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.920306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-04-23 05:14:57.920458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-04-23 05:14:57.920614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.920646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.920772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.920926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.920968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.921214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.921367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.921410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.921585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.921693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.921738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.921892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.922055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.922085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.922231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.922388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.922417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.922548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.922681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.922707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.922877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.922990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.923028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.923182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.923299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.923325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.923468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.923618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.923645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.923781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.923918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.923956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.924099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.924239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.924266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.924392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.924529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.924571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.924714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.924858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.924884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.925047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.925163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.925193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.925324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.925468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.925496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.925652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.925761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.925799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.925938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.926087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.926117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.926359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.926609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.926638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.926805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.926968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.926995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.927136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.927324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.927354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.927488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.927679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.927706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.927845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.928172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.928412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.928702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.928860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.928997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.929106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.929133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.929246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.929383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.929412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.929558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.929696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.929723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-04-23 05:14:57.929881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-04-23 05:14:57.929994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.930021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.930154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.930305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.930336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.930477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.930662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.930690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.930826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.931020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.931050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.931202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.931346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.931375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.931564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.931735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.931762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.931895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.932163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.932458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.932711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.932871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.933006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.933270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.933553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.933831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.933990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.934096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.934206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.934233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.934373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.934471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.934498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.934616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.934747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.934773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.934906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.935205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.935510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.935807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.935994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.936160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.936292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.936319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.936461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.936584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.936612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.936753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.936888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.936915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.937029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.937193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.937219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-04-23 05:14:57.937353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.937466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-04-23 05:14:57.937492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.937637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.937777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.937802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.937940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.938218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.938458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.938726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.938862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.939034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.939202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.939229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.939370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.939508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.939542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.939677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.939840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.939867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.939986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.940273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.940542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.940825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.940966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.941102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.941264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.941291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.941411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.941557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.941586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.941730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.941897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.941924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.942057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.942313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.942590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.942857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.942993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.943098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.943201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.943227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.943391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.943544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.943573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.943735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.943870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.943897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.944036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.944148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.944175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.944338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.944498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.944534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.944676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.944817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.944844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.945003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.945178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.945226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.945390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.945501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.945538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.945701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.945877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.945926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-04-23 05:14:57.946082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-04-23 05:14:57.946252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.946295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.946432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.946541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.946569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.946754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.946933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.946963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.947163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.947321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.947348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.947482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.947632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.947677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.947813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.947985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.948015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.948176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.948316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.948344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.948455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.948583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.948614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.948787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.948931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.948975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.949128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.949274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.949301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.949438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.949563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.949594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.949764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.949972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.950016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.950123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.950260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.950288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.950403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.950518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.950546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.950673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.950817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.950846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.951015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.951153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.951180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.951285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.951442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.951468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.951598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.951753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.951780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.951952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.952060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.952087] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.952196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.952310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.952337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.952488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.952651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.952699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.952858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.953206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.953443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.953765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.953923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.954073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.954178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.954204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.954343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.954481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.954507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.954648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.954755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.954781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.954916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.955084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.955110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-04-23 05:14:57.955249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-04-23 05:14:57.955381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.955408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.955536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.955674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.955718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.955826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.955992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.956019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.956153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.956264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.956303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.956447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.956615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.956646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.956820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.956974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.957002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.957143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.957288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.957315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.957446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.957572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.957602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.957773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.957950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.957994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.958132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.958242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.958270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.958408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.958508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.958542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.958734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.958880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.958928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.959088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.959269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.959296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.959402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.959533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.959561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.959710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.959846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.959876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.960042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.960172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.960199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.960332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.960446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.960476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.960617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.960792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.960836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.961009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.961169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.961196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.961329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.961464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.961491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.961675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.961845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.961890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.962042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.962195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.962221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.962361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.962497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.962534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.962674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.962811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.962838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.962978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.963273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.963605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.963853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.963990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.964163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.964296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.964324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-04-23 05:14:57.964462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-04-23 05:14:57.964600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.964628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.964780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.964942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.964986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.965124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.965287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.965313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.965452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.965625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.965670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.965794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.965966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.966011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.966151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.966318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.966345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.966444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.966549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.966576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.966749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.966907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.966939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.967101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.967238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.967265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.967407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.967512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.967549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.967702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.967857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.967884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.968038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.968167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.968194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.968300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.968439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.968466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.968602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.968725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.968753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.968937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.969116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.969143] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.969259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.969360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.969387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.969534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.969696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.969740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.969926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.970075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.970106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.970243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.970384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.970413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.970563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.970740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.970769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.970973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.971279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.971573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.971869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.971997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.972163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.972301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.972328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-04-23 05:14:57.972469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-04-23 05:14:57.972604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.972632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.972777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.972876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.972902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.973063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.973196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.973223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.973389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.973552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.973580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.973741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.973919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.973964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.974125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.974269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.974295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.974397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.974576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.974623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.974755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.974899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.974926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.975035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.975169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.975197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.975309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.975446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.975472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.975621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.975757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.975802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.975988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.976142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.976169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.976297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.976405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.976433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.976624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.976794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.976823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.977005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.977137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.977163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.977324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.977465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.977491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.977655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.977865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.977909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.978063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.978242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.978269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.978402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.978509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.978544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.978699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.978853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.978880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.979015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.979150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.979176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.979319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.979451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.979477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.979621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.979757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.979784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.979939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.980179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.980417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.980718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.980906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.981011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.981150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.981177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-04-23 05:14:57.981320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.981431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-04-23 05:14:57.981457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.981565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.981714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.981744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.981911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.982063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.982106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.982245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.982404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.982430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.982529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.982655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.982699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.982823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.982976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.983002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.983120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.983256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.983284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.983429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.983587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.983632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.983758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.983914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.983942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.984080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.984186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.984214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.984323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.984468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.984495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.984647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.984823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.984867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.985021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.985179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.985206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.985344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.985456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.985482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.985655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.985784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.985814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.985943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.986103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.986130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.986244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.986383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.986408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.986559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.986698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.986725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.986834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.986996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.987023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.987128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.987298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.987325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.987455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.987646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.987690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.987845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.988038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.988081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.988213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.988372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.988399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.988508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.988669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.988725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.988849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.989001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.989028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.989163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.989299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.989326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.989460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.989629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.989674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.989842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.990029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.990074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.990236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.990401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.990428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-04-23 05:14:57.990569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.990706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-04-23 05:14:57.990743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.990915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991087] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.991196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.991473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.991784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.991942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.992054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.992194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.992221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.992339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.992478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.992505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.992632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.992742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.992769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.992879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.993012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.993040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.993146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.993282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.993309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.993448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.993610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.993656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.993819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.993999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.994029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.994208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.994357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.994383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.994574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.994727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.994775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.994928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.995106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.995132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.995277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.995417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.995444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.995614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.995750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.995783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.995950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.996135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.996164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.996322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.996456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.996482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.996624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.996739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.996765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.996939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.997059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.997088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.997235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.997383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.997414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.997583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.997723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.997750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.997912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.998071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.998101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.998279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.998441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.998467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.998636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.998772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.998815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.998994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.999140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.999170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.999355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.999532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.999560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:57.999675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.999805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:57.999832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-04-23 05:14:58.000054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:58.000232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-04-23 05:14:58.000262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.000435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.000622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.000650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.000786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.000927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.000957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.001134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.001320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.001349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.001497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.001661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.001688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.001823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.001977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.002007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.002132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.002319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.002349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.002472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.002601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.002628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.002738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.002886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.002915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.003032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.003182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.003211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.003386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.003580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.003608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.003744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.003869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.003898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-04-23 05:14:58.004048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.004168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-04-23 05:14:58.004198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.004358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.004478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.004508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.004635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.004742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.004769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.004934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.005109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.005139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.005266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.005414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.005444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.005590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.005738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.005765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.005929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.006064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.006093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.006268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.006442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.006471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.006619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.006725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.006752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.006882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.007039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.007068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.007192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.007345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-04-23 05:14:58.007375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-04-23 05:14:58.007580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.007743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.007769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.007924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.008077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.008106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.008254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.008408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.008454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.008627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.008765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.008806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.008973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.009111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.009138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.009305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.009460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.009491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.009654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.009789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.009816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.009956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.010110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.010139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.010300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.010422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.010452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.010608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.010747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.010774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.010911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.011092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.011121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.011299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.011422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.011448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.011589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.011694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.011720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.011886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.012204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.012567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.012837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.012998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.013163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.013271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.013301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.013486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.013632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.013658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.013773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.013902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.013931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.014104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.014257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.014285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.014435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.014603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.014630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.014758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.014974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.015002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.015151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.015296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.015324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.015484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.015630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.015662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.015776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.015936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.015966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.016113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.016231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.016261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.016394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.016568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.016595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-04-23 05:14:58.016711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.016852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-04-23 05:14:58.016878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.017042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.017157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.017186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.017308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.017502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.017537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.017677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.017816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.017842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.017948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.018074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.018099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.018293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.018402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.018428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.018558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.018699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.018730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.018839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.018999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.019026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.019162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.019294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.019322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.019497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.019658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.019684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.019840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.020022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.020082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.020245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.020404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.020429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.020567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.020680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.020707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.020909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.021104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.021130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.021264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.021424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.021454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.021612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.021733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.021766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.021930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.022044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.022084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.022251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.022417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.022445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.022607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.022739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.022764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.022928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.023034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.023060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.023191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.023352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.023396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.023523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.023669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.023697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.023824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.024000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.024028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.024207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.024395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.024420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.024558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.024689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.024714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.024876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.025179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.025457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.025819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.025986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-04-23 05:14:58.026150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-04-23 05:14:58.026312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.026341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.026469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.026675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.026702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.026805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.026934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.026961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.027072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.027209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.027236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.027423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.027588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.027614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.027753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.027889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.027914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.028049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.028231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.028259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.028419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.028554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.028582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.028725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.028865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.028892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.029093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.029204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.029230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.029341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.029489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.029527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.029687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.029830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.029872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.030032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.030173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.030199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.030334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.030463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.030491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.030660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.030797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.030823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.030958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.031067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.031092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.031285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.031415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.031442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.031612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.031768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.031797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.031928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.032055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.032081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.032229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.032406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.032435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.032586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.032701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.032730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.032918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.033067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.033108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.033223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.033369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.033398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.033582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.033690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.033717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.033924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.034070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.034096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.034276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.034412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.034437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.034593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.034747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.034776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.034936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.035074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.035101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.035262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.035442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-04-23 05:14:58.035471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-04-23 05:14:58.035608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.035758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.035788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.035977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.036084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.036111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.036224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.036380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.036406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.036543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.036661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.036690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.036868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.036985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.037010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.037117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.037218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.037243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.037376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.037524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.037552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.037688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.037847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.037873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.037999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.038123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.038151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.038275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.038445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.038471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.038610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.038748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.038789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.038904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.039230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.039543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.039843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.039974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.040072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.040224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.040253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.040376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.040504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.040560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.040710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.040884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.040913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.041067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.041232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.041257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.041418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.041586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.041617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.041778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.041937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.041964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.042098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.042236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.042262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.042411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.042544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.042570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.042705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.042903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.042929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.043033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.043139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.043165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.043278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.043430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.043459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.043626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.043767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.043792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.043960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.044148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.044176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.044329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.044524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-04-23 05:14:58.044551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-04-23 05:14:58.044694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.044799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.044824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.044991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.045144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.045172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.045316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.045466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.045496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.045691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.045827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.045853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.045980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.046120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.046148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.046339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.046529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.046559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.046673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.046868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.046894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.047033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.047281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.047332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.047447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.047593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.047623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.047784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.047921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.047946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.048139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.048311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.048340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.048502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.048671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.048697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.048880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.049039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.049065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.049202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.049336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.049363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.049502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.049703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.049729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.049879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.050123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.050150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.050264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.050448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.050473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.050620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.050756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.050782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.050917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.051100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.051129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.051257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.051396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.051423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.051559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.051671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.051698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.051832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.051997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.052022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.052194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.052330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.052356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.052488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.052612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.052639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-04-23 05:14:58.052753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-04-23 05:14:58.052887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.052913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.053072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.053180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.053205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.053313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.053445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.053473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.053642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.053789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.053816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.053944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.054103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.054129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.054242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.054383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.054409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.054543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.054695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.054725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.054836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.054980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.055006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.055160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.055277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.055316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.055512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.055660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.055687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.055824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.056149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.056464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.056813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.056999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.057149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.057324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.057353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.057468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.057647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.057677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.057807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.057982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.058011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.058144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.058278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.058306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.058491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.058645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.058674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.058839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.058979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.059006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.059183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.059298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.059323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.059484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.059644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.059671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.059823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.060179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.060468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.060820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.060979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.061147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.061312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.061342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.061498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.061681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.061708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.061822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.062023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-04-23 05:14:58.062050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-04-23 05:14:58.062158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.062287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.062313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.062473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.062659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.062688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.062846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.063213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.063522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.063817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.063993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.064109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.064226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.064255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.064435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.064595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.064630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.064793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.064939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.064966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.065118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.065263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.065290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.065413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.065574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.065612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.065751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.065919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.065946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.066084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.066262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.066290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.066410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.066580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.066609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.066761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.066904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.066932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.067114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.067249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.067277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.067438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.067599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.067626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.067752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.067881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.067914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.068043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.068226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.068252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.068386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.068489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.068523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.068634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.068790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.068816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.068976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.069090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.069121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.069247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.069429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.069458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.069611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.069762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.069791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.069946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.070082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.070109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.070265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.070456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.070483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.070598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.070730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.070761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.070889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.071015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.071050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.071187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.071347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-04-23 05:14:58.071372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.170 [2024-04-23 05:14:58.071543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.071685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.071713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.071869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.071973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.071999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.072112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.072243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.072269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.072429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.072536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.072564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.072728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.072877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.072919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.073034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.073142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.073168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.073334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.073465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.073493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.073663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.073807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.073833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.073968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.074130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.074159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.074304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.074416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.074445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.074621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.074797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.074825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.074951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.075086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.075113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.075247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.075394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.075423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.075565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.075724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.075750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.075944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.076068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.076098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.076288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.076487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.076523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.076674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.076836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.076864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.077000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.077157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.077185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.077344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.077471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.077500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.077683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.077819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.077846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.078005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.078150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.078176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.078331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.078478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.078509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.078655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.078804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.078834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.078981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.079124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.079150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.079316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.079446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.079477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.079672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.079777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.079805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.079957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.080124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.080150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.080285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.080417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.080444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-04-23 05:14:58.080570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.080717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-04-23 05:14:58.080743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.080912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.081058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.081084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.081219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.081421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.081447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.081585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.081714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.081768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.081927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.082090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.082130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.082276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.082441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.082468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.082584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.082715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.082741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.082876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083038] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.083202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.083542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.083817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.083962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.084149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.084282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.084324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.084506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.084654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.084681] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.084811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.084941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.084970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.085119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.085284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.085311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.085464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.085620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.085648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.085793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.085976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.086005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.086172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.086302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.086329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.086460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.086632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.086659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.086822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.086922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.086949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.087140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.087275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.087303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.087449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.087615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.087643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.087799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.087940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.087970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.088153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.088288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.088331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.088494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.088640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.088667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.088815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.088949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.088977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-04-23 05:14:58.089086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-04-23 05:14:58.089220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.089247] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.089386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.089529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.089573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.089748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.089885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.089914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.090095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.090230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.090256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.090407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.090573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.090601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.090746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.090879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.090904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.091073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.091225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.091254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.091409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.091547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.091578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.091751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.091875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.091904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.092060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.092176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.092204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.092376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.092539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.092583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.092720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.092906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.092936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.093057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.093227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.093256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.093378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.093532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.093560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.093709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.093848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.093875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.094017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.094154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.094181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.094338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.094489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.094523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.094667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.094773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.094799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.094923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.095104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.095130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.095259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.095409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.095438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.095590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.095739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.095767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.095927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.096088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.096130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.096282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.096458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.096487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.096623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.096775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.096803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.096963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.097122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.097148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.097286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.097397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.097423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.097556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.097711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.097742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.097894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.098022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.098052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.098205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.098367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-04-23 05:14:58.098393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-04-23 05:14:58.098529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.098668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.098694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.098819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.098979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.099005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.099182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.099322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.099350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.099510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.099670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.099699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.099858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.099971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.099997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.100132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.100316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.100341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.100499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.100683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.100710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.100822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.100973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.101001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.101177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.101312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.101353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.101509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.101690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.101716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.101879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.102112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.102165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.102346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.102507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.102543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.102707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.102839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.102883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.103002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.103171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.103199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.103353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.103501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.103539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.103692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.103868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.103897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.104032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.104199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.104224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.104398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.104531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.104558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.104680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.104817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.104846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.104994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.105181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.105207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.105400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.105584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.105614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.105805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.105941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.105968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.106132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.106254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.106284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.106429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.106570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.106600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.106754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.106912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.106953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.107130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.107269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.107299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.107420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.107583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.107613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.107778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.107918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.107944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-04-23 05:14:58.108077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.108209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-04-23 05:14:58.108235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.108410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.108529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.108556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.108680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.108853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.108883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.109010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.109156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.109186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.109335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.109475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.109501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.109721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.109886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.109912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.110021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.110252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.110315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.110489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.110623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.110653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.110786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.110925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.110950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.111144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.111304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.111331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.111492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.111660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.111686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.111825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.111940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.111967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.112102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.112239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.112264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.112403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.112574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.112602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.112708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.112815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.112841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.112971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.113104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.113129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.113261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.113360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.113385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.113546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.113677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.113708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.113888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.114049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.114080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.114217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.114379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.114405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.114504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.114650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.114676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.114839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.114985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.115014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.115154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.115306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.115336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.115489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.115643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.115671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.115796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.115933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.115959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.116119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.116255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.116283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.116396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.116570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.116600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.116786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.116926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.116951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.117153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.117287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.117337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-04-23 05:14:58.117485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.117643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-04-23 05:14:58.117673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.117796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.117954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.117983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.118119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.118250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.118276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.118412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.118543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.118569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.118702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.118846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.118875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.119038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.119185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.119214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.119362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.119507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.119543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.119707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.119844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.119871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.120044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.120193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.120222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.120369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.120541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.120576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.120729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.120900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.120930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.121090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.121251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.121296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.121417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.121569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.121608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.121757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.121935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.121964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.122110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.122307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.122333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.122483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.122624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.122659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.122845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.122997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.123026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.123150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.123296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.123325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.123474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.123653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.123683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.123822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.123982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.124012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.124142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.124288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.124320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.124498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.124666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.124695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.124805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.124938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.124970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.125105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.125239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.125265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.125459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.125576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.125605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.125756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.125903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.125933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.126084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.126225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.126254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.126403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.126539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.126566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.126698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.126836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.126865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-04-23 05:14:58.126985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.127139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-04-23 05:14:58.127165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.127332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.127496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.127550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.127726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.127884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.127914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.128069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.128259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.128286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.128389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.128500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.128533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.128703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.128875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.128901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.129006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.129119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.129146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.129254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.129385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.129412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.129549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.129675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.129706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.129888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.129999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.130026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.130161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.130319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.130346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.130486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.130671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.130702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.130824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.130943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.130973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.131091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.131266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.131294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.131467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.131598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.131625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.131818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.131952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.131977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.132154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.132331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.132360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.132493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.132670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.132697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.132858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.132990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.133033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.133150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.133295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.133324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.133444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.133629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.133656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.133769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.133897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.133926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.134105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.134245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.134271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.134438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.134586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.134613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.134729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.134855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.134881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-04-23 05:14:58.135044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-04-23 05:14:58.135233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.135259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.135394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.135526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.135553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.135734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.135844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.135870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.136031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.136148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.136178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.136333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.136485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.136513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.136692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.136806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.136832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.137038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.137188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.137218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.137392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.137542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.137572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.137713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.137898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.137927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.138108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.138241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.138267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.138378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.138502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.138539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.138698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.138871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.138900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.139047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.139223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.139250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.139409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.139568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.139598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.139759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.139921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.139948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.140115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.140302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.140329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.140449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.140610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.140637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.140789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.140951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.140978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.141130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.141303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.141332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.141512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.141716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.141743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.141901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.142198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.142499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.142830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.142964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.143140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.143305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.143331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.143465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.143570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.143599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.143743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.143943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.143969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.144114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.144242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.144270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.144445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.144620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.144650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-04-23 05:14:58.144776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-04-23 05:14:58.144933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.144958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.145086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.145249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.145274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.145475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.145620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.145648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.145791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.145931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.145961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.146093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.146201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.146227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.146362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.146529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.146556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.146719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.146867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.146898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.147032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.147167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.147193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.147368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.147528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.147572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.147707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.147866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.147895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.148081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.148263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.148289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.148421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.148565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.148594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.148756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.148896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.148922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.149083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.149199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.149229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.149384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.149546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.149594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.149732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.149915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.149943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.150116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.150292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.150321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.150476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.150630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.150661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.150840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.150951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.150976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.151134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.151254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.151284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.151442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.151559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.151586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.151780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.151938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.151964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.152146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.152307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.152333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.152505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.152649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.152675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.152805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.152924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.152950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.153068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.153181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.153207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.153344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.153510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.153545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.153656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.153798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.153825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-04-23 05:14:58.153932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.154069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-04-23 05:14:58.154094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.154252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.154426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.154456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.154613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.154751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.154777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.154959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.155108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.155137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.155286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.155392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.155419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.155575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.155689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.155718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.155863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.156018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.156047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.156223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.156368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.156397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.156559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.156720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.156747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.156908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.157076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.157106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.157279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.157397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.157426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.157549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.157696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.157724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.157906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.158040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.158082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.158235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.158353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.158382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.158548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.158726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.158756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.158917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.159200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.159439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.159772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.159952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.160122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.160291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.160320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.160444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.160579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.160614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.160743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.160902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.160930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.161062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.161183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.161217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.161408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.161568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.161595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.161755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.161933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.161962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.162140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.162245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.162272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.162456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.162578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.162609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.162769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.162931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.162958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.163069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.163214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.163240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-04-23 05:14:58.163389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.163560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-04-23 05:14:58.163590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.163737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.163890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.163919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.164102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.164222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.164251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.164402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.164565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.164592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.164757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.164907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.164937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.165116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.165254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.165280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.165453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.165618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.165645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.165810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.165945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.165989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.166159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.166302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.166330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.166481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.166643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.166671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.166780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.166939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.166986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.167097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.167232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.167259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.167390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.167556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.167584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.167743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.167931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.167960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.168106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.168263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.168289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.168421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.168537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.168564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.168727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.168892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.168921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.169102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.169250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.169279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.169422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.169567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.169606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.169764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.169926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.169969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.170089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.170218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.170257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.170422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.170577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.170604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.170791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.170932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.170961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.171138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.171277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.171303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.171412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.171563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.171594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-04-23 05:14:58.171736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.171912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-04-23 05:14:58.171942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.172099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.172205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.172232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.172390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.172500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.172534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.172695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.172870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.172899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.173019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.173135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.173163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.173280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.173433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.173467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.173651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.173790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.173844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.173951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.174134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.174164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.174310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.174423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.174461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.174635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.174758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.174787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.174923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.175240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.175544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.175839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.175994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.176128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.176236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.176263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.176384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.176538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.176574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.176728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.176877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.176906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.177046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.177158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.177184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.177288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.177454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.177480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.177598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.177702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.177729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.177844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.178049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.178076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.178212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.178369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.178398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.178559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.178720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.178746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.178900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.179020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.179050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.179230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.179370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.179396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.179505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.179695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.179723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.179881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.180178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.180479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-04-23 05:14:58.180792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-04-23 05:14:58.180977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.181148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.181287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.181311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.181499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.181670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.181697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.181807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.181972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.181997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.182128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.182281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.182308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.182480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.182599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.182625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.182790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.182965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.182994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.183147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.183288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.183319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.183467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.183635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.183664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.183787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.183938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.183967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.184082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.184196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.184226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.184405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.184554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.184584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.184753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.184871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.184896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.185060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.185255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.185282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.185446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.185600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.185630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.185795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.185960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.185985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.186161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.186297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.186322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.186525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.186649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.186676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.186855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.187005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.187033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.187165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.187309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.187335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.187524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.187664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.187690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.187842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.187974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.188003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.188159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.188305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.188334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.188472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.188608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.188635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.188790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.188939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.188964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.189078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.189187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.189229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.189387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.189505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.189544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.189687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.189798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.189825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.189963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.190124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.190153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-04-23 05:14:58.190313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.190425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-04-23 05:14:58.190452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.190572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.190685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.190710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.190819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.190931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.190957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.191089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.191234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.191262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.191384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.191548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.191574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.191738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.191836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.191862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.191975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.192222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.192500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.192778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.192943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.193076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.193239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.193263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.193385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.193528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.193554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.193693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.193827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.193852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.193969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.194210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.194536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.194814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.194980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.195095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.195238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.195264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.195409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.195528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.195554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.195669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.195780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.195805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.195911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.196198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.196558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.196801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.196961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.197121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.197283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.197328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.197500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.197616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.197643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.197758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.197899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.197924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.198038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.198222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.198251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-04-23 05:14:58.198398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19f5970 is same with the state(5) to be set 00:30:19.184 [2024-04-23 05:14:58.198589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.198725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-04-23 05:14:58.198754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.198907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.199160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.199453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.199729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.199896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.200045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.200159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.200185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.200319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.200428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.200456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.200596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.200703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.200731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.200869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.201151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.201414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.201705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.201897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.202036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.202147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.202174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.202283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.202416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.202442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.202554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.202697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.202723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.202845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.203170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.203459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.203743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.203918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.204049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.204165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.204192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.204360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.204496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.204531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.204685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.204834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.204862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.205001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.205142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.205168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.205307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.205444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.205471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.205588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.205707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.205734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.205849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.205986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.206013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.206149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.206262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.206289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.206402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.206499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.206535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.206679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.206843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.206870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-04-23 05:14:58.207003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-04-23 05:14:58.207142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.207169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.207325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.207438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.207465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.207637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.207751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.207777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.207887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.207992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.208018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.208135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.208248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.208277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.208392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.208558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.208586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.208696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.208833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.208860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.208965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.209258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.209509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.209772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.209937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.210075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.210209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.210236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.210371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.210511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.210544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.210693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.210808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.210834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.210993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.211131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.211158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.211296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.211431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.211458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.211605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.211711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.211737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.211881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.212160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.212481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.212793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.212926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.213091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.213201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.213228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.213387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.213529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.213568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.213682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.213838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.213865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.214001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.214135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.214162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-04-23 05:14:58.214295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.214412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-04-23 05:14:58.214439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.214579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.214691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.214717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.214838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.214975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.215002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.215113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.215226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.215252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.215420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.215553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.215585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.215688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.215830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.215857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.215995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.216158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.216185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.216323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.216458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.216485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.216631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.216746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.216775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.216908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.217146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.217439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.217689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.217852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.217983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.218120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.218147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.218260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.218406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.218433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.218546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.218658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.218694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.218857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.218983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.219013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.219182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.219320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.219347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.219481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.219631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.219658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.219795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.219930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.219957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.220175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.220314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.220341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.220446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.220592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.220619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.220728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.220871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.220898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.221009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.221145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.221173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.221309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.221414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.221441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.221580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.221723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.221749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.221982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.222133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.222162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.222304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.222435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.222461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.222599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.222737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.222764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-04-23 05:14:58.222930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-04-23 05:14:58.223034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.223061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.223204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.223318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.223346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.223448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.223579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.223607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.223745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.223883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.223909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.224047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.224213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.224239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.224377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.224522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.224550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.224690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.224820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.224848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.225062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.225176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.225203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.225321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.225423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.225449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.225616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.225729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.225755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.225866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.225980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.226007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.226173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.226311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.226338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.226471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.226591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.226618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.226723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.226943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.226970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.227135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.227243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.227269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.227430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.227547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.227574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.227725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.227862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.227889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.227996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.228112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.228139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.228257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.228405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.228431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.228594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.228706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.228733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.228898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.229159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.229442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.229791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.229924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.230070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.230243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.230270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.230427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.230568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.230595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.230733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.230840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.230867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.230987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.231119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.231158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.231295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.231405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.231431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-04-23 05:14:58.231562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-04-23 05:14:58.231713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.231739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.231887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.232218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.232532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.232828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.232967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.233106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.233211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.233238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.233380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.233485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.233512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.233673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.233809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.233836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.233938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.234219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.234538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.234814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.234950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.235093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.235201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.235229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.235344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.235459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.235486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.235606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.235736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.235762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.235899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.236235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.236541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.236843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.236978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.237113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.237273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.237299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.237434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.237567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.237594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.237708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.237816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.237842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.237992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.238274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.238562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.238839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.238976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.239110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.239222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.239249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.239402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.239536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.239563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.239683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.239818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-04-23 05:14:58.239848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-04-23 05:14:58.239990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.240157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.240184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.240321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.240459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.240486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.240659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.240769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.240796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.240958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.241205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.241474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.241817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.241952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.242070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.242200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.242227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.242338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.242477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.242504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.242648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.242777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.242803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.242941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.243109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.243135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.243269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.243377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.243403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.243547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.243681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.243708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.243846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.244175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.244493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.244797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.244933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.245044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.245207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.245234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.245396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.245532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.245560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.245691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.245833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.245861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.246007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.246122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.246149] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.246264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.246422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.246448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.246559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.246668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.246695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.246856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.246997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.247024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.247174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.247313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.247340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-04-23 05:14:58.247483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.247605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-04-23 05:14:58.247632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.247740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.247903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.247929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.248092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.248228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.248255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.248394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.248533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.248561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.248710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.248820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.248847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.248974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.249115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.249142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.249305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.249448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.249476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.249619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.249752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.249779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.249910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.250184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.250430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.250672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.250829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.250946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.251227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.251504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.251828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.251960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.252072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.252210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.252237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.252383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.252525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.252552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.252688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.252849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.252875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.253013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.253127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.253153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.253269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.253380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.253407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.253545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.253677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.253704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.253840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.253990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.254016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.254127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.254234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.254260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.254388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.254489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.254522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.254665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.254805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.254831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.254943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.255072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.255098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.255231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.255347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.255373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.255476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.255617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.255644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-04-23 05:14:58.255785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-04-23 05:14:58.255916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.255943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.256074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.256189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.256216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.256362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.256543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.256571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.256717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.256828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.256855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.257004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.257138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.257164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.257291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.257429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.257457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.257577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.257713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.257740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.257853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.257984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.258011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.258150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.258248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.258275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.258385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.258549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.258576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.258712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.258855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.258882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.259013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.259145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.259172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.259309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.259414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.259441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.259589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.259731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.259757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.259897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.260172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.260477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.260755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.260892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.261005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.261266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.261507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.261816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.261952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.262092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.262199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.262225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.262365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.262504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.262538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.262651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.262797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.262823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.262972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.263300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.263555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.263808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.263944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-04-23 05:14:58.264108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-04-23 05:14:58.264220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.264248] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.264408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.264540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.264568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.264706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.264883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.264909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.265027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.265296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.265540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.265791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.265959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.266068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.266180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.266207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.266351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.266523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.266549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.266658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.266789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.266815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.266974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.267220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.267523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.267831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.267987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.268106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.268219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.268247] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.268365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.268507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.268539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.268680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.268819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.268846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.268988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.269271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.269533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.269859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.269998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.270131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.270233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.270258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.270418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.270535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.270562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.270708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.270844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.270870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.271006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.271113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.271139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.271275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.271410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.271436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.271600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.271717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.271744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.271857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.271999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.272026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.272189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.272306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.272332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-04-23 05:14:58.272495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-04-23 05:14:58.272667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.272693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.272829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.272964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.272990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.273099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.273260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.273286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.273400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.273509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.273543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.273676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.273789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.273815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.273978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.274078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.274104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.274262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.274402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.274428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.274568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.274728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.274754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.274862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.274977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.275003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.275139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.275280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.275306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.275416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.275541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.275568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.275731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.275841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.275867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.276007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.276115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.276141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.276302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.276441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.276467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.276607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.276741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.276766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.276926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.277251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.277533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.277778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.277915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.278054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.278214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.278241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.278389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.278500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.278535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.278680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.278824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.278850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.278965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.279079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.279106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.279269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.279486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.279512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.279643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.279815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.279841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.279946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.280090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.280116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.280255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.280420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.280447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.280585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.280707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.280734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-04-23 05:14:58.280874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.281012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-04-23 05:14:58.281043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.281155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.281264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.281291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.281420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.281555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.281583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.281750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.281885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.281911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.282015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.282188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.282214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.282323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.282436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.282464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.282582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.282729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.282756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.282895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.283025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.283052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.283159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.283396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.283423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.283563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.283704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.283730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.283851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.283983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.284014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.284155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.284316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.284342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.284451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.284588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.284616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.284726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.284884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.284910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.285072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.285218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.285245] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.285381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.285550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.285578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.285686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.285799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.285827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.285968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.286107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.286135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.286299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.286412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.286440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.286557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.286697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.286723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.286888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.286999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.287031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.287147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.287284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.287310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.287454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.287561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.287588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.287696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.287827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.287854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.287960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.288077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.288104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.288214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.288324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-04-23 05:14:58.288350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-04-23 05:14:58.288472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.288617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.288643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.288758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.288888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.288914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.289032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.289167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.289193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.289327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.289440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.289466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.289615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.289725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.289751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.289915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.290187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.290456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.290769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.290897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.291032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.291165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.291192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.291328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.291463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.291489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.291599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.291862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.291889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.292002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.292274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.292558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.292812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.292978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.293090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.293227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.293253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.293415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.293553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.293579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.293735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.293845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.293872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.294019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.294326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.294575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.294858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.294996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.295132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.295241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.295267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.295372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.295510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.295549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.295668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.295777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.295802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.295954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.296090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.296115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.296231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.296374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.296401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-04-23 05:14:58.296535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.296635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-04-23 05:14:58.296661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.296811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.296944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.296970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.297130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.297238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.297264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.297400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.297538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.297565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.297706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.297844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.297870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.297978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.298129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.298156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.298301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.298462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.298487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.298632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.298770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.298797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.298933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.299207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.299539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.299792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.299936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.300050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.300162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.300189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.300322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.300458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.300485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.300600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.300735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.300761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.300927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.301205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.301460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.301766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.301958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.302064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.302206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.302231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.302368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.302476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.302502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.302646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.302783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.302809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.302971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.303106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.303132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.303246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.303379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.303406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.303539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.303801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.303828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.303994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.304113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.304140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.304274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.304411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.304437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.304583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.304715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.304741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.304851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.304983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.305010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-04-23 05:14:58.305152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-04-23 05:14:58.305261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.305286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.305397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.305553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.305580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.305685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.305798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.305824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.305937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.306206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.306508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.306768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.306907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.307070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.307229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.307254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.307363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.307494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.307527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.307637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.307749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.307776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.307917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.308182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.308489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.308795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.308956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.309091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.309233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.309260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.309405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.309547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.309574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.309738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.309872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-04-23 05:14:58.309898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-04-23 05:14:58.310008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.310143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.310169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.310326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.310467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.310493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.310636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.310744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.310771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.310921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.311244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.311548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.311815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.311985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.312146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.312284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.312311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.312475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.312662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.312689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.312827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.312966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.312992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.313099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.313233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.313259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.313366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.313486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.313512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.313683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.313801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.313828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.313964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.314231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.314509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.314831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.314991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.315128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.315242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.315269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.315393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.315555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.315582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.480 qpair failed and we were unable to recover it. 00:30:19.480 [2024-04-23 05:14:58.315746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.315912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.480 [2024-04-23 05:14:58.315939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.316099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.316261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.316288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.316428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.316601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.316628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.316765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.316914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.316941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.317102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.317236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.317263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.317401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.317513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.317544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.317687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.317799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.317826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.317985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.318146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.318172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.318336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.318471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.318497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.318653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.318761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.318789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.318952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.319223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.319498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.319807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.319960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.320069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.320170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.320196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.320356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.320462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.320489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.320657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.320787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.320813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.320976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.321109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.321135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.321275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.321389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.321416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.321578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.321710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.321736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.321869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.322187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.322482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.322776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.322938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.323105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.323245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.323272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.323374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.323479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.323505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.323647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.323752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.323778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.323892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.324049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.324076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.324237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.324340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.324366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.481 qpair failed and we were unable to recover it. 00:30:19.481 [2024-04-23 05:14:58.324502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.481 [2024-04-23 05:14:58.324618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.324645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.324771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.324887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.324913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.325020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.325157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.325184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.325349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.325486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.325522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.325669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.325832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.325857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.325997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.326268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.326541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.326820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.326983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.327120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.327286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.327313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.327448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.327559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.327585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.327724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.327833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.327859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.327973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.328115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.328142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.328284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.328421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.328451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.328591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.328754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.328780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.328919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.329216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.329489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.329803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.329933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.330058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.330183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.330209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.330346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.330489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.330538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.330680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.330817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.330843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.330994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.331153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.331179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.331325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.331434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.331465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.331600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.331760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.331787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.331896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.332147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.332500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.332813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.332999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.482 qpair failed and we were unable to recover it. 00:30:19.482 [2024-04-23 05:14:58.333107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.482 [2024-04-23 05:14:58.333264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.333291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.333450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.333557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.333584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.333716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.333826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.333854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.333997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.334107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.334133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.334268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.334429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.334459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.334619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.334760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.334786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.334893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.335185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.335508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.335788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.335978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.336112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.336248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.336274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.336440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.336551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.336578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.336715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.336825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.336851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.336989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.337226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.337534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.337818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.337979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.338118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.338228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.338255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.338416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.338549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.338576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.338690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.338855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.338881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.339037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.339148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.339174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.339311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.339441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.339466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.339629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.339767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.339794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.339958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.340095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.340121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.340264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.340373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.340399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.340526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.340665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.340691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.340844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.340978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.341005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.341130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.341277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.341303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.483 [2024-04-23 05:14:58.341439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.341576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.483 [2024-04-23 05:14:58.341603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.483 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.341733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.341873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.341898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.342031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.342197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.342223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.342356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.342490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.342526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.342646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.342823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.342849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.342989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.343125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.343150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.343280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.343412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.343439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.343561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.343730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.343756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.343897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.344067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.344093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.344198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.344302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.344338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.344505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.344649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.344676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.344815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.344977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.345003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.345137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.345252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.345278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.345381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.345545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.345572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.345684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.345800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.345826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.345932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.346199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.346494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.346789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.346926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.347060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.347198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.347224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.347362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.347526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.347552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.347662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.347828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.347854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.347992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.348106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.348133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.348274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.348432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.348458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.484 [2024-04-23 05:14:58.348600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.348703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.484 [2024-04-23 05:14:58.348731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.484 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.348860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.348972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.349000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.349113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.349276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.349302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.349446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.349582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.349609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.349775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.349913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.349940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.350051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.350159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.350187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.350291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.350423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.350450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.350568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.350740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.350767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.350926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.351207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.351468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.351745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.351911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.352052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.352214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.352241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.352385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.352502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.352535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.352671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.352806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.352833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.352966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.353107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.353134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.353244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.353417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.353444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.353591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.353703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.353730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.353867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.354160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.354487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.354786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.354949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.355086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.355205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.355231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.355343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.355479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.355505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.355645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.355778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.355804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.355959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.356250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.356497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.356784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.356953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.485 [2024-04-23 05:14:58.357117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.357255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.485 [2024-04-23 05:14:58.357281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.485 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.357416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.357549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.357577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.357685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.357823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.357850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.357966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.358102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.358128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.358285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.358442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.358472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.358601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.358739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.358766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.358872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.359194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.359494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.359809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.359982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.360148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.360254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.360280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.360394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.360532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.360560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.360694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.360816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.360843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.360979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.361137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.361164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.361268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.361418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.361445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.361613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.361744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.361773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.361914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.362213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.362505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.362805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.362973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.363085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.363193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.363219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.363355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.363463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.363490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.363617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.363726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.363752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.363910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.364071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.364097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.364261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.364440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.364466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.364604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.364739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.364766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.364872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.365156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.365494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.486 [2024-04-23 05:14:58.365774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.486 [2024-04-23 05:14:58.365912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.486 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.366078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.366223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.366250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.366357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.366502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.366536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.366669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.366811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.366837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.366944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.367054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.367080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.367213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.367357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.367389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.367528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.367669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.367695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.367838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.367997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.368024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.368166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.368305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.368331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.368465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.368578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.368606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.368745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.368882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.368909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.369042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.369178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.369204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.369310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.369452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.369478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.369602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.369741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.369768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.369880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.369986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.370012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.370149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.370290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.370317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.370433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.370575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.370602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.370742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.370850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.370876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.371033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.371170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.371197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.371316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.371427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.371455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.371589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.371724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.371750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.371865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.371975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.372002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.372134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.372263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.372290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.372400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.372533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.372560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.372696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.372831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.372858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.372995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.373306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.373563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.373855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.373990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.374127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.374286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.487 [2024-04-23 05:14:58.374312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.487 qpair failed and we were unable to recover it. 00:30:19.487 [2024-04-23 05:14:58.374438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.374577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.374606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.374741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.374845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.374871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.375000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.375135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.375161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.375322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.375430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.375456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.375598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.375721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.375747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.375883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.375989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.376015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.376177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.376340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.376366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.376505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.376642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.376668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.376809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.376920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.376947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.377056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.377194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.377220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.377383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.377491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.377524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.377678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.377788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.377814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.377923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.378213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.378452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.378732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.378891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.378999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.379141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.379167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.379279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.379388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.379425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.379565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.379678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.379703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.379869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.380169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.380427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.380688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.380820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.380944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.381192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.381492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.381764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.381928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.382041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.382157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.382185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.382326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.382460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.488 [2024-04-23 05:14:58.382487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.488 qpair failed and we were unable to recover it. 00:30:19.488 [2024-04-23 05:14:58.382607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.382722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.382749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.382857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.382995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.383021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.383132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.383262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.383288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.383423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.383565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.383593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.383756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.383863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.383889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.384024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.384133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.384160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.384264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.384372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.384398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.384539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.384684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.384710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.384850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.384988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.385014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.385142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.385271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.385298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.385408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.385546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.385573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.385679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.385796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.385823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.385936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.386075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.386101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.386265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.386390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.386416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.386578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.386715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.386742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.386881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.387141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.387405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.387688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.387843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.387975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.388105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.388130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.388264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.388404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.388429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.388550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.388691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.388719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.388860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.388974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.389000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.389135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.389264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.389291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.389397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.389544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.389571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.489 qpair failed and we were unable to recover it. 00:30:19.489 [2024-04-23 05:14:58.389735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.389874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.489 [2024-04-23 05:14:58.389900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.390036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.390271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.390513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.390800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.390960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.391087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.391193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.391219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.391377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.391551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.391578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.391686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.391784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.391810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.391947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.392213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.392486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.392827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.392988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.393126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.393256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.393282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.393449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.393626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.393656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.393768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.393912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.393939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.394113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.394218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.394244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.394380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.394522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.394550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.394667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.394796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.394822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.394957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.395246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.395533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.395828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.395980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.396083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.396203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.396229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.396336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.396470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.396500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.396641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.396747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.396773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.396883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.396992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.397018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.397184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.397285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.397311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.397418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.397528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.397555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.397685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.397815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.397840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.490 [2024-04-23 05:14:58.397949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.398091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.490 [2024-04-23 05:14:58.398117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.490 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.398277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.398383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.398409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.398542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.398679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.398705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.398865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.399173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.399468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.399798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.399968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.400105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.400243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.400270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.400370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.400481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.400507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.400628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.400767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.400793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.400903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.401227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.401529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.401834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.401967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.402070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.402234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.402261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.402381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.402527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.402554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.402685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.402827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.402853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.402958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.403191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.403485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.403738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.403869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.404034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.404155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.404181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.404320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.404417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.404443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.404572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.404715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.404742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.404879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.404991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.405017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.405179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.405312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.405338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.405475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.405583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.405610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.405714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.405826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.405853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.405990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.406126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.406152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.491 qpair failed and we were unable to recover it. 00:30:19.491 [2024-04-23 05:14:58.406287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.406422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.491 [2024-04-23 05:14:58.406448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.406555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.406698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.406723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.406869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.407190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.407522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.407802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.407967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.408139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.408276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.408302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.408415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.408522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.408549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.408655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.408787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.408813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.408916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.409230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.409551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.409790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.409975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.410136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.410240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.410267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.410408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.410569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.410596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.410735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.410867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.410893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.411022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.411154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.411186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.411346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.411490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.411522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.411660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.411766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.411792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.411926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.412171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.412443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.412752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.412913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.413076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.413215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.413243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.413409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.413544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.413571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.413709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.413819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.413850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.413969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.414130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.414160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.414328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.414439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.414465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.414613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.414752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.414778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.492 qpair failed and we were unable to recover it. 00:30:19.492 [2024-04-23 05:14:58.414916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.415061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.492 [2024-04-23 05:14:58.415088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.415190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.415295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.415321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.415427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.415557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.415584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.415685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.415849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.415875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.415985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.416251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.416493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.416794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.416953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.417069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.417207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.417233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.417378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.417524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.417550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.417672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.417801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.417827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.417965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.418234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.418488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.418793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.418955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.419066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.419210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.419237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.419403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.419574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.419602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.419736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.419874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.419905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.420021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.420138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.420165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.420292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.420430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.420456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.420633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.420751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.420777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.420914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.421199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.421437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.421770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.421902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.422038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.422138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.493 [2024-04-23 05:14:58.422164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.493 qpair failed and we were unable to recover it. 00:30:19.493 [2024-04-23 05:14:58.422303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.422416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.422442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.422566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.422671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.422697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.422836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.422950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.422976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.423113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.423229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.423257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.423370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.423505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.423539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.423651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.423783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.423810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.423919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.424167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.424422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.424659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.424785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.424922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.425191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.425524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.425802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.425964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.426101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.426237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.426264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.426398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.426563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.426590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.426728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.426889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.426915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.427072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.427312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.427591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.427844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.427979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.428115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.428237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.428264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.428397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.428536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.428568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.428673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.428783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.428809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.428963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.429095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.429121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.429258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.429394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.429420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.429557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.429696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.429722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.429858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.430008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.430034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.494 [2024-04-23 05:14:58.430203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.430310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.494 [2024-04-23 05:14:58.430337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.494 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.430473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.430612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.430639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.430753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.430879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.430906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.431048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.431182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.431208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.431365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.431503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.431534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.431670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.431782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.431808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.431944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.432220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.432485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.432786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.432975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.433108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.433219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.433245] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.433377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.433483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.433509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.433627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.433739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.433767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.433899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.434174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.434504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.434825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.434960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.435095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.435193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.435219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.435359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.435486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.435512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.435659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.435789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.435816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.435952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.436266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.436548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.436828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.436991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.437091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.437228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.437254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.437387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.437486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.437510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.437633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.437738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.437764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.437921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.438024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.438050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.438181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.438319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.438345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.495 [2024-04-23 05:14:58.438483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.438605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.495 [2024-04-23 05:14:58.438632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.495 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.438770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.438879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.438905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.439050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.439218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.439244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.439354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.439490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.439521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.439661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.439769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.439795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.439958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.440243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.440521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440681] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.440779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.440909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.441011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.441291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.441547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.441801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.441974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.442090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.442229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.442255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.442389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.442494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.442531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.442676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.442805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.442830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.442940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.443070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.443100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.443269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.443409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.443434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.443568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.443699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.443725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.443855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.443986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.444012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.444112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.444225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.444252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.444407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.444567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.444593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.444756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.444857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.444883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.444993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.445271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.445510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.445794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.445958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.446108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.446258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.446284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.446391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.446548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.446587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.446734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.446897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.496 [2024-04-23 05:14:58.446922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.496 qpair failed and we were unable to recover it. 00:30:19.496 [2024-04-23 05:14:58.447032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.447167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.447194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.447335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.447465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.447492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.447659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.447786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.447812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.447946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.448213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.448453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.448728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.448873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.448981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.449149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.449176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.449310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.449412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.449438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.449605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.449783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.449809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.449955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.450202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.450442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.450698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.450827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.450935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.451073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.451099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.451209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.451324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.451349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.451488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.451712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.451739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.451894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.452187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.452434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.452703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.452859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.452993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.453248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.453559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.453831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.453995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.454107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.454266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.454292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.454394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.454536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.454564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.454700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.454829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.454855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.455026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.455184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.455210] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.497 qpair failed and we were unable to recover it. 00:30:19.497 [2024-04-23 05:14:58.455346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.497 [2024-04-23 05:14:58.455474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.455500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.455674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.455773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.455799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.455935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.457225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.457542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.457849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.457995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.458134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.458268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.458294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.458430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.458545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.458572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.458686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.458804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.458830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.458965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.459099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.459125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.459266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.459407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.459432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.459576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.459685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.459711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.459881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.459988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.460015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.460131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.460244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.460271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.460391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.460503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.460548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.460679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.460793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.460818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.460948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.461228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.461523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.461801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.461932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.462032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.462304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.462567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.462836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.462973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.463088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.463227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.463252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.498 [2024-04-23 05:14:58.463362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.463498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.498 [2024-04-23 05:14:58.463528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.498 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.463651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.463788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.463813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.463963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.464106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.464131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.464294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.464405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.464432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.464575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.464689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.464715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.464870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.464978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.465005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.465120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.465233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.465259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.465389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.465499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.465531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.465657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.465772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.465798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.466982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.467144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.467171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.467336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.467482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.467508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.467634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.467772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.467798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.467910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.468215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.468511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.468804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.468966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.469102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.469238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.469264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.469408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.469545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.469578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.469695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.469805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.469832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.469946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.470079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.470105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.470236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.470379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.470404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.470544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.470667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.470693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.470858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.470993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.471019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.471152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.471288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.471314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.471455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.471592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.471619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.471732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.471896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.471922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.472030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.472188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.472214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.472347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.472452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.472477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.472623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.472769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.472805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.499 [2024-04-23 05:14:58.472945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.473059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.499 [2024-04-23 05:14:58.473085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.499 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.473222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.473340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.473366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.473505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.473632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.473658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.473792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.473951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.473977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.474092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.474328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.474354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.474490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.474680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.474707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.474822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.474975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.475001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.475135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.475268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.475294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.475408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.475538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.475570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.475702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.475860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.475886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.476043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.476151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.476176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.476286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.476391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.476419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.476566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.476702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.476729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.476877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.477146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.477425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.477683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.477822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.477931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.478246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.478496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.478806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.478944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.479118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.479255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.479283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.479397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.479530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.479557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.479696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.479841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.479867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.480005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.480118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.480145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.480274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.480435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.480461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.480604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.480743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.480769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.480934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.481041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.481066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.481196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.481314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.481339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.481477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.481617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.500 [2024-04-23 05:14:58.481643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.500 qpair failed and we were unable to recover it. 00:30:19.500 [2024-04-23 05:14:58.481756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.481867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.481893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.482030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.482132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.482158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.482292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.482428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.482454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.482566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.482714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.482739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.482893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.483208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.483505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.483784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.483974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.484110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.484244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.484269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.484433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.484605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.484631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.484740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.484884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.484909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.485044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.485159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.485184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.485327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.485465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.485490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.485667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.485777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.485804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.485919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.486166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.486489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.486805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.486969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.487107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.487269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.487294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.487419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.487528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.487554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.487684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.487821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.487847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.487957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.488074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.488099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.488232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.488378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.488403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.488575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.488715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.488740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.488855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.488992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.489018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.489212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.489336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.489365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.489508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.489673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.489703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.489813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.489955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.489981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.490092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.490229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.501 [2024-04-23 05:14:58.490255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.501 qpair failed and we were unable to recover it. 00:30:19.501 [2024-04-23 05:14:58.490387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.490502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.490538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.490653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.490766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.490797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.490896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.491191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.491455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.491739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.491888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.491991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.492288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.492568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.492860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.492994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.493132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.493281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.493308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.493468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.493586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.493613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.493749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.493891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.493917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.494058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.494197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.494224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.494339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.494472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.494499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.494654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.494793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.494819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.494970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.495102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.495128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.495255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.495377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.495405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.495563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.495710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.495737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.495861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.495998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.496028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.496190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.496321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.496347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.496497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.496626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.496652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.496787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.496945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.496972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.497110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.497240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.497266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.497377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.497513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.497548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.497700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.497842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.497868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.497975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.498080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.498106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.502 qpair failed and we were unable to recover it. 00:30:19.502 [2024-04-23 05:14:58.498241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.502 [2024-04-23 05:14:58.498389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.498421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.498560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.498697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.498724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.498833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.498971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.498998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.499112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.499244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.499270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.499404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.499537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.499569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.499730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.499870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.499896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.500043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.500180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.500205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.500336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.500470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.500497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.500630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.500779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.500806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.500968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.501105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.501131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.501266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.501412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.501443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.501569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.501702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.501729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.501849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.502013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.502039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.502181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.502344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.502371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.502507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.502661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.502687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.502830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.503046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.503072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.503211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.503347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.503373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.503485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.503656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.503683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.503819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.503982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.504009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.504174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.504321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.504350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.504487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.504655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.504686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.504859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.505017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.505043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-04-23 05:14:58.505152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.505260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-04-23 05:14:58.505286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.505422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.505560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.505588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.505704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.505849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.505887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.505996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.506130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.506156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.506295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.506412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.506438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.506575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.506710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.506737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.506874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.507139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.507398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.507715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.507847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.507984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.508145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.508171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.508274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.508490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.508522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.508627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.508767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.508793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.508947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.509216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.509511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.509833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.509998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.510160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.510263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.510289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.510427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.510565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.510592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.510759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.510869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.510897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.511018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.511148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.511174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.511282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.511444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-04-23 05:14:58.511469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-04-23 05:14:58.511601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.511742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.511779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.511915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.512149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.512397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.512726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.512876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.512990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.513151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.513177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.513313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.513420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.513446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.513563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.513683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.513709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.513847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.513983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.514009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.514151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.514256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.514282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.514387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.514540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.514578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.514711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.514832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.514857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.515016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.515167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.515193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.515341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.515503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.515561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.515671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.515836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.515862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.516031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.516148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.516174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.516312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.516417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.516443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.516563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.516677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.516704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.516843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.516993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.517019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.517154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.517290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.517317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-04-23 05:14:58.517480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.517621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-04-23 05:14:58.517648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.517821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.517957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.517985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.518126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.518261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.518288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.518453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.518605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.518632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.518773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.518887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.518913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.519020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.519158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.519185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.519295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.519453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.519479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.519627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.519781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.519807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.519946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.520095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.520121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.520270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.520406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.520433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.520565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.520707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.520734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.520884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.521023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.521049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.521183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.521347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.521374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.521538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.521653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.521679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.521831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.521995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.522021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.522139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.522300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.522326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.522464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.522612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.522639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.522778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.522919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.522946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.523084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.523220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.523248] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.523388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.523534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.523571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.523712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.523846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.523872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.524011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.524179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.524205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.524321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.524455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.524483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.524638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.524773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.524800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.524910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.525048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.525077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-04-23 05:14:58.525214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-04-23 05:14:58.525371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.525398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.525513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.525682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.525709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.525858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.526189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.526494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.526844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.526973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.527107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.527243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.527270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.527408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.527555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.527582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.527715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.527836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.527865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.527984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.528124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.528151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.528315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.528456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.528483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.528617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.528732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.528759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.528911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.529051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.529078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.529252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.529368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.529396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.529536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.529677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.529704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.529868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.530162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.530501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.530820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.530986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.531119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.531258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.531285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.531397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.532171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.532203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-04-23 05:14:58.532337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-04-23 05:14:58.532480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.532507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.532669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.532835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.532862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.533000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.533136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.533162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.533321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.533436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.533462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.533594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.533754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.533792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.533932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.534233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.534506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.534792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.534963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.535076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.535217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.535244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.535387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.535526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.535564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.535726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.536443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.536474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.536620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.536785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.536811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.536951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.537088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.537114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.537261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.537425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.537451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.537605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.537748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.537781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.537921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.538035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.538063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.538179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.538288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-04-23 05:14:58.538315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-04-23 05:14:58.538479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.538605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.538632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.538763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.538905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.538931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.539067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.539230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.539256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.539370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.539519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.539547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.539682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.539818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.539845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.539954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.540124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.540150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.540282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.540421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.540447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.540550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.540690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.540717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.540867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.541140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.541460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.541745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.541947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.542107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.542266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.542292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.542463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.542631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.542658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.542780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.542894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.542922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.543040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.543186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.543213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.543346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.543524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.543552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.543710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.543859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.543886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.544018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.544125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.544151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.544305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.544454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.544483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.544656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.544800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.544827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-04-23 05:14:58.544936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-04-23 05:14:58.545083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.545110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.545250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.545357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.545384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.545525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.545652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.545678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.545821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.545960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.545986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.546128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.546261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.546287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.546394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.546548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.546574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.546710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.546854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.546878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.546982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547144] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.547276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.547542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.547796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.547961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.548127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.548236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.548262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.548374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.548521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.548563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.548674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.548780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.548806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.548919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.549195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.549453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.549724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.549873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.550014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.550147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.550173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.550280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.550438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.550464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.550628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.550747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.550773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.550881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.551026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.551052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-04-23 05:14:58.551189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.551323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-04-23 05:14:58.551354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.551466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.551602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.551628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.551764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.551931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.551957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.552113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.552252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.552278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.552385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.552523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.552550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.552662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.552802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.552829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.552940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.553187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.553432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.553755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.553924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.554061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.554205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.554237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.554374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.554507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.554541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.554667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.554780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.554806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.554912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.555038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.555064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.555199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.555340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.555366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.555471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.555643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.555671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.555835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.555974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.556001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.556142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.556284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.556311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.556428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.556571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.556598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.556707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.556832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.556859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.557018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.557153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.557178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.557317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.557466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.557492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.557660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.557766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.557792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-04-23 05:14:58.557903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.558047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-04-23 05:14:58.558073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.558179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.558314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.558340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.558510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.558629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.558655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.558787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.558950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.558977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.559084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.559222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.559248] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.559389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.559561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.559589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.559702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.559839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.559865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.560031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.560190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.560215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.560353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.560461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.560487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.560660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.560823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.560849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.560968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.561103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.561129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.561269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.561409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.561435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.561572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.561737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.561763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.561904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.562171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.562500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.562786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.562974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.563082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.563212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.563239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.563352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.563505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.563537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.563685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.563852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.563878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.564004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.564166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.564193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.564333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.564471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.564497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.564670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.564830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-04-23 05:14:58.564857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-04-23 05:14:58.565019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.565158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.565184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.565312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.565472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.565499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.565653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.565786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.565816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.565930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.566045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.566072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.566213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.566357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.566383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.566497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.566667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.566695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.566837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.566975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.567002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.567118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.567249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.567275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.567399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.567567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.567594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.567730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.567886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.567912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.568070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.568172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.568198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.568359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.568495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.568527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.568672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.568802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.568828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.568990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.569261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.569558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.569838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.569997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.570110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.570246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.570273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.570414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.570533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.570571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.570709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.570868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.570894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.571055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.571165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.571193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.571306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.571414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.571441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.571618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.571778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.571805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-04-23 05:14:58.571941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-04-23 05:14:58.572047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.572073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.572219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.572353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.572379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.572537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.572685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.572711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.572847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.572989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.573015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.573153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.573302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.573329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.573495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.573641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.573667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.573803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.573971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.573997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.574159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.574287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.574313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.574418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.574582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.574609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.574723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.574868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.574894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.575069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.575196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.575222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.575355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.575488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.575521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.575686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.575828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.575854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.575991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.576142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.576169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.576309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.576474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.576500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.576658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.576766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.576792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.576932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.577093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.577120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.577250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.577382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.577408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.577543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.577688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.577713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.577876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.578010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.578036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.578171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.578334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-04-23 05:14:58.578359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-04-23 05:14:58.578497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.578620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.578646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.578816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.578951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.578978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.579088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.579201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.579228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.579363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.579529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.579565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.579697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.579863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.579889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.580008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.580148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.580174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.580283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.580422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.580448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.580618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.580776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.580802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.580938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.581088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.581113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.581245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.581406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.581432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.581545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.581681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.581707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.581828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.581995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.582022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.582136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.582247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.582273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.582378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.582505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.582537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.582655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.582793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.582818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.582935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.583179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.583497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.583814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.583971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.584109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.584246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.584273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.584384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.584523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.584550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.584660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.584801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.584827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.584966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.585276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.585550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.585818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.585985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.586090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.586222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.586248] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.586384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.586523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.586551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.586716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.586846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-04-23 05:14:58.586872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-04-23 05:14:58.587035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.587165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.587191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.587317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.587457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.587483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.587608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.587750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.587787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.587897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.588138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.588437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.588724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.588893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.589006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.589144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.589170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.589309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.589449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.589477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.589631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.589767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.589794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.589936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.590205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.590537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.590814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.590967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.591076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.591244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.591270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.591404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.591535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.591570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.591707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.591832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.591857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.591963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.592097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.592123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.592285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.592411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.592437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.592564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.592699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.592725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.595660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.595798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.595827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.595936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.596261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.596548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.596808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.596998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.597133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.597272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.597299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.597412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.597561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.597588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.597702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.597844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.597870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-04-23 05:14:58.598005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.598172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-04-23 05:14:58.598199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.598333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.598444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.598472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.598650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.598796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.598822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.598985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.599098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.599137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.599252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.599363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.599394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.599567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.599728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.599754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.599865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.599981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.600007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.600146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.600262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.600289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.600427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.600573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.600600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.600707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.600826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.600852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.601011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.601149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.601177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.601288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.601397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.601424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.601589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.601721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.601747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.601885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.602180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.602509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.602800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.602937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.603074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.603237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.603262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.603379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.603542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.603573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.603709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.603831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.603867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.604006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.604147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.604175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.604315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.604435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.604462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.604641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.604752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.604778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.604893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.605157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.605471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.605796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.605958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.606125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.606234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.606261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.606395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.606556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.606586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-04-23 05:14:58.606689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.606850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-04-23 05:14:58.606877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.607015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.607145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.607172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.607290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.607417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.607444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.607564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.607727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.607753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.607905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.608204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.608488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.608807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.608943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.609106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.609214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.609241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.609346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.609506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.609538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.609690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.609797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.609824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.609960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.610096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.610122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.610236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.610342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.610369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.610498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.610676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.610703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.610839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.610998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.611025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.611155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.611264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.611292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.611470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.611582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.611610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.611747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.611856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.611883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.611997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.612266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.612568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.612851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.612995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.613115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.613243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.613270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.613405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.613508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.613542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.613684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.613831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.613857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.613994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.614156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.614183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.614291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.614439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.614466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.614604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.614769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.614808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.614932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.615036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.615067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-04-23 05:14:58.615204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.615343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-04-23 05:14:58.615370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.615508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.615683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.615710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.615820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.615966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.615992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.616121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.616259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.616286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.616392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.616500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.616553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.616694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.616802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.616841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.616978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.617117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.617146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.617287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.617399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.617426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.617572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.617738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.617765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.617936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.618077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.618103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.618238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.618397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.618423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.618600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.618737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.618763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.618868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.619136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.619437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.619716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.619840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.619973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.620127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.620153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.620298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.620458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.620484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.620605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.620714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.620740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.620843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.620978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.621004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.621132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.621248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.621275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.621415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.621567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.621594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.621753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.621887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.621913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.622046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.622180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.622206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.622341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.622457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.622485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-04-23 05:14:58.622609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-04-23 05:14:58.622745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-04-23 05:14:58.622769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-04-23 05:14:58.622874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-04-23 05:14:58.623011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-04-23 05:14:58.623036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-04-23 05:14:58.623180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.623281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.623307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.623469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.623569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.623594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.623733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.623843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.623867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.624045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.624175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.624199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.624303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.624459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.624482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.624632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.624768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.624794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.624931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.625210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.625446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.625724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.625884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.626068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.626224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.626252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.626373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.626482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.626506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.626660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.626799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.626824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.626933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.627201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.627449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.801 [2024-04-23 05:14:58.627781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.801 [2024-04-23 05:14:58.627927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.801 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.628063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.628230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.628257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.628362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.628495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.628531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.628679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.628810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.628837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.628982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.629144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.629171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.629287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.629428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.629456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.629564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.629707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.629733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.629854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.629992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.630018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.630158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.630295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.630321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.630447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.630583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.630610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.630776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.630885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.630912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.631022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.631154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.631180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.631325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.631489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.631520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.631646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.631806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.631832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.631952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.632090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.632117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.632254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.632389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.632415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.632564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.632699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.632726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.632894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.633170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.633470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.633788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.633928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.634089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.634225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.634251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.634415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.634556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.634583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.634720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.634839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.634866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.635006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.635288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.635571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.635848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.635985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.636117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.636249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.636276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.802 qpair failed and we were unable to recover it. 00:30:19.802 [2024-04-23 05:14:58.636383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.802 [2024-04-23 05:14:58.636527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.636566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.636705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.636823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.636849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.636965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.637247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.637508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.637792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.637984] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.638141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.638275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.638301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.638439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.638572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.638599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.638700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.638812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.638838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.638943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.639238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.639564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.639834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.639963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.640094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.640201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.640227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.640364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.640496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.640527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.640673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.640802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.640829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.640941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.641268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.641504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.641827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.641989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.642128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.642267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.642293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.642421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.642534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.642573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.642709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.642826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.642854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.642968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.643078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.643104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.803 qpair failed and we were unable to recover it. 00:30:19.803 [2024-04-23 05:14:58.643240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.803 [2024-04-23 05:14:58.643377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.643404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.643539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.643673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.643704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.643848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.643978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.644005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.644139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.644251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.644278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.644441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.644560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.644587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.644724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.644856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.644882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.645020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.645287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.645560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.645859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.645994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.646103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.646264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.646291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.646404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.646573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.646604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.646738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.646875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.646902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.647050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.647162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.647188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.647352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.647492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.647530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.647637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.647773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.647800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.647937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.648240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.648578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.648826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.648958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.649068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.649199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.649225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.649337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.649439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.649469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.649574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.649736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.649762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.649913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.650186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.650512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.650799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.650962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.651128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.651298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.651324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.651459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.651622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.804 [2024-04-23 05:14:58.651650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.804 qpair failed and we were unable to recover it. 00:30:19.804 [2024-04-23 05:14:58.651771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.651907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.651938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.652081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.652194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.652220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.652360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.652472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.652502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.652664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.652769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.652795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.652925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.653195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.653525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.653827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.653978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.654086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.654224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.654250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.654361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.654525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.654552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.654669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.654809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.654835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.654955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.655220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.655492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.655804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.655970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.656088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.656225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.656252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.656392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.656495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.656547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.656656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.656762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.656789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.656922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.657157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.657479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.657756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.657930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.658063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.658200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.658227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.658364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.658468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.658496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.658644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.658780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.658806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.658919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.659197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.659476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.659811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.805 [2024-04-23 05:14:58.659953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.805 qpair failed and we were unable to recover it. 00:30:19.805 [2024-04-23 05:14:58.660117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.660231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.660258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.660359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.660484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.660511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.660635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.660776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.660803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.660911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.661168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.661474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.661748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.661882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.661999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.662129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.662155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.662307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.662443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.662469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.662611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.662719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.662746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.662886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.663196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.663528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.663772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.663933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.664046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.664185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.664212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.664325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.664458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.664484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.664629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.664763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.664790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.664895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.665061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.665087] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.665227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.665390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.665416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.665526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.665665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.665692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.665854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.665993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.666019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.666170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.666326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.666352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.666455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.666572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.666599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.666735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.666867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.666893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.806 qpair failed and we were unable to recover it. 00:30:19.806 [2024-04-23 05:14:58.667052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.806 [2024-04-23 05:14:58.667179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.667205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.667341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.667458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.667484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.667611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.667776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.667802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.667913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.668086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.668113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.668250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.668416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.668443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.668574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.668712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.668738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.668889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.669237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.669545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.669791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.669985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.670116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.670250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.670278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.670442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.670557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.670585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.670728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.670867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.670894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.671033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.671206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.671233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.671373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.671508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.671540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.671691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.671831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.671857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.672019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.672131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.672158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.672273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.672381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.672407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.672544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.672709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.672736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.672873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.673166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.673452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.673720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.673845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.673985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.674126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.674152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.674285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.674447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.674474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.674648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.674757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.674784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.674923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.675031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.675058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.675156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.675281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.675307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.675416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.675564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.807 [2024-04-23 05:14:58.675594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.807 qpair failed and we were unable to recover it. 00:30:19.807 [2024-04-23 05:14:58.675711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.675850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.675876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.675975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.676256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.676558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.676837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.676975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.677084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.677215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.677241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.677343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.677475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.677501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.677647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.677776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.677802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.677918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.678236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.678505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.678785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.678918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.679034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.679154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.679180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.679342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.679484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.679511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.679637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.679773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.679799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.679936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.680070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.680096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.680229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.680389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.680416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.680546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.680689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.680715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.680885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.681180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.681415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.681683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.681847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.681959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.682099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.682126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.682290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.682424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.682451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.682588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.682723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.682749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.682881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.683168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.683457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.808 qpair failed and we were unable to recover it. 00:30:19.808 [2024-04-23 05:14:58.683695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.808 [2024-04-23 05:14:58.683884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.684047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.684156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.684183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.684328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.684429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.684455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.684629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.684747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.684773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.684913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.685176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.685451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.685730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.685901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.686017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.686300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.686561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.686859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.686992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.687135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.687295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.687326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.687468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.687591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.687619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.687764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.687902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.687928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.688045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.688174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.688200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.688342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.688486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.688513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.688656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.688794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.688821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.688937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.689206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.689476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.689775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.689973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.690132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.690270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.690296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.690401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.690530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.690567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.690680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.690796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.690823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.690960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.691212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.691537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.691818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.809 [2024-04-23 05:14:58.691979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.809 qpair failed and we were unable to recover it. 00:30:19.809 [2024-04-23 05:14:58.692086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.692199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.692226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.692364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.692526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.692562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.692675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.692812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.692839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.692948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.693203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.693457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.693727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.693899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.694033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.694139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.694165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.694303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.694441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.694468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.694639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.694751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.694784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.694909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.695183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.695452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.695753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.695927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.696088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.696224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.696250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.696391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.696531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.696572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.696685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.696855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.696881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.697019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.697153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.697179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.697286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.697420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.697446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.697567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.697705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.697731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.697851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.697991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.698017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.698124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.698272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.698298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.698431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.698541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.698579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.698719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.698838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.698864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.810 [2024-04-23 05:14:58.698976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.699081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.810 [2024-04-23 05:14:58.699108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.810 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.699207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.699338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.699364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.699546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.699675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.699701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.699809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.699956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.699982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.700119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.700231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.700256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.700366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.700530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.700567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.700677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.700824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.700851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.700991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.701288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.701581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.701869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.701997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.702096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.702198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.702224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.702367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.702478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.702504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.702620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.702757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.702788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.702925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.703227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.703503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.703764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.703933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.704040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.704205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.704232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.704403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.704543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.704571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.704680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.704825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.704851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.704981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.705118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.705145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.705281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.705415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.705442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.705549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.705697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.705724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.705869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.706180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.706445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.706694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.706835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.811 [2024-04-23 05:14:58.706970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.707135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.811 [2024-04-23 05:14:58.707161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.811 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.707270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.707431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.707457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.707599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.707713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.707740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.707875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.708191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.708467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.708775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.708938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.709042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.709143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.709169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.709288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.709420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.709449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.709555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.709658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.709686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.709851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.710185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.710499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.710787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.710916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.711077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.711190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.711220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.711321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.711453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.711479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.711598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.711705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.711732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.711844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.711981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.712007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.712139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.712301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.712327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.712436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.712541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.712568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.712702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.712835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.712861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.712998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.713266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.713558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.713802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.713939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.714077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.714204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.714230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.714361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.714524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.714550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.714665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.714807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.714833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.812 qpair failed and we were unable to recover it. 00:30:19.812 [2024-04-23 05:14:58.714969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.715081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.812 [2024-04-23 05:14:58.715107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.715227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.715388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.715414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.715544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.715652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.715678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.715820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.715932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.715960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.716071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.716210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.716236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.716350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.716462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.716489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.716604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.716743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.716770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.716909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.717179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.717467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.717736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.717923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.718024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.718195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.718221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.718356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.718468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.718494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.718614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.718753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.718779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.718889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.719026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.719052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.719199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.719383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.719409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.719543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.719682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.719708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.719829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.719993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.720020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.720157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.720271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.720295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.720426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.720565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.720593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.720735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.720870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.720896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.721024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.721317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.721588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.721865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.721995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.722136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.722278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.722304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.722444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.722573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.722599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.813 [2024-04-23 05:14:58.722735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.722851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.813 [2024-04-23 05:14:58.722878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.813 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.723016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.723181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.723207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.723357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.723512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.723552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.723656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.723768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.723794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.723934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.724216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.724508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.724759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.724928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.725065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.725201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.725227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.725363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.725502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.725534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.725639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.725766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.725796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.725908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.726181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.726448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.726682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.726852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.726965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.727271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.727533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.727835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.727999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.728110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.728242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.728268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.728414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.728549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.728577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.728687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.728819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.728845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.728980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.729245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.729526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.729791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.729979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.730112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.730219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.730246] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.730359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.730467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.730493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.814 [2024-04-23 05:14:58.730645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.730757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.814 [2024-04-23 05:14:58.730783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.814 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.730915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.731192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.731448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.731725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.731865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.732031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.732138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.732164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.732302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.732464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.732491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.732611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.732722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.732749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.732862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.733192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.733473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.733731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.733852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.733980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.734141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.734167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.734285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.734420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.734448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.734579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.734740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.734766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.734880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.735150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.735433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.735710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.735846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.735979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.736146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.736172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.736307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.736413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.736439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.736558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.736663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.736690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.736853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.736986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.737012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.737144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.737278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.737304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.737445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.737588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.815 [2024-04-23 05:14:58.737615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.815 qpair failed and we were unable to recover it. 00:30:19.815 [2024-04-23 05:14:58.737749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.737881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.737907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.738038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.738139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.738166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.738270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.738417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.738443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.738579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.738716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.738742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.738872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.738973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.739000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.739131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.739266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.739292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.739395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.739507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.739540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.739671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.739840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.739866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.739999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.740303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.740548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.740781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.740942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.741080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.741245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.741271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.741382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.741494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.741526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.741641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.741772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.741798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.741941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.742075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.742101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.742242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.742351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.742377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.742536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.742677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.742703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.742865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.743177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.743537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.743801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.743976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.744079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.744201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.744227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.744361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.744472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.744499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.744615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.744748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.744775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.744914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.745076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.745103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.745206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.745343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.745369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.745544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.745687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.816 [2024-04-23 05:14:58.745713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.816 qpair failed and we were unable to recover it. 00:30:19.816 [2024-04-23 05:14:58.745816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.745954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.745980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.746126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.746233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.746260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.746403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.746548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.746575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.746711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.746822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.746848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.746972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.747083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.747109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.747273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.747434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.747460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.747577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.747720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.747746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.747878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.748185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.748511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.748798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.748939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.749052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.749181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.749208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.749342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.749473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.749499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.749643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.749778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.749804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.749939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.750180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.750480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.750745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.750909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.751035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.751199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.751225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.751358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.751491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.751535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.751679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.751795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.751822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.751934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.752210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.752481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.752738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.752876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.753040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.753176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.753202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.753339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.753454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.753482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.753633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.753771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-04-23 05:14:58.753797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-04-23 05:14:58.753934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.754233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.754489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.754734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.754894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.755062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.755226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.755252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.755358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.755496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.755541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.755681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.755846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.755873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.756007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.756276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.756543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.756836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.756975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.757110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.757218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.757245] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.757351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.757510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.757543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.757681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.757842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.757875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.758014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.758138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.758164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.758325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.758459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.758486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.758635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.758777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.758803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.758916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.759218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.759558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.759827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.759995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.760161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.760299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.760325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.760436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.760543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.760571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.760697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.760840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.760867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.761000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.761263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.761541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.761812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.761977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-04-23 05:14:58.762140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-04-23 05:14:58.762277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.762302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.762417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.762525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.762551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.762669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.762779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.762805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.762916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.763179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.763449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.763754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.763920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.764060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.764169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.764196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.764334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.764466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.764492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.764661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.764785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.764811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.764949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.765216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.765488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.765809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.765970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.766086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.766219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.766247] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.766359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.766474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.766500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.766628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.766767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.766793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.766955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.767240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.767512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.767792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.767929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.768042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.768178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.768205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.768306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.768447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.768473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.768615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.768782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.768807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.768921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.769216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.769509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.769788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.769952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-04-23 05:14:58.770054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-04-23 05:14:58.770189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.770216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.770347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.770512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.770544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.770681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.770816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.770842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.770955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.771213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.771509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.771802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.771966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.772105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.772239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.772265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.772426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.772593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.772625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.772729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.772859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.772886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.773024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.773187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.773212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.773345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.773457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.773484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.773645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.773780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.773807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.773923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.774245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.774519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.774781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.774950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.775086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.775252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.775278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.775379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.775504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.775552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.775716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.775879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.775904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.776023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.776167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.776193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.776303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.776434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.776460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.776593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.776724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.776750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.776880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.777007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.777033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.777165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.777266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-04-23 05:14:58.777292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-04-23 05:14:58.777402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.777571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.777599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.777742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.777910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.777936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.778101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.778214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.778240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.778381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.778513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.778545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.778714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.778876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.778902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.779008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.779119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.779145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.779273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.779405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.779432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.779568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.779698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.779724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.779874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.779976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.780002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.780136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.780243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.780269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.780436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.780592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.780619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.780756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.780916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.780942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.781104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.781239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.781266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.781364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.781478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.781505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.781633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.781765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.781791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.781951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.782084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.782110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.782246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.782354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.782382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.782551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.782686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.782713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.782874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.783168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.783432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.783719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.783882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.783989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.784098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.784126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.784262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.784431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.784457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.784593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.784735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.784762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.784899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.785039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.785065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.785202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.785340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.785366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.785481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.785619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.785646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-04-23 05:14:58.785782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-04-23 05:14:58.785923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.785949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.786110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.786237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.786263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.786426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.786529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.786556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.786724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.786828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.786854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.786986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.787121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.787147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.787285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.787415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.787441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.787591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.787728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.787759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.787897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.788225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.788484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.788817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.788979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.789117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.789229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.789255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.789421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.789528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.789555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.789698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.789840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.789865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.789971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.790105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.790131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.790264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.790376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.790402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.790544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.790680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.790710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.790840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.790976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.791003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.791108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.791270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.791296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.791431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.791600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.791627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.791761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.791916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.791943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.792080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.792242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.792268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.792402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.792533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.792560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.792730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.792837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.792863] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.792978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.793097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.793124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.793262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.793362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.793389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-04-23 05:14:58.793527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.793669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-04-23 05:14:58.793695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.793808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.793919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.793946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.794108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.794267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.794293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.794431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.794594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.794621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.794753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.794913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.794939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.795052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.795155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.795192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.795308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.795467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.795494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.795626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.795758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.795785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.795951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.796266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.796530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.796779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.796907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.797048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.797186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.797212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.797340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.797496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.797529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.797644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.797752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.797778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.797941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.798071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.798097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.798203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.798364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.798390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.798556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.798719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.798746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.798910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.799231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.799525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.799766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.799931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.800068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.800187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.800214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.800315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.800478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.800505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.800644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.800784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.800810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.800949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.801222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.801545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-04-23 05:14:58.801818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-04-23 05:14:58.801978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.802118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.802252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.802278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.802414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.802576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.802603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.802718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.802870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.802897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.803007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.803138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.803164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.803300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.803463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.803489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.803606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.803722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.803748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.803851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.803980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.804006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.804179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.804325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.804351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.804454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.804589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.804616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.804733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.804883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.804909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.805045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.805178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.805204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.805376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.805476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.805502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.805623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.805755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.805785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.805888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.806201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.806479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.806756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.806910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.807052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.807214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.807240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.807372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.807509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.807558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.807696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.807860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.807887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.807999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.808110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.808137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.808242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.808380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.808406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.808546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.808712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.808738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.808878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.809018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.809045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-04-23 05:14:58.809179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-04-23 05:14:58.809345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.809371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.809522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.809628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.809655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.809787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.809894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.809920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.810050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.810164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.810190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.810322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.810491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.810522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.810628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.810739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.810766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.810907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.811203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.811468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.811777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.811910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.812035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.812140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.812167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.812327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.812430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.812458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.812593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.812701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.812728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.812858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.813003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.813029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.813195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.813353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.813379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.813543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.813682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.813708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.813842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.814140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.814387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.814677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.814838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.814972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.815112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.815138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.815299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.815437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.815463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.815581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.815742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.815768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.815904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.816173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.816440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.816741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.816884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.817021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.817155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.817182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.817320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.817458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.817486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-04-23 05:14:58.817632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-04-23 05:14:58.817753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.817780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.817882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.818182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.818466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.818765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.818913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.819019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.819278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.819545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.819810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.819941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.820080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.820217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.820243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.820383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.820537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.820568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.820732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.820842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.820867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.821006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.821112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.821138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.821279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.821410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.821436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.821608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.821717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.821744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.821877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.822174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.822443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.822716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.822855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.822992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.823130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.823156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.823290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.823450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.823476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.823598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.823735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.823763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.823905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.824229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.824563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.824852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.824990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.825128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.825258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.825284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.825392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.825495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.825536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.825640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.825781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.825807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-04-23 05:14:58.825916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-04-23 05:14:58.826034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.826060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.826197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.826331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.826357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.826495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.826641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.826668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.826829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.826968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.826993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.827130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.827265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.827291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.827404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.827505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.827539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.827646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.827783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.827809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.827910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.828200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.828501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.828804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.828970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.829084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.829216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.829242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.829399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.829584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.829616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.829782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.829891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.829916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.830034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.830299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.830573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.830837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.830997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.831110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.831217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.831243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.831341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.831439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.831465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.831574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.831708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.831734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.831835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.831997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.832023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.832131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.832242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.832269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.832409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.832542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.832568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.832735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.832848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.832876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.833008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.833116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.833142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.833250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.833400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-04-23 05:14:58.833426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-04-23 05:14:58.833587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.833808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.833834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.833998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.834241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.834530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.834775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.834911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.835045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.835174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.835201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.835365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.835471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.835498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.835618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.835736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.835764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.835938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.836236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.836535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.836845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.836979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.837143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.837253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.837280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.837414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.837550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.837577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.837693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.837829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.837856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.838022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.838166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.838193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.838325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.838458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.838484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.838601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.838715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.838741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.838850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.838987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.839013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.839117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.839248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.839274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.839377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.839504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.839535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.839648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.839785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.839811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.839944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.840188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.840475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.840808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.840958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-04-23 05:14:58.841072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-04-23 05:14:58.841211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.841237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.841350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.841461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.841487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.841632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.841743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.841769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.841899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.842175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.842442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.842726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.842882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.843000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.843132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.843158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.843295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.843422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.843448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.843560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.843670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.843696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.843811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.843978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.844005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.844138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.844273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.844299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.844460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.844566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.844593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.844740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.844904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.844930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.845035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.845167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.845193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.845303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.845461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.845487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.845631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.845746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.845772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-04-23 05:14:58.845906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-04-23 05:14:58.846044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.846071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.846209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.846335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.846363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.846501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.846622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.846649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.846785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.846921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.846947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.847118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.847259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.847285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.847419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.847555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.847582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.847750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.847911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.847937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.848040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.848198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.848225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.848379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.848506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.848544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.848661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.848822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.848848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.848955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.849200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.849492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.849806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.849962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.850071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.850174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.850201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.850305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.850414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.850440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.850556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.850689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.850715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.850879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.851025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.851051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-04-23 05:14:58.851188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-04-23 05:14:58.851322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.851348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.851487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.851627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.851653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.851790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.851912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.851938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.852076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.852208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.852234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.852362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.852493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.852526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.852674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.852782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.852808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.852969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.853266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.853525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.853803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.853964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.854075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.854203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.854229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.854358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.854486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.854512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.854655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.854763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.854789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.854932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.855195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.855470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.855805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.855975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.856138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.856245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.856271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.856434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.856572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.856599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.856736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.856842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.856869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.857033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.857176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.857203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.857361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.857500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.857548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.857683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.857798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.857825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.857989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.858094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.858120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.858276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.858404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.858430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.858561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.858689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-04-23 05:14:58.858715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-04-23 05:14:58.858841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.858981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.859007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.859142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.859242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.859268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.859405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.859542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.859568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.859705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.859840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.859866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.859969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.860264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.860559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.860835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.860991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.861128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.861265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.861291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.861411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.861574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.861601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.861741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.861848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.861874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.862014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.862280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.862579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.862825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.862952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.863116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.863258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.863284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.863385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.863523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.863550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.863661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.863795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.863821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.863959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.864072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.864098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.864241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.864346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.864372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.864538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.864680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.864706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.864844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.865159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.865473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.865774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.865936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.866074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.866178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.866204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.866341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.866444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.866472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.866608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.866740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.866766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.866904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.867014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.867042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-04-23 05:14:58.867146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-04-23 05:14:58.867274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.867300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.867438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.867581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.867608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.867722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.867827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.867853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.867993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.868131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.868157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.868287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.868427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.868455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.868599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.868737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.868764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.868898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.869212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.869522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.869822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.869979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.870090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.870229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.870255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.870388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.870506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.870541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.870656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.870760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.870787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.870918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.871238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.871537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.871816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.871979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.872118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.872249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.872275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.872434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.872574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.872601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.872747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.872908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.872935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.873046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.873176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.873204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.873355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.873494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.873546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.873690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.873800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.873826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.873929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.874217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.874466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.874769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.874905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.875005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.875134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.875160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-04-23 05:14:58.875319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.875475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-04-23 05:14:58.875501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.875669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.875804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.875831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.875999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.876244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.876532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.876828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.876988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.877098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.877227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.877253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.877392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.877500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.877547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.877692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.877831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.877858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.877987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.878230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.878494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.878801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.878967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.879139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.879259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.879285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.879452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.879588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.879615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.879725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.879832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.879858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.879989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.880128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.880154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.880288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.880422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.880448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.880567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.880677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.880704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.880869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.881168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.881444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.881730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.881870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.882015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.882152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.882178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.882284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.882422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.882449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.882618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.882755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.882782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.882894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.883025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.883051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-04-23 05:14:58.883180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.883327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-04-23 05:14:58.883365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.883509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.883658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.883684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.883797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.883935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.883961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.884068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.884205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.884231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.884367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.884535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.884562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.884668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.884795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.884821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.884956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.885093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.885119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.885232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.885370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.885397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.885510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.885678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.885704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.885867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.886163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.886400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.886706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.886867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.886983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.887154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.887180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.887292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.887427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.887454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.887595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.887735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.887761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.887924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.888188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.888491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.888799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.888964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.889081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.889190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.889216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.889378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.889513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.889554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.889695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.889810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.889837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.889947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.890108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.890134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.890240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.890381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.890407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.890541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.890703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.890729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.890848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.891010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.891037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-04-23 05:14:58.891173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.891287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-04-23 05:14:58.891315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.891450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.891619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.891646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.891788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.891894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.891920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.892026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.892298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.892560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.892828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.892986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.893127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.893238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.893264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.893412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.893541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.893568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.893727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.893886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.893913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.894025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.894128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.894154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.894300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.894408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.894435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.894598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.894735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.894761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.894922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.895222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.895524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.895814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.895963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.896102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.896209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.896235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.896346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.896486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.896512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.896656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.896820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.896847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.896954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.897228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.897533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.897811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.897945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.898083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.898249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.898275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.898388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.898525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.898552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.898667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.898780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.898806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.898923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.899068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.899095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.899231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.899365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.899391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-04-23 05:14:58.899529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.899673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-04-23 05:14:58.899699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.899860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.899996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.900023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.900159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.900328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.900354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.900471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.900617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.900644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.900781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.900899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.900924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.901082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.901216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.901241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.901403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.901567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.901593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.901699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.901830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.901857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.901992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.902139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.902165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.902296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.902431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.902457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.902566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.902702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.902729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.902861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.902991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.903016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.903135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.903295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.903325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.903438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.903579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.903606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.903714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.903844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.903870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.904003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.904136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.904162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.904292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.904410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.904436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.904566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.904706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.904732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.904902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.905231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905367] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.905468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.905757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.905912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.906049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.906160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.906186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.906299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.906414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.906441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.906548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.906720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.906747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.906883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.906994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.907020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.907183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.907326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.907352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.907464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.907575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.907601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.907735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.907907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.907933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-04-23 05:14:58.908044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.908184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-04-23 05:14:58.908209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.908343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.908474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.908499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.908645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.908758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.908783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.908917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.909227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.909521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.909818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.909985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.910143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.910292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.910318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.910479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.910593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.910619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.910747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.910879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.910904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.911036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.911342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.911602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.911846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.911966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.912105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.912217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.912243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.912374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.912475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.912501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.912652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.912790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.912816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.912979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.913140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.913166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.913275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.913410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.913436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.913563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.913700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.913728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.913859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.914194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.914474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.914746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.914934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.915046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.915196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.915223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.915388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.915526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.915553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-04-23 05:14:58.915730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-04-23 05:14:58.915870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.915896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.916031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.916145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.916171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.916310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.916417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.916443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.916574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.916679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.916706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.916835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.916975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.917001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.917112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.917247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.917273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.917436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.917549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.917576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.917715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.917844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.917870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.917987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.918124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.918154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.918282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.918425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.918451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.918577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.918710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.918735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.918876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.918978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.919004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.919116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.919251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.919276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.919379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.919486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.919512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.919635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.919748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.919775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.919935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.920234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.920518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.920814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.920972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.921084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.921192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.921218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.921322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.921419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.921444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.921584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.921689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.921715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.921850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.921987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.922012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.922119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.922250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.922275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.922405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.922546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.922573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-04-23 05:14:58.922707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.922834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-04-23 05:14:58.922859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.922969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.923107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.923133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.923279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.923392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.923418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.923567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.923694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.923720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.923834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.923984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.924010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.924126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.924259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.924285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.924415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.924566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.924593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.924700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.924848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.924874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.925036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.925167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.925194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.925330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.925472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.925498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.925643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.925807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.925834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.925968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.926226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.926506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.926812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.926972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.927085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.927217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.927243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.927358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.927489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.927522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.927637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.927774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.927800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.927900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.928226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.928487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.928791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.928947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.929082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.929217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.929243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.929409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.929537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.929564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.929681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.929858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.929884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.929992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.930267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.930548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.930843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.930974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-04-23 05:14:58.931085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.931230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-04-23 05:14:58.931256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.931393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.931494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.931524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.931624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.931784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.931809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.931944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.932192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.932490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.932797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.932929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.933045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.933293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.933558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.933855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.933988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.934120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.934253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.934279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.934384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.934512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.934544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.934685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.934823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.934849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.934984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.935147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.935173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.935311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.935418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.935447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.935582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.935680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.935706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.935839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.935976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.936003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.936144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.936287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.936313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.936446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.936582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.936610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.936718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.936825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.936851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.936957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.937196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.937468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.937766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.937960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.938097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.938225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.938251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.938367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.938497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.938528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.938645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.938780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.938806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.938922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.939066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.939092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.939228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.939363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-04-23 05:14:58.939389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-04-23 05:14:58.939552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.939694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.939726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.939876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.940139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.940379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.940623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.940788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.940921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.941198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.941491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.941788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.941968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.942108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.942270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.942296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.942445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.942602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.942631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.942744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.942923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.942950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.943060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.943168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.943197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.943340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.943503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.943536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.943689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.943816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.943851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.943991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.944128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.944155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-04-23 05:14:58.944295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.944411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-04-23 05:14:58.944437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:20.121 [2024-04-23 05:14:58.944560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.944663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.944689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.121 qpair failed and we were unable to recover it. 00:30:20.121 [2024-04-23 05:14:58.944855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.944976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.945002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.121 qpair failed and we were unable to recover it. 00:30:20.121 [2024-04-23 05:14:58.945107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.945244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.945270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.121 qpair failed and we were unable to recover it. 00:30:20.121 [2024-04-23 05:14:58.945391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.945512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.945544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.121 qpair failed and we were unable to recover it. 00:30:20.121 [2024-04-23 05:14:58.945655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.945807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.945833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.121 qpair failed and we were unable to recover it. 00:30:20.121 [2024-04-23 05:14:58.945962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.946097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.121 [2024-04-23 05:14:58.946124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.121 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.946285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.946420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.946446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.946565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.946679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.946711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.946866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.946998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.947025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.947184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.947295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.947322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.947461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.947574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.947601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.947713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.947866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.947901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.948039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.948173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.948201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.948335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.948473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.948499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.948650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.948756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.948786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.948956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.949253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.949537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.949818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.949957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.950059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.950227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.950258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.950400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.950534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.950572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.950681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.950829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.950857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.950990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.951261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.951599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.951858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.122 [2024-04-23 05:14:58.951984] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.122 qpair failed and we were unable to recover it. 00:30:20.122 [2024-04-23 05:14:58.952097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.952261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.952295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.952432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.952574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.952601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.952766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.952912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.952939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.953063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.953206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.953232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.953377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.953511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.953543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.953657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.953811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.953839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.953948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.954209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.954513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.954782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.954914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.955051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.955181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.955209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.955315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.955455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.955481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.955622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.955787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.955818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.955929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.956268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.956568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.956851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.956974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.957109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.957241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.957267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.957373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.957481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.957506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.957627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.957771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.957796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.123 qpair failed and we were unable to recover it. 00:30:20.123 [2024-04-23 05:14:58.957905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.123 [2024-04-23 05:14:58.958018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.958045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.958207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.958345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.958370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.958509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.958650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.958677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.958819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.958954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.958980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.959121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.959287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.959313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.959429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.959549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.959577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.959686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.959818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.959844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.960000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.960136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.960162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.960260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.960421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.960447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.960611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.960728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.960755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.960886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.960984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.961011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.961114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.961243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.961269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.961406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.961540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.961567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.961704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.961854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.961880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.962042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.962185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.962211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.962319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.962452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.962478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.962646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.962778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.962804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.962933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.963199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.963474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.124 qpair failed and we were unable to recover it. 00:30:20.124 [2024-04-23 05:14:58.963795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.124 [2024-04-23 05:14:58.963955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.964090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.964232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.964258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.964395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.964542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.964569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.964688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.964797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.964824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.964951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.965086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.965121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.965244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.965379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.965405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.965535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.965641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.965667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.965832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.965981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.966007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.966107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.966269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.966295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.966401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.966534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.966560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.966674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.966811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.966838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.966978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.967118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.967145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.967307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.967436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.967462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.967603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.967746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.967773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.967939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.968245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.968491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.968789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.968952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.969057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.969191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.969217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.969360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.969507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.969539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.125 [2024-04-23 05:14:58.969673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.969775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.125 [2024-04-23 05:14:58.969801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.125 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.969933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.970208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.970528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.970834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.970987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.971129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.971261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.971287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.971403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.971545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.971583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.971705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.971818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.971845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.971980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.972142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.972168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.972305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.972469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.972495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.972652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.972820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.972846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.972954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.973257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.973525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.973834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.973973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.974077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.974208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.974234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.974339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.974506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.974538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.974684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.974790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.974815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.974974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.975108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.975134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.975293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.975404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.975430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.975547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.975693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.126 [2024-04-23 05:14:58.975719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.126 qpair failed and we were unable to recover it. 00:30:20.126 [2024-04-23 05:14:58.975842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.975973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.975999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.976126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.976234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.976259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.976363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.976493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.976524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.976676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.976816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.976842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.976952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.977067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.977095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.977259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.977373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.977399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.977543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.977687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.977713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.977852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.977986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.978012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.978144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.978250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.978275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.978384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.978524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.978561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.978696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.978839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.978865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.979028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.979129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.979155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.979287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.979423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.979449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.979583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.979720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.979746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.979883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.979994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.980023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.980133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.980246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.980273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.980413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.980573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.980600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.980707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.980843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.980869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.980976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.981089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.981114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.981222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.981349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.127 [2024-04-23 05:14:58.981375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.127 qpair failed and we were unable to recover it. 00:30:20.127 [2024-04-23 05:14:58.981479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.981598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.981624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.981759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.981863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.981889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.982003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.982149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.982175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.982309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.982444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.982470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.982632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.982769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.982798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.982937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.983214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.983512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.983794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.983928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.984061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.984173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.984199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.984358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.984525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.984552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.984663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.984822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.984848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.984964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.985094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.985120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.985257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.985417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.985443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.128 [2024-04-23 05:14:58.985572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.985713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.128 [2024-04-23 05:14:58.985740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.128 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.985849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.985988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.986014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.986154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.986256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.986281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.986394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.986569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.986597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.986738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.986845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.986870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.987029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.987189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.987215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.987348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.987493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.987524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.987662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.987775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.987803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.987904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.988034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.988060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.988219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.988353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.988379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.988543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.988686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.988712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.988851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.988983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.989009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.989131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.989295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.989321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.989457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.989596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.989623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.989738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.989876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.989902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.990014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.990276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.990576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.990836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.990966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.991075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.991239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.991265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.129 [2024-04-23 05:14:58.991366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.991475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.129 [2024-04-23 05:14:58.991502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.129 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.991619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.991761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.991787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.991924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.992216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.992536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.992811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.992957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.993066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.993203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.993229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.993365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.993465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.993491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.993625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.993735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.993760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.993891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.994026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.994052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.994192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.994352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.994378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.994538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.994653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.994680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.994816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.994982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.995007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.995140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.995278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.995304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.995445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.995578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.995605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.995770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.995911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.995936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.996071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.996172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.996198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.996308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.996471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.996497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.996659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.996774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.996800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.996902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.997036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.997061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.997189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.997320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.130 [2024-04-23 05:14:58.997345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.130 qpair failed and we were unable to recover it. 00:30:20.130 [2024-04-23 05:14:58.997468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.997627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.997658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.997762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.997898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.997925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.998042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.998172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.998198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.998355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.998491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.998524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.998631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.998747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.998774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.998908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.999173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.999468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:58.999766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:58.999928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.000040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.000151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.000177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.000311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.000412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.000438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.000560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.000660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.000686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.000818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.000984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.001009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.001146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.001275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.001301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.001462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.001571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.001608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.001738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.001866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.001892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.002030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.002162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.002188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.002332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.002439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.002464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.002594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.002702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.002728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.002864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.002999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.003026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.131 qpair failed and we were unable to recover it. 00:30:20.131 [2024-04-23 05:14:59.003162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.003293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.131 [2024-04-23 05:14:59.003319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.003429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.003566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.003594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.003708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.003879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.003905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.004020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.004152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.004178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.004316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.004480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.004505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.004635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.004795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.004820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.004959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.005093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.005119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.005255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.005386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.005412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.005573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.005734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.005760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.005896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.006135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.006410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.006704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.006866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.006997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.007251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.007499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.007806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.007970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.008111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.008272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.008298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.008412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.008574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.008601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.008765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.008901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.008928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.132 [2024-04-23 05:14:59.009066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.009230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.132 [2024-04-23 05:14:59.009258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.132 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.009424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.009529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.009556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.009701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.009861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.009887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.009986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.010303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.010571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.010835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.010973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.011138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.011265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.011296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.011456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.011594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.011621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.011761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.011876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.011902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.012034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.012192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.012218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.012320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.012449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.012479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.012599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.012761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.012793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.012904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.013052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.013079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.013182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.013343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.013369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.013509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.013654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.013680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.013852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.013989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.014015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.014144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.014275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.014301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.014437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.014573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.014600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.014711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.014857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.014884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.133 qpair failed and we were unable to recover it. 00:30:20.133 [2024-04-23 05:14:59.015010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.133 [2024-04-23 05:14:59.015171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.015197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.015341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.015474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.015500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.015621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.015760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.015789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.015925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.016093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.016119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.016254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.016413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.016439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.016578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.016710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.016736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.016888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.017183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.017488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.017746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.017920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.018059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.018223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.018249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.018361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.018469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.018495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.018684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.018805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.018831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.018963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.019096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.019123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.019234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.019335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.019363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.019477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.019650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.019678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.019809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.019989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.020016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.020121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.020230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.020257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.020368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.020500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.020533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.020661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.020811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.020836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.020999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.021141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.021167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.021301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.021428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.021455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.134 qpair failed and we were unable to recover it. 00:30:20.134 [2024-04-23 05:14:59.021586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.134 [2024-04-23 05:14:59.021693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.021719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.021848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.022185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.022428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.022738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.022874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.023021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.023150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.023176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.023282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.023418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.023445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.023618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.023728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.023754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.023890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.024169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.024485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.024786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.024957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.025068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.025242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.025268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.025396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.025532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.025559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.025701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.025820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.025846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.025957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.026097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.026123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.026261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.026400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.026426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.026604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.026718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.026744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.026911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.027045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.027072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.027239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.027342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.027369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.027505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.027682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.027712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.027852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.027988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.028014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.028155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.028280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.028306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.028435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.028567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.028594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.028733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.028878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.028905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.029063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.029175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.029202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.029365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.029501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.029535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.029698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.029844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.029870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.030003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.030149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.030175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.135 qpair failed and we were unable to recover it. 00:30:20.135 [2024-04-23 05:14:59.030306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.135 [2024-04-23 05:14:59.030476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.030502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.030628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.030790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.030817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.030926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.031226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.031560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.031830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.031983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.032144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.032279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.032306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.032411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.032580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.032608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.032716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.032833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.032860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.032974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.033131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.033158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.033290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.033428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.033454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.033565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.033697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.033722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.033869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.034162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.034523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.034836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.034998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.035159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.035319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.035345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.035477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.035618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.035645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.035759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.035929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.035956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.036093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.036200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.036227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.036362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.036472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.036500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.036659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.036768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.036799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.036933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.037201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.037469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.037736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.037877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.038010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.038170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.038196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.038355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.038485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.038511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.038630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.038790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.038816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.136 qpair failed and we were unable to recover it. 00:30:20.136 [2024-04-23 05:14:59.038948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.039092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.136 [2024-04-23 05:14:59.039119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.039231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.039394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.039420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.039565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.039680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.039706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.039850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.039959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.039985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.040097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.040199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.040236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.040379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.040489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.040528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.040665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.040802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.040830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.040997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.041131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.041157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.041264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.041422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.041448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.041563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.041725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.041751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.041851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.041984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.042010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.042149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.042254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.042280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.042413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.042573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.042600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.042738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.042870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.042900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.043059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.043291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.043559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.043823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.043967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.044105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.044240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.044267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.044399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.044507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.044538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.044712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.044872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.044898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.045021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.045154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.045180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.045344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.045449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.045475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.045629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.045738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.045768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.045897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.046152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.046443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.046766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.046941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.047105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.047218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.047244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.137 [2024-04-23 05:14:59.047382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.047545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.137 [2024-04-23 05:14:59.047582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.137 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.047693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.047858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.047884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.048020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.048154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.048181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.048345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.048476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.048502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.048654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.048784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.048811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.048970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.049103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.049130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.049293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.049410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.049436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.049570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.049731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.049756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.049865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.050207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.050443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.050740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.050906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.051070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.051210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.051236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.051382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.051521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.051548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.051685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.051794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.051820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.051963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.052233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.052498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.052796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.052940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.053074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.053201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.053228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.053363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.053499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.053533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.053658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.053766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.053794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.053953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.054213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.054511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.054777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.054944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.055080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.055219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.055245] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.055354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.055460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.055486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.055603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.055772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.138 [2024-04-23 05:14:59.055799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.138 qpair failed and we were unable to recover it. 00:30:20.138 [2024-04-23 05:14:59.055961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.056091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.056117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.056221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.056383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.056409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.056537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.056682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.056709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.056847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.056987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.057014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.057122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.057284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.057310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.057434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.057606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.057633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.057743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.057900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.057927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.058060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.058223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.058249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.058355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.058466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.058492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.058645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.058789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.058816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.058942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.059105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.059132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.059233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.059369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.059396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.059539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.059654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.059680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.059817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.059979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.060006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.060138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.060317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.060343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.060455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.060589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.060615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.060751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.060862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.060897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.061045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.061193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.061231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.061366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.061473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.061499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.061626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.061793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.061819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.061955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.062092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.062118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.062228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.062334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.062361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.062494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.062621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.062647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.062810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.062976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.063002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.139 [2024-04-23 05:14:59.063119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.063239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.139 [2024-04-23 05:14:59.063265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.139 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.063402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.063542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.063572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.063731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.063875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.063901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.064016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.064153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.064179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.064307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.064419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.064445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.064575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.064717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.064743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.064911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.065180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.065489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.065791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.065978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.066087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.066227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.066254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.066392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.066505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.066536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.066671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.066832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.066858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.066998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.067127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.067153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.067287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.067443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.067470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.067604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.067743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.067770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.067907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.068236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.068503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.068783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.068947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.069106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.069238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.069264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.069415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.069534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.069562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.069703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.069806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.069832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.069973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.070112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.070138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.070274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.070383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.070409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.070575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.070715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.070742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.070854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.070990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.071017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.071158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.071264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.071291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.071468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.071589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.071615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.071748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.071907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.140 [2024-04-23 05:14:59.071933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.140 qpair failed and we were unable to recover it. 00:30:20.140 [2024-04-23 05:14:59.072052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.072186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.072212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.072343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.072450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.072477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.072650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.072757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.072783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.072921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.073170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.073435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.073756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.073918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.074048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.074152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.074178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.074307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.074443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.074469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.074575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.074741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.074767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.074901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.075192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.075540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.075791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.075927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.076064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.076220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.076246] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.076383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.076539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.076567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.076730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.076838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.076865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.077006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.077167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.077193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.077327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.077462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.077489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.077635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.077779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.077805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.077924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.078217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.078519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.078819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.078960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.079102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.079241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.079267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.079404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.079513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.079546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.079707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.079822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.079849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.079985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.080122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.080148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.080253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.080386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.141 [2024-04-23 05:14:59.080413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.141 qpair failed and we were unable to recover it. 00:30:20.141 [2024-04-23 05:14:59.080546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.080677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.080704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.080841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.080998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.081024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.081157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.081256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.081282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.081440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.081572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.081600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.081745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.081852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.081880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.082026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.082138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.082166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.082271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.082388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.082414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.082576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.082707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.082733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.082870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.083173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.083420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.083661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.083795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.083903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084087] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.084218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.084502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.084794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.084952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.085087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.085249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.085275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.085438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.085601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.085629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.085766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.085899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.085926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.086090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.086220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.086247] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.086415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.086554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.086581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.086717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.086852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.086878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.087015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.087175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.087201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.087306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.087421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.087448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.087583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.087748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.087774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.087944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.088216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.088490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.142 [2024-04-23 05:14:59.088762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.142 [2024-04-23 05:14:59.088899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.142 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.089005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.089140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.089167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.089296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.089434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.089461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.089580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.089694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.089721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.089853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.089983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.090010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.090141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.090302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.090328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.090463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.090571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.090598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.090728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.090858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.090889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.090994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.091127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.091154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.091255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.091389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.091415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.091553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.091709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.091735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.091868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.092196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.092471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.092760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.092926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.093073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.093233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.093259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.093391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.093502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.093535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.093641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.093750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.093781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.093890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.094214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.094460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.094705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.094893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.095028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.095167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.095194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.095358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.095489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.095521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.095689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.095827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.095853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.143 [2024-04-23 05:14:59.095968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.096077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.143 [2024-04-23 05:14:59.096104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.143 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.096206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.096307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.096335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.096445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.096614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.096642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.096825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.096965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.096991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.097103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.097235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.097261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.097418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.097588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.097615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.097744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.097849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.097875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.097987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.098127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.098154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.098290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.098402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.098429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.098565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.098730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.098756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.098918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.099162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.099470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.099755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.099941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.100076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.100208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.100234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.100372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.100500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.100531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.100667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.100804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.100831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.100972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.101287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.101560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.101814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.101979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.102089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.102226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.102253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.102387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.102526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.102553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.102687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.102802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.102829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.102971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.103230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.103496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.103803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.103930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.104089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.104224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.104252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.144 [2024-04-23 05:14:59.104387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.104541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.144 [2024-04-23 05:14:59.104569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.144 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.104706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.104817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.104843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.104975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.105107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.105134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.105230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.105369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.105395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.105504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.105663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.105690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.105854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.106154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.106451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.106775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.106912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.107047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.107183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.107211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.107374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.107501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.107532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.107665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.107835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.107861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.108022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.108181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.108207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.108303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.108410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.108437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.108548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.108682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.108714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.108877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.108981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.109007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.109133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.109241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.109267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.109428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.109537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.109564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.109666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.109804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.109830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.109960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.110129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.110156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.110318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.110424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.110450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.110565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.110694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.110720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.110857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.111178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.111450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.111728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.111921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.112083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.112207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.112238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.112369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.112495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.112535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.112655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.112763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.112789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.145 [2024-04-23 05:14:59.112897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.113038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.145 [2024-04-23 05:14:59.113064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.145 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.113225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.113330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.113356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.113456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.113586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.113613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.113750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.113890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.113918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.114032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.114192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.114219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.114355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.114525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.114552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.114699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.114859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.114886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.115044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.115180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.115206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.115334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.115443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.115469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.115607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.115745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.115773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.115910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.116210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.116487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.116770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.116929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.117056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.117159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.117184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.117350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.117458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.117484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.117605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.117739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.117765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.117901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.118158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.118417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.118689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.118847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.118972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.119250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.119533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.119827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.119986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.120141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.120245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.120271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.120408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.120554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.120581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.120747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.120878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.120904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.121039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.121152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.121179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.121315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.121427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.146 [2024-04-23 05:14:59.121454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.146 qpair failed and we were unable to recover it. 00:30:20.146 [2024-04-23 05:14:59.121595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.121735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.121762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.121875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.121988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.122014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.122154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.122255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.122281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.122417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.122568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.122596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.122738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.122872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.122899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.123046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.123155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.123181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.123316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.123453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.123483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.123625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.123728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.123754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.123859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.123990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.124016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.124130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.124296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.124323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.124435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.124547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.124573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.124714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.124878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.124905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.125066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.125174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.125200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.125373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.125481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.125507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.125651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.125757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.125783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.125919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.126059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.126086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.126226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.126362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.126388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.126541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.126681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.126707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.126837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.126976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.127002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.127142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.127299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.127325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.127466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.127577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.127605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.127773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.127878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.127904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.128066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.128198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.128224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.128391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.128525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.128552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.128662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.128832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.128858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.128956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.129065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.129091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.147 [2024-04-23 05:14:59.129229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.129332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.147 [2024-04-23 05:14:59.129358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.147 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.129524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.129639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.129665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.129777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.129878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.129904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.130025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.130263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.130531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.130810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.130947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.131116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.131274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.131300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.131436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.131569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.131596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.131726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.131844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.131870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.132032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.132168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.132195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.132302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.132463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.132490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.132608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.132732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.132759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.132893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.133169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.133459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.133732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.133895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.134066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.134205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.134231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.134401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.134544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.134572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.134677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.134786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.134812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.134971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.135078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.135104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.148 [2024-04-23 05:14:59.135220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.135321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.148 [2024-04-23 05:14:59.135347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.148 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.135482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.135618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.135647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.135781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.135907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.135934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.136042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.136205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.136231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.136366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.136470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.136497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.136645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.136793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.136820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.136960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.137207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.137449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.137726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.137897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.138031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.138139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.138169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.138301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.138403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.138429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.138571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.138721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.138747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.138884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.139185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.139487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.139759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.139903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.140039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.140154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.140180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.140309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.140424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.140451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.140564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.140727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.140753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.140888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.141187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.141463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.141713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.141882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.141991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.142126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.142153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.142291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.142401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.142439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.149 qpair failed and we were unable to recover it. 00:30:20.149 [2024-04-23 05:14:59.142587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.149 [2024-04-23 05:14:59.142726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.142753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.142909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.143218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.143571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.143848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.143980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.144092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.144224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.144250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.144358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.144468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.144494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.144636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.144747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.144774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.144910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.145186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.145481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.145787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.145951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.146055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.146196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.146223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.146330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.146470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.146498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.146644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.146764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.146791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.146921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.147178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.147485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.147771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.147905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.148039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.148286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.148582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.148832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.148992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.149127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.149239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.149265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.149378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.149511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.149548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.149656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.149793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.149819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.150 qpair failed and we were unable to recover it. 00:30:20.150 [2024-04-23 05:14:59.149964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.150070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-04-23 05:14:59.150096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.150230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.150363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.150389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.150528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.150635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.150661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.150830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.150939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.150966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.151094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.151252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.151279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.151425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.151563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.151590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.151698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.151858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.151884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.151996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.152124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.152151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.152287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.152450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.152476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.152656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.152818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.152848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.152983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.153131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.153156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.153295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.153406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.153433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.153573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.153709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.153735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.153894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.154181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.154480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.154751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.154881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.155017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.155178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.155205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.155341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.155489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.155520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.155662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.155798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.155828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.155958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.156206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.156474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.156753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.156919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.157017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.157126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.157152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.157258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.157417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.157443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.157555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.157693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.157720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.157853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.158138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.158435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.151 qpair failed and we were unable to recover it. 00:30:20.151 [2024-04-23 05:14:59.158725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-04-23 05:14:59.158914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.159074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.159207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.159234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.159365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.159497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.159545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.159679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.159789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.159817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.159926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.160219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.160535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.160812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.160973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.161104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.161212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.161239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.161374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.161493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.161526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.161677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.161787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.161814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.161985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.162288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.162562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.162812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.162969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.163104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.163206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.163234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.163341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.163448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.163475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.163612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.163735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.163762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.163892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.164162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.164408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.164717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.164900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.165046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.165318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.165555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.165854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.165992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.166100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.166200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.166227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.166354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.166461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.166490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.152 [2024-04-23 05:14:59.166620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.166727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-04-23 05:14:59.166753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.152 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.166892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.167051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.167077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.167215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.167327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.167353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.167482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.167668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.167695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.167834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.168165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.168472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.168758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.168945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.169053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.169193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.169220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.169363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.169528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.169556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.169666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.169803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.169829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.169962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.170265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.170520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.170817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.170978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.171089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.171196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.171222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.171357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.171493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.171540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.171676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.171783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.171810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.171918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.172055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.172083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.172243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.172380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.172406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.172569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.172670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.172696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.172856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.172994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.173020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.173155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.173313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.173340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.173482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.173653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.173680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.173797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.173935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.173962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.174079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.174224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.174251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.174388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.174528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.174555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.153 qpair failed and we were unable to recover it. 00:30:20.153 [2024-04-23 05:14:59.174668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.153 [2024-04-23 05:14:59.174776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.174802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.174911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.175181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.175452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.175728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.175864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.176005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.176112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.176138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.176282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.176425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.176451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.176618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.176728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.176754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.176867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.177156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.177456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.177719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.177908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.178020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.178130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.178158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.178291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.178403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.178432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.178572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.178711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.178737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.178877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.179179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.179442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.179718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.179875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.180014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.180148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.180174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.180290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.180433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.180459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.180578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.180709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.180735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.180849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181038] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.181195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.181492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.181795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.181928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.182028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.182169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.182195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.182343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.182482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.182508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.182629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.182742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.182768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.182871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.183140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.183439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.154 [2024-04-23 05:14:59.183791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.154 [2024-04-23 05:14:59.183967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.154 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.184128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.184236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.184262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.184398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.184538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.184566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.184703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.184867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.184893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.185004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.185305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.185558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.185818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.185949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.186052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.186180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.186206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.186344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.186451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.186478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.186626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.186739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.186765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.186878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.187200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.187503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.187826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.187997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.188168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.188307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.188334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.188443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.188609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.188636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.188744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.188857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.188884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.188992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.189132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.189158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.189271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.189376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.189403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.189566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.189704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.189730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.189869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.189981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.190008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.190171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.190307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.190334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.190499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.190638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.190665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.190795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.190901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.190928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.191093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.191229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.191256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.191366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.191479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.191505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.191665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.191774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.191800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.191963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.192235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.192508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.192786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.192974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.193110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.193211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.193237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.193359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.193568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.193597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.155 [2024-04-23 05:14:59.193763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.193904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.155 [2024-04-23 05:14:59.193930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.155 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.194067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.194199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.194226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.194361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.194497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.194530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.194635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.194796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.194822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.194959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.195230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.195498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.195821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.195982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.196119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.196228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.196255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.196416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.196554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.196582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.196720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.196852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.196879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.197037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.197158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.197185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.197326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.197460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.197487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.197624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.197725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.197752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.197861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.197995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.198021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.198160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.198269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.198297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.198434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.198561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.198588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.198698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.198804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.198830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.198997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.199134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.199160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.199293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.199430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.199456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.199579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.199714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.199740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.199913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.200190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.200450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.200724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.200888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.201054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.201161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.201187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.201308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.201470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.201497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.201607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.201746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.201773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.201933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.202186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.202461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.202739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.202879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.202984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.203094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.203122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.203259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.203363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.203389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.156 [2024-04-23 05:14:59.203535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.203665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.156 [2024-04-23 05:14:59.203692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.156 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.203827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.203973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.204000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.204121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.204264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.204290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.204431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.204562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.204590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.204723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.204825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.204851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.204986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.205158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.205184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.205288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.205405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.205431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.205567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.205704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.205731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.205872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.205984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.206012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.206146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.206279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.206306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.206446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.206554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.206582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.206712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.206844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.206870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.206980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.207140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.207166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.207306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.207444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.207471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.207593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.207753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.207779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.207887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.208169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.208446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.208794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.208939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.209100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.209267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.209294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.209424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.209534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.209571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.209703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.209819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.209845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.210009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.210110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.210136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.210243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.210382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.210409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.210543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.210692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.210718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.210857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.210997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.211023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.211134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.211265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.211291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.211450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.211584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.211611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.211753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.211872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.211899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.212033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.212141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.212167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.157 qpair failed and we were unable to recover it. 00:30:20.157 [2024-04-23 05:14:59.212300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.157 [2024-04-23 05:14:59.212437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.212463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.212592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.212704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.212730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.212893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.212998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.213026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.213192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.213332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.213357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.213529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.213663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.213689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.213851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.214209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214367] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.214497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.214740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.214941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.215082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.215193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.215220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.215356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.215487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.215520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.215629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.215793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.215819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.215959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.216102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.216128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.216247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.216376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.216403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.216525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.216674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.216700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.216863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.216990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.217018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.217126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.217263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.217290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.217431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.217542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.217568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.217685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.217798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.217829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.217947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.218091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.218117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.218281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.218420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.218447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.218581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.218717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.218744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.218880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.219209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.219525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.219799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.219957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.220096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.220194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.220221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.220333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.220433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.220459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.220605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.220719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.220746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.220884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.220998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.221024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.221157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.221293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.221320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.221460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.221599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.221626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.221793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.221925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.221951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.222108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.222272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.158 [2024-04-23 05:14:59.222297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.158 qpair failed and we were unable to recover it. 00:30:20.158 [2024-04-23 05:14:59.222430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.222600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.222626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.222787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.222918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.222944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.223102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.223245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.223275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.223452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.223572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.223602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.223760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.223868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.223894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.224008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.224171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.224197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.224354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.224550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.224576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.224711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.224817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.224844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.224959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.225073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.225101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.225231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.225380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.225409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.225556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.225719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.225744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.225853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.225990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.226015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.226143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.226256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.226283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.226420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.226559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.226586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.226712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.226870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.226896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.227075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.227207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.227232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.227330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.227461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.227487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.227655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.227856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.227882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.228059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.228213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.228242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.228390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.228562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.228592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.228727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.228896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.228922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.229024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.229132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.229157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.229283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.229481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.229506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.229679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.229831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.229860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.230050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.230178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.230220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.230337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.230460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.230488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.230657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.230799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.230825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.230955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.231068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.231094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.231221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.231360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.231385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.231506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.231708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.231734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.231893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.232057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.232082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.232221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.232333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.232378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.232538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.232670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.232696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.232875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.233012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.233037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.233170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.233320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.233362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.159 qpair failed and we were unable to recover it. 00:30:20.159 [2024-04-23 05:14:59.233495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.159 [2024-04-23 05:14:59.233662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.233696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.233838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.233939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.233965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.234071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.234200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.234226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.234344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.234492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.234530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.234683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.234803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.234831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.234988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.235120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.235146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.235309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.235444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.235469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.235649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.235880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.235942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.236062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.236247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.236273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.236405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.236535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.236562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.236738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.236898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.236924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.237060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.237210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.237238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.237385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.237544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.237570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.237708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.237834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.237860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.237989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.238128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.238156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.238304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.238455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.238481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.238651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.238836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.238865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.239009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.239145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.239171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.239282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.239405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.239433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.239582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.239731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.239760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.239902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.240037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.240062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.240200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.240338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.240364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.240511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.240640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.240666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.240799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.240984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.241009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.241175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.241345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.241370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.241506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.241662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.241688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.241862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.242032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.242060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.242236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.242393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.242418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.242560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.242733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.242759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.242916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.243208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.243520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.243757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.243941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.244092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.244230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.244255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.244390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.244551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.244581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.244731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.244890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.160 [2024-04-23 05:14:59.244915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.160 qpair failed and we were unable to recover it. 00:30:20.160 [2024-04-23 05:14:59.245057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.245229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.245255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.245421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.245600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.245629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.245742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.245889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.245918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.246067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.246214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.246243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.246387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.246504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.246541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.246696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.246812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.246838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.246973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.247102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.247128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.247272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.247399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.247425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.247586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.247724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.247750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.247878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.247986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.248012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.248153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.248258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.248284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.248406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.248579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.248609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.248744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.248886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.248912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.249072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.249205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.249231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.249335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.249470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.249496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.249616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.249774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.249804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.249970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.250076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.250102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.250240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.250368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.250394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.250567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.250679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.250705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.250835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.250973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.251002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.251176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.251292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.251321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.251483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.251619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.251645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.251784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.251931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.251959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.252112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.252310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.252335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.252472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.252623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.252654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.252814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.252976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.253006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.253162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.253301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.253330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.253479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.253630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.253672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.253832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.253958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.253987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.254138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.254277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.254302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.254438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.254571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.254600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.254745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.254857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.254886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.255052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.255211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.255238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.255356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.255491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.255523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-04-23 05:14:59.255719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-04-23 05:14:59.255860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.255885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.256034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.256179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.256208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.256355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.256478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.256506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.256681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.256782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.256808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.256955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.257274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.257542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.257810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.257997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.258154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.258279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.258307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.258455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.258598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.258628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.258779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.258900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.258929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.259088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.259225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.259251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.259380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.259509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.259546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.259697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.259838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.259880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.260015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.260142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.260170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.260327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.260455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.260481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.260666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.260838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.260867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.261041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.261233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.261259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.261364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.261528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.261558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.261715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.261874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.261916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.262060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.262208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.262234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.262396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.262555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.262582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.262784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.262992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.263023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.263154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.263285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.263310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.263437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.263583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.263613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.263763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.263930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.263956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.264094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.264232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.264258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.264371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.264507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.264540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.264642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.264774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.264799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.264933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.265087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.265115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.265295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.265430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.265454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.265568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.265730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.265757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.265894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.266206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.266545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.266841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.266979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-04-23 05:14:59.267131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.267249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-04-23 05:14:59.267276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.267386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.267584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.267611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.267772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.267944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.267972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.268125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.268254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.268279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.268441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.268610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.268636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.268777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.268940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.268969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.269087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.269275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.269303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.269467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.269592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.269617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.269753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.269887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.269912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.270075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.270255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.270283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.270409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.270556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.270582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.270711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.270847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.270872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.271041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.271172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.271197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.271321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.271502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.271565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.271718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.271873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.271901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.272064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.272197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.272222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.272355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.272503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.272545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.272732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.272884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.272914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.273062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.273224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.273251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.273426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.273555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.273583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.273750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.273929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.273992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.274195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.274366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.274395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.274577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.274712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.274738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.274864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.274998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.275023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.434 [2024-04-23 05:14:59.275159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.275334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.434 [2024-04-23 05:14:59.275359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.434 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.275526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.275662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.275688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.275821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.275977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.276011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.276176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.276307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.276332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.276490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.276627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.276652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.276839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.276984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.277014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.277160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.277311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.277339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.277499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.277616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.277643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.277782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.277945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.277972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.278123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.278282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.278307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.278489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.278624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.278652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.278771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.278908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.278933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.279132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.279269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.279299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.279450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.279595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.279624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.279810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.279921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.279946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.280080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.280216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.280241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.280403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.280526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.280555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.280695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.280829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.280855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.281029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.281141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.281166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.281297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.281436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.281461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.281598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.281755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.281780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.281888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.282046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.282071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.282226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.282386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.282419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.282554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.282693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.282718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.282855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.283207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.283570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.283853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.283982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.284145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.284256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.284283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.284404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.284559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.284588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.284707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.284858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.284885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.285072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.285190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.285216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.285350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.285487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.285512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.285659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.285791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.285821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.285964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.286136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.286165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.286325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.286437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.286463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.286618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.286747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.286776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.286927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.287115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.287140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.287245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.287382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.287408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.287565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.287705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.287730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.287842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.288212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.288535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.288844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.288982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.289117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.289255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.289283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.289396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.289574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.289603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.289758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.289932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.289961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.290092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.290223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.290250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.290362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.290526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.290555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.290704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.290863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.290891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.291088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.291218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.291244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.291347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.291482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.291508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.291700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.291895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.291920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.292059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.292188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.292217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.292401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.292555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.292582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.435 qpair failed and we were unable to recover it. 00:30:20.435 [2024-04-23 05:14:59.292717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.292849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.435 [2024-04-23 05:14:59.292874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.292983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.293142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.293170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.293341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.293461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.293489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.293678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.293819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.293845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.294007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.294156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.294185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.294340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.294504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.294534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.294696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.294849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.294875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.294989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.295155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.295181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.295363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.295495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.295542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.295685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.295862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.295891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.296015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.296154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.296183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.296354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.296501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.296536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.296671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.296810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.296836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.296999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.297173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.297202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.297364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.297499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.297532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.297664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.297767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.297792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.297925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.298245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.298528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.298824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.298999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.299180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.299288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.299313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.299426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.299529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.299573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.299720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.299842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.299870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.300009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.300169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.300194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.300304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.300436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.300464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.300599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.300736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.300762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.300917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.301056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.301082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.301210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.301339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.301365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.301505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.301686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.301714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.301840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.302007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.302033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.302205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.302364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.302393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.302540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.302680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.302707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.302863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.302990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.303015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.303188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.303302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.303328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.303523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.303676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.303704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.303851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.303970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.303999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.304131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.304288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.304314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.304454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.304617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.304644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.304796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.304944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.304972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.305099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.305249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.305274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.305403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.305520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.305547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.305720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.305836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.305861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.306018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.306173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.306200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.306359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.306491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.306522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.306698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.306857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.306885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.307041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.307196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.307221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.307380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.307544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.307571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.307709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.307880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.307907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.308047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.308183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.436 [2024-04-23 05:14:59.308207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.436 qpair failed and we were unable to recover it. 00:30:20.436 [2024-04-23 05:14:59.308405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.308548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.308578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.308745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.308892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.308918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.309101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.309269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.309294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.309434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.309572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.309597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.309711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.309877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.309906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.310076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.310223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.310250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.310372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.310508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.310538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.310680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.310793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.310818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.310996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.311145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.311174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.311351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.311535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.311565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.311685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.311832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.311860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.312044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.312159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.312185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.312341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.312456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.312484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.312667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.312805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.312830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.313010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.313157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.313185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.313334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.313444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.313471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.313645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.313809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.313835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.313967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.314096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.314125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.314306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.314439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.314464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.314645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.314822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.314849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.315040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.315192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.315220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.315364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.315508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.315545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.315661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.315783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.315813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.315971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.316132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.316175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.316290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.316414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.316442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.316587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.316739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.316768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.316938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.317077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.317105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.317265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.317400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.317426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.317583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.317727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.317752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.317882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.318045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.318073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.318219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.318343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.318371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.318508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.318648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.318675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.318832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.318983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.319010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.319200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.319335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.319360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.319467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.319596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.319625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.319784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.319942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.319968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.320108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.320211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.320236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.320346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.320442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.320467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.320623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.320776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.320806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.320954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.321121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.321163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.321339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.321496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.321528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.321650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.321802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.321831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.321978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.322114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.322140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.322275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.322432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.322458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.322595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.322757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.322785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.322958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.323130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.323203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.323321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.323464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.323493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.323658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.323798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.323823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.323962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.324089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.324117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.324264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.324390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.324424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.324600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.324749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.324777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.324929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.325063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.325088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.325246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.325403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.325427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.325587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.325707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.325734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.437 [2024-04-23 05:14:59.325922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.326055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.437 [2024-04-23 05:14:59.326080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.437 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.326214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.326321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.326346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.326510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.326677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.326703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.326828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.327168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.327467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.327802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.327988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.328144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.328265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.328292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.328435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.328587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.328615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.328776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.328917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.328942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.329048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.329183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.329209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.329338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.329498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.329528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.329675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.329823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.329850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.330041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.330172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.330216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.330361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.330487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.330521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.330712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.330819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.330848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.330991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.331126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.331151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.331269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.331384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.331409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.331568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.331744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.331770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.331935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.332095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.332124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.332270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.332389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.332418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.332635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.332775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.332801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.332962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.333128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.333156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.333304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.333471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.333499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.333655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.333817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.333843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.333982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.334091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.334121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.334277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.334451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.334480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.334667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.334775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.334805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.334940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.335085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.335113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.335270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.335406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.335432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.335582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.335755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.335785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.335980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.336113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.336139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.336304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.336465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.336491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.336680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.336847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.336874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.337020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.337142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.337168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.337277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.337377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.337403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.337572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.337724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.337752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.337944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.338070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.338105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.338273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.338432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.338461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.338611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.338766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.338795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.338929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.339107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.339133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.339246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.339408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.339434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.339600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.339775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.339804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.339951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.340097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.340126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.340277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.340416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.340443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.340604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.340714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.340741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.340906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.341181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.341566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.341813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.341973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.342125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.342267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.342296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.342471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.342630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.342659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.438 [2024-04-23 05:14:59.342804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.342992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.438 [2024-04-23 05:14:59.343018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.438 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.343118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.343254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.343281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.343422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.343595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.343625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.343780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.343918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.343946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.344128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.344304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.344332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.344518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.344632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.344658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.344794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.344938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.344967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.345087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.345203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.345231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.345349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.345525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.345564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.345745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.345864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.345889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.346079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.346227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.346257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.346420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.346583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.346609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.346747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.346909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.346935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.347083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.347190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.347216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.347388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.347585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.347612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.347790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.347963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.347989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.348124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.348257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.348284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.348418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.348581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.348626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.348807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.348910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.348936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.349072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.349215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.349240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.349394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.349556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.349584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.349741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.349875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.349901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.350097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.350226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.350252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.350420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.350560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.350587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.350761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.350900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.350926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.351057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.351165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.351191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.351321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.351503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.351542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.351648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.351804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.351832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.351980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.352130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.352159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.352348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.352503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.352564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.352738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.352878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.352908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.353084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.353200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.353230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.353403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.353578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.353607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.353767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.353912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.353955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.354108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.354259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.354288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.354410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.354570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.354599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.354747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.354895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.354924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.355079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.355192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.355218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.355372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.355528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.355567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.355712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.355853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.355882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.356068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.356197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.356223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.356357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.356510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.356564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.356720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.356877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.356906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.357055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.357197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.357226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.357394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.357587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.357620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.357758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.357907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.357934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.358079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.358245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.358271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.358382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.358532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.358562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.358707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.358941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.358995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.359127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.359259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.359285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.359474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.359632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.439 [2024-04-23 05:14:59.359660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.439 qpair failed and we were unable to recover it. 00:30:20.439 [2024-04-23 05:14:59.359844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.360031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.360057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.360198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.360338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.360364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.360501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.360660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.360686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.360841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.360978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.361005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.361117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.361247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.361273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.361383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.361541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.361570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.361680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.361789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.361815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.361946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.362091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.362117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.362256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.362390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.362420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.362570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.362701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.362727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.362866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.363171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.363495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.363800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.363939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.364100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.364230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.364256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.364366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.364528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.364564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.364744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.364977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.365004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.365141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.365306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.365335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.365464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.365622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.365650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.365827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.366001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.366030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.366156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.366333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.366362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.366545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.366694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.366724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.366877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.367016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.367043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.367174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.367343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.367377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.367560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.367722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.367764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.367911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.368079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.368105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.368213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.368347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.368373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.368531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.368667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.368694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.368867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.369030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.369057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.369205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.369358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.369385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.369552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.369706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.369735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.369883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.370033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.370062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.370209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.370359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.370388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.370536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.370712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.370738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.370850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.370985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.371011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.371165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.371320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.371347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.371542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.371672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.371698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.371809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.371943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.371969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.372081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.372217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.372243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.372373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.372493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.372536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.372726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.372844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.372870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.372979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.373140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.373166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.373328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.373483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.373534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.373687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.373837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.373866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.373986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.374145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.374174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.374325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.374473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.374502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.374706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.374843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.374870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.375007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.375191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.375221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.375397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.375540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.375570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.375678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.375855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.375881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.375996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.376133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.376159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.376319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.376461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.376490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.376642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.376811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.376854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.377002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.377159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.377188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.377346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.377451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.377478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.440 qpair failed and we were unable to recover it. 00:30:20.440 [2024-04-23 05:14:59.377628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.377763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.440 [2024-04-23 05:14:59.377790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.377946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.378146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.378209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.378323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.378474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.378502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.378694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.378800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.378826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.378964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.379144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.379171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.379318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.379472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.379498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.379643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.379776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.379802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.379944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.380070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.380097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.380258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.380414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.380443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.380642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.380780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.380807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.380994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.381166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.381196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.381378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.381556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.381586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.381728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.381843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.381870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.382002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.382160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.382189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.382339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.382475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.382504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.382656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.382814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.382840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.382994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.383132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.383161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.383333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.383482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.383512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.383652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.383811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.383837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.384010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.384177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.384241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.384384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.384572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.384600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.384739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.384900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.384929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.385078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.385255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.385284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.385443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.385558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.385585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.385742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.385952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.386011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.386158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.386336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.386365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.386548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.386694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.386724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.386879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.387015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.387042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.387204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.387358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.387387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.387533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.387691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.387720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.387865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.388026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.388053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.388190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.388321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.388347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.388538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.388689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.388720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.388910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.389079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.389106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.389285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.389423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.389449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.389562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.389703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.389729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.389907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.390070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.390096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.390227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.390387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.390413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.390583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.390745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.390776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.390933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.391044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.391070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.391237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.391351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.391378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.391484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.391662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.391691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.391854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.392048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.392074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.392235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.392374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.392400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.392530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.392676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.392706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.392853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.393037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.393063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.393200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.393360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.393405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.393542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.393678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.393705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.393849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.394021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.394050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.394174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.394352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.394381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.394539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.394726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.394755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.394931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.395097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.441 [2024-04-23 05:14:59.395126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.441 qpair failed and we were unable to recover it. 00:30:20.441 [2024-04-23 05:14:59.395269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.395414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.395443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.395562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.395689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.395715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.395863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.395994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.396022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.396191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.396323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.396349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.396542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.396677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.396703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.396867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.397031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.397060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.397211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.397341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.397368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.397501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.397650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.397693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.397853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.398160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.398464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.398758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.398891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.399082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.399205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.399233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.399393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.399504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.399540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.399677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.399824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.399850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.399959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.400132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.400177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.400297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.400454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.400483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.400646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.400809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.400836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.400996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.401159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.401193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.401358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.401560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.401589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.401764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.401921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.401948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.402124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.402299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.402328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.402529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.402655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.402682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.402794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.402899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.402925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.403030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.403158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.403202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.403388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.403554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.403581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.403715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.403850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.403876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.404010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.404124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.404150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.404286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.404433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.404462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.404639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.404799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.404826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.404963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.405147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.405173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.405335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.405467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.405510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.405683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.405847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.405873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.406006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.406179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.406208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.406321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.406469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.406498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.406638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.406770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.406796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.406929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.407092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.407118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.407258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.407424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.407465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.407608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.407735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.407774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.407931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.408068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.408094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.408256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.408403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.408432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.408582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.408697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.408726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.408868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.409096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.409154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.409291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.409450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.409476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.409641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.409774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.409801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.409939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.410071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.410097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.410265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.410442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.410471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.410620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.410723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.410749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.410846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.411203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.411460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.411802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.411940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.412079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.412246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.412276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.412432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.412563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.412591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.412751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.412941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.412968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.413131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.413295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.442 [2024-04-23 05:14:59.413321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.442 qpair failed and we were unable to recover it. 00:30:20.442 [2024-04-23 05:14:59.413477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.413672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.413699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.413858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.414026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.414055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.414194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.414318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.414359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.414507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.414658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.414684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.414889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.415005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.415033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.415222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.415351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.415377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.415522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.415679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.415708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.415862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.415998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.416025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.416194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.416327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.416353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.416459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.416625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.416652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.416765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.416924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.416950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.417085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.417216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.417243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.417428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.417620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.417651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.417764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.417938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.417971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.418123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.418299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.418329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.418474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.418607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.418646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.418781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.418943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.418969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.419100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.419250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.419279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.419432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.419549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.419591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.419698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.419829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.419856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.419995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.420123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.420151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.420328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.420492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.420527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.420717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.420903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.420953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.421114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.421257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.421283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.421422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.421601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.421629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.421744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.421895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.421924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.422075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.422249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.422276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.422416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.422615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.422641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.422749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.422933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.422962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.423074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.423224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.423257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.423387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.423566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.423596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.423729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.423837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.423864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.424027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.424185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.424215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.424332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.424484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.424513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.424696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.424805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.424831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.424972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.425086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.425114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.425305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.425451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.425482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.425666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.425870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.425917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.426117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.426249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.426275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.426412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.426528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.426555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.426684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.426831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.426861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.426999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.427192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.427219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.427348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.427509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.427543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.427681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.427819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.427846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.428009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.428125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.428154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.428298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.428422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.428451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.428595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.428759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.428785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.428928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.429093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.429120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.429230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.429393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.429423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.429548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.429697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.429726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.429843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.430005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.430032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.430174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.430310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.430355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.430542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.430697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.430726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.430878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.431028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.431057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.431196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.431375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.431405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.443 qpair failed and we were unable to recover it. 00:30:20.443 [2024-04-23 05:14:59.431543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.431654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.443 [2024-04-23 05:14:59.431681] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.431795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.431956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.431985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.432134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.432321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.432348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.432510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.432685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.432715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.432875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.433215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.433508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.433818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.433968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.434131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.434237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.434264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.434426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.434547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.434578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.434685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.434816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.434842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.434978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.435127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.435158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.435347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.435458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.435484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.435621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.435815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.435841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.435979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.436131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.436160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.436303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.436427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.436456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.436611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.436715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.436741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.436871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.437003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.437030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.437188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.437346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.437376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.437530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.437672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.437706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.437839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.438003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.438029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.438198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.438355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.438384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.438557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.438708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.438737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.438856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.438968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.439008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.439200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.439363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.439390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.439546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.439665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.439695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.439814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.439978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.440005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.440144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.440323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.440352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.440473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.440616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.440644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.440807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.440965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.440994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.441174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.441348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.441378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.441543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.441722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.441766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.441897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.442057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.442083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.442259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.442379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.442407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.442542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.442699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.442725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.442832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.442985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.443014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.443171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.443333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.443359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.443521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.443664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.443693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.443864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.443999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.444027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.444182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.444330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.444359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.444552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.444715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.444741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.444876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.445035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.445064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.445218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.445349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.445375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.445510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.445712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.445738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.445868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.446161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.446528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.446805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.446986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.447114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.447248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.447274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.447376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.447539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.447569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.447710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.447890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.447919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.444 qpair failed and we were unable to recover it. 00:30:20.444 [2024-04-23 05:14:59.448073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.444 [2024-04-23 05:14:59.448210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.448236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.448369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.448505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.448538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.448694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.448830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.448856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.449052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.449192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.449218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.449372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.449529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.449558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.449727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.449869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.449910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.450053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.450195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.450225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.450346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.450493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.450532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.450683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.450894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.450949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.451071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.451209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.451237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.451392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.451544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.451574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.451727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.451871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.451900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.452043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.452191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.452220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.452382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.452490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.452529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.452703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.452838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.452864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.452972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.453147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.453176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.453293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.453452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.453481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.453651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.453784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.453809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.453940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.454070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.454096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.454216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.454348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.454380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.454538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.454679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.454708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.454875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.454980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.455006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.455144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.455263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.455292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.455437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.455583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.455612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.455730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.455852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.455898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.456030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.456172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.456198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.456298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.456460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.456487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.456630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.456806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.456835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.456956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.457074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.457104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.457285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.457395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.457421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.457560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.457717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.457745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.457880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.458066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.458092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.458256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.458448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.458478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.458629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.458739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.458766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.458929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.459226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.459497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.459809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.459972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.460111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.460239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.460268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.460377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.460525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.460554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.460709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.460853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.460881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.461040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.461174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.461199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.461357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.461504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.461564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.461673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.461805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.461831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.461969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.462108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.462134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.462298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.462463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.462489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.462644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.462752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.462795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.462956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.463155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.463181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.463317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.463451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.463480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.463647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.463753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.463787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.463951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.464084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.464112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.464298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.464474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.464503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.464675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.464791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.464817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.464956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.465103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.465145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.465270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.465428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.465455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.465587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.465723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.465749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.445 qpair failed and we were unable to recover it. 00:30:20.445 [2024-04-23 05:14:59.465954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.445 [2024-04-23 05:14:59.466119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.466165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.466310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.466467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.466493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.466640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.466760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.466790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.466958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.467102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.467131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.467258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.467438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.467468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.467618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.467738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.467764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.467953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.468120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.468153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.468303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.468414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.468454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.468638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.468748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.468775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.468950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.469095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.469123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.469255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.469374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.469402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.469509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.469675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.469702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.469919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.470059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.470085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.470249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.470412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.470439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.470581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.470698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.470726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.470899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.471232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.471572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.471830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.471955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.472097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.472233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.472260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.472365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.472504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.472540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.472682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.472821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.472848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.473020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.473157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.473183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.473351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.473513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.473546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.473710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.473856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.473888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.474052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.474185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.474212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.474344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.474501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.474536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.474658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.474810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.474837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.475052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.475193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.475219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.475435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.475606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.475633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.475796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.475929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.475956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.476091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.476241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.476268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.476427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.476593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.476620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.476728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.476832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.476859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.477072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.477237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.477268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.477382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.477544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.477582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.477721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.477862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.477889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.478024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.478164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.478191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.478305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.478442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.478469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.478584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.478691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.478717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.478860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.479160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.479426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.479728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.479900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.480058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.480191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.480221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.480439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.480580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.480607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.480749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.480911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.480938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.481079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.481221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.481250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.481416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.481573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.481600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.481742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.481913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.481940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.446 qpair failed and we were unable to recover it. 00:30:20.446 [2024-04-23 05:14:59.482102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.446 [2024-04-23 05:14:59.482238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.482265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.482371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.482520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.482549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.482659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.482797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.482824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.482959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.483113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.483140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.483299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.483437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.483469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.483619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.483762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.483793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.483930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.484169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.484470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.484788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.484958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.485069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.485172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.485200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.485298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.485432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.485459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.485608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.485747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.485774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.485912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.486051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.486078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.486210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.486324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.486351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.486523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.486748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.486785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.486946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.487086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.487112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.487222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.487350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.487377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.487506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.487661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.487688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.487834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.487975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.488002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.488138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.488246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.488272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.488441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.488572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.488600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.488737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.488886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.488915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.489059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.489222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.489249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.489386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.489544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.489581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.489720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.489855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.489882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.490019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.490137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.490164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.490326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.490465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.490494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.490654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.490818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.490845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.490949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.491221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.491473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.491741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.491903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.492037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.492167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.492193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.492302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.492451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.492478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.492625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.492741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.492767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.492878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.493148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.493484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.493761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.493928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.494065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.494216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.494243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.494384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.494532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.494561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.494729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.494843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.494870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.495002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.495128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.495155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.495322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.495439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.495466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.495608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.495748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.495776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.495916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.496073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.496100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.496261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.496425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.496452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.496589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.496729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.496756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.496866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.497197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.497473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.497782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.497952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.498168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.498364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.498390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.447 qpair failed and we were unable to recover it. 00:30:20.447 [2024-04-23 05:14:59.498531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.498670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.447 [2024-04-23 05:14:59.498697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.498833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.499027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.499054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.499244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.499484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.499510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.499673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.499808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.499849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.500010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.500200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.500226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.500362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.500470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.500496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.500609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.500718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.500760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.500937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.501171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.501198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.501416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.501575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.501602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.501821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.501928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.501954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.502094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.502234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.502260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.502404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.502563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.502592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.502707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.502851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.502879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.502998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.503149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.503192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.503365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.503530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.503558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.503745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.503916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.503943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.504083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.504194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.504222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.504361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.504494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.504527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.504657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.504764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.504790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.504909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.505048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.505074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.505194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.505312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.505339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.505485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.505675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.505706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.505838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.505998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.506024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.506163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.506290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.506316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.506426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.506594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.506622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.506785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.506971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.506998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.507106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.507236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.507263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.507401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.507540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.507568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.507704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.507928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.507954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.508140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.508334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.508361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.508526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.508640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.508668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.508804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.508937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.508964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.509097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.509211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.509238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.509453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.509579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.509623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.509798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.510068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.510094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.510238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.510379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.510405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.510506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.510643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.510670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.510839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.510998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.511023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.511148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.511263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.511291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.511404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.511567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.511595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.511756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.511891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.511918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.512134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.512317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.512345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.512507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.512624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.512652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.512795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.512923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.512949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.513120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.513229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.513257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.513422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.513598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.513641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.513806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.513962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.513988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.514112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.514244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.514271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.514417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.514531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.514559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.514744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.514909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.514936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.515101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.515214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.515240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.515382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.515574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.515602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.515772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.515910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.515937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.448 qpair failed and we were unable to recover it. 00:30:20.448 [2024-04-23 05:14:59.516143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.516321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.448 [2024-04-23 05:14:59.516347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.516547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.516684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.516711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.516812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.516960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.516987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.517166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.517335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.517362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.517512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.517657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.517684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.517817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.517975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.518002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.518137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.518285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.518311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.518453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.518586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.518614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.518775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.518921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.518950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.519125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.519236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.519263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.519421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.519582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.519610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.519714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.519852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.519878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.519985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.520121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.520148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.520287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.520418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.520446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.520586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.520699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.520727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.520873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.521173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.521472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.521759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.521950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.522115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.522225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.522253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.522389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.522492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.522527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.522642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.522779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.522807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.522939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.523206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.523473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.523772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.523936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.524095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.524229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.524257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.524365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.524528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.524556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.524656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.524786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.524816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.524929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.525174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.525471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.525791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.525978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.526108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.526248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.526276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.526417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.526528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.526556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.526690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.526861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.526887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.527054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.527190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.527218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.527325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.527453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.527479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.527591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.527730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.527762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.527901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.528077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.528104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.528253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.528390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.528417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.528549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.528685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.528712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.528852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.528983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.529009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.529122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.529280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.529307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.529471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.529591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.529619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.529789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.529902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.529931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.530047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.530187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.530214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.530348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.530457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.530485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.530603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.530740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.530771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.530910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.531217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.531519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.531791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.531956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.532118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.532221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.532249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.449 qpair failed and we were unable to recover it. 00:30:20.449 [2024-04-23 05:14:59.532379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.449 [2024-04-23 05:14:59.532485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.532522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.532672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.532807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.532834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.532974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.533114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.533141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.533291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.533398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.533425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.533590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.533754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.533781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.533889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.534020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.534047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.534221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.534326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.534353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.534512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.534679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.534706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.534852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.534991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.535018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.535115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.535222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.535249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.535408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.535532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.535560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.535690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.535792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.535820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.535932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.536197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.536487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.536813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.536977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.537113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.537288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.537315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.537458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.537606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.537634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.537770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.537901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.537928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.538062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.538169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.538195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.538370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.538510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.538545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.538706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.538844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.538873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.538981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.539118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.539146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.539314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.539483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.539510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.539636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.539751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.539777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.539886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.540184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.540502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.540783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.540945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.541045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.541157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.541183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.541287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.541424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.541450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.541587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.541749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.541777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.541921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.542226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.542552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.542863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.542993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.543127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.543273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.543300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.543438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.543571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.543599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.543739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.543846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.543872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.544008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.544139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.544165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.544310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.544444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.544471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.544623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.544768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.544794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.544932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.545048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.545080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.545182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.545343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.545370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.545510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.545679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.545705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.545875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.546209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.546532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.546839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.546977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.547114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.547221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.547249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.547409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.547544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.547572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.547743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.547857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.547883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.548022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.548180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.548207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.548338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.548484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.548512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.548658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.548791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.548818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.450 [2024-04-23 05:14:59.548929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.549037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.450 [2024-04-23 05:14:59.549063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.450 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.549166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.549305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.549332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.549468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.549605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.549632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.549766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.549907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.549934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.550043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.550153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.550181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.550317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.550475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.550502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.550644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.550807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.550833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.550994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.551262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.551568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.551845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.551976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.552111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.552209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.552236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.552395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.552527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.552554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.552721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.552871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.552898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.553036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.553172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.553199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.553348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.553540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.553571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.553711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.553876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.553903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.554014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.554150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.554177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.554283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.554393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.554420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.554535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.554676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.554703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.554837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.554976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.555002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.555135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.555296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.555323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.555459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.555596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.555624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.555760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.555927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.555955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.556090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.556226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.556254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.556399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.556560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.556588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.556722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.556890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.556917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.557020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.557156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.557183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.557317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.557471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.557498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.557635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.557766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.557792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.557907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.558217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.558488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.558798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.558924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.559059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.559172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.559199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.559332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.559500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.559535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.559671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.559809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.559837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.560003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.560145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.560171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.560305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.560443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.560470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.560616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.560777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.560804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.560967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.561137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.561165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.561285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.561426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.561453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.561568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.561737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.561764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.561875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.562205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.562511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.562787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.562929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.563060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.563196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.563223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.563337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.563476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.563504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.563671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.563818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.563846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.563985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.564126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.564153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.451 [2024-04-23 05:14:59.564317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.564453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.451 [2024-04-23 05:14:59.564479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.451 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.564650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.564827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.564854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.565014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.565120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.565148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.565290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.565448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.565475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.565625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.565764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.565791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.565947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.566106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.566134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.566269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.566431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.566458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.566593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.566769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.566796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.566906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.567072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.567100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.567203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.567368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.567395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.567532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.567662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.567689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.567847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.567985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.568012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.568129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.568237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.568263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.568408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.568566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.568594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.568734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.568836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.568862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.569026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.569167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.569193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.569330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.569465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.569491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.569666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.569805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.569833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.569976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.570110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.570138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.570307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.570469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.570500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.570649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.570808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.570835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.570995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.571166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.571193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.571307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.571467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.571494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.571664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.571819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.571855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.572018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.572173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.572200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.572337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.572501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.572537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.572678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.572837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.572864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.572998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.573132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.573158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.573297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.573406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.573435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.573572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.573709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.573741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.573877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.574203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.574482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.574775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.574967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.575128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.575265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.575292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.575428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.575591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.575619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.575760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.575893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.575920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.576053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.576220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.576247] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.576354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.576491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.576526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.576666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.576781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.576812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.576979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.577103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.577130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.577253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.577410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.577437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.577573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.577684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.577722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.577872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.578202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.578483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.578820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.578980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.579110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.579250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.579278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.579440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.579555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.579583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.579722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.579864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.579895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.580033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.580174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.580202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.580346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.580477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.580503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.580675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.580812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.580839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.580980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.581140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.581167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.581328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.581490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.581532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.581676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.581806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.581833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.452 qpair failed and we were unable to recover it. 00:30:20.452 [2024-04-23 05:14:59.581970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.452 [2024-04-23 05:14:59.582104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.582131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.582235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.582364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.582391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.582502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.582653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.582680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.582842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.582980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.583008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.583129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.583278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.583305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.583412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.583545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.583574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.583739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.583875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.583902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.584039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.584172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.584199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.584334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.584472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.584499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.584669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.584805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.584831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.584934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.585202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.585498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.585817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.585979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.586155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.586285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.586312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.586424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.586561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.586588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.453 [2024-04-23 05:14:59.586695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.586826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.453 [2024-04-23 05:14:59.586853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.453 qpair failed and we were unable to recover it. 00:30:20.729 [2024-04-23 05:14:59.587014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.729 [2024-04-23 05:14:59.587151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.729 [2024-04-23 05:14:59.587179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.729 qpair failed and we were unable to recover it. 00:30:20.729 [2024-04-23 05:14:59.587317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.729 [2024-04-23 05:14:59.587427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.729 [2024-04-23 05:14:59.587453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.729 qpair failed and we were unable to recover it. 00:30:20.729 [2024-04-23 05:14:59.587615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.729 [2024-04-23 05:14:59.587727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.587754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.587895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.588189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.588494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.588834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.588996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.589132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.589265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.589292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.589425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.589560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.589587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.589724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.589865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.589893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.590028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.590196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.590222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.590356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.590542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.590570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.590707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.590839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.590867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.591032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.591168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.591196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.591336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.591480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.591507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.591651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.591787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.591814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.591958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.592124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.592151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.592269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.592431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.592459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.592600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.592717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.592745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.592883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.593146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.593417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.593692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.593883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.594045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.594182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.594209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.594341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.594500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.594534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.594668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.594801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.594828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.594970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.595134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.595161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.595303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.595406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.595433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.595556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.595724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.595751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.595914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.596029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.596056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.596218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.596388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.596415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.730 qpair failed and we were unable to recover it. 00:30:20.730 [2024-04-23 05:14:59.596540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.730 [2024-04-23 05:14:59.596675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.596703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.596838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.596977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.597004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.597111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.597240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.597267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.597401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.597539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.597566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.597700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.597860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.597887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.598003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.598165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.598192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.598331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.598458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.598485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.598604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.598714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.598741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.598874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.598979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.599007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.599168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.599271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.599297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.599461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.599605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.599632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.599793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.599906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.599933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.600107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.600239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.600266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.600375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.600505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.600548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.600659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.600767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.600795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.600959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.601087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.601114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41a8000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.601308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.601476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.601535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.601681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.601821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.601848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.602010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.602212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.602254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.602369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.602508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.602543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.602719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.602893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.602920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.603074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.603238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.603281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.603416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.603554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.603586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.603727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.603897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.603942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.604106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.604248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.604285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.604429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.604539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.604566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.604698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.604878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.604905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.605090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.605245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.605271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.605378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.605524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.605552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.731 qpair failed and we were unable to recover it. 00:30:20.731 [2024-04-23 05:14:59.605710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.731 [2024-04-23 05:14:59.605894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.605938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.606110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.606242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.606269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.606373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.606528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.606564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.606752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.606932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.606975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.607138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.607310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.607336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.607470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.607647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.607696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.607882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.608052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.608096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.608231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.608403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.608430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.608541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.608732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.608778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.608962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.609114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.609141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.609303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.609414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.609440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.609607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.609759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.609788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.609971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.610147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.610173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.610341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.610471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.610497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.610639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.610841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.610884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2526765 Killed "${NVMF_APP[@]}" "$@" 00:30:20.732 [2024-04-23 05:14:59.611078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.611231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.611257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 05:14:59 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:20.732 [2024-04-23 05:14:59.611387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 05:14:59 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:20.732 [2024-04-23 05:14:59.611505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.611546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 05:14:59 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:30:20.732 05:14:59 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:20.732 [2024-04-23 05:14:59.611708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 05:14:59 -- common/autotest_common.sh@10 -- # set +x 00:30:20.732 [2024-04-23 05:14:59.611904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.611947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.612114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.612291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.612317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.612454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.612615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.612660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.612822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.613182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.613415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.613672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.613803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 [2024-04-23 05:14:59.613905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.614016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 [2024-04-23 05:14:59.614042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 05:14:59 -- nvmf/common.sh@470 -- # nvmfpid=2527213 00:30:20.732 05:14:59 -- nvmf/common.sh@471 -- # waitforlisten 2527213 00:30:20.732 [2024-04-23 05:14:59.615352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 05:14:59 -- common/autotest_common.sh@817 -- # '[' -z 2527213 ']' 00:30:20.732 [2024-04-23 05:14:59.615540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 05:14:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:20.732 [2024-04-23 05:14:59.615567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.732 qpair failed and we were unable to recover it. 00:30:20.732 05:14:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:20.732 [2024-04-23 05:14:59.615690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.732 05:14:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:20.732 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:20.732 [2024-04-23 05:14:59.615835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 05:14:59 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:20.733 [2024-04-23 05:14:59.615864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 05:14:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:20.733 [2024-04-23 05:14:59.616011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 05:14:59 -- common/autotest_common.sh@10 -- # set +x 00:30:20.733 [2024-04-23 05:14:59.616146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.616173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.616332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.616440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.616467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.616626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.616803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.616850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.616991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.617122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.617150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.617278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.617445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.617472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.617623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.617788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.617814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.617940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.618097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.618127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.618293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.618434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.618460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.618646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.618806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.618850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.619007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.619160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.619186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.619301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.619424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.619452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.619594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.619770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.619813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.619998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.620149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.620174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.620315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.620479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.620505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.621257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.621404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.621432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.621607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.621753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.621796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.621980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.622134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.622161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.622305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.622454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.622480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.622622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.622783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.622810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.622966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.623125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.623168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.623336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.623451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.623478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.623640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.623789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.623819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.624001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.624139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.624164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.624299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.624411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.624436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.624578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.625224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.625253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.625434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.625542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.625575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.625693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.625799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.625825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.733 qpair failed and we were unable to recover it. 00:30:20.733 [2024-04-23 05:14:59.625988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.733 [2024-04-23 05:14:59.626130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.626158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.626266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.626366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.626392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.626491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.626631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.626657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.626773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.626892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.626919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.627081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.627222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.627248] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.627355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.627492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.627524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.627676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.627824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.627868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.627992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.628147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.628174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.628286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.628396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.628423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.628590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.628706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.628732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.628895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.629210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.629461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.629772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.629963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.630123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.630234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.630262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.630376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.630481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.630507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.630641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.630802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.630829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.630966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.631209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.631476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.631743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.631911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.632023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.632134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.632160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.632291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.632405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.632432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.734 [2024-04-23 05:14:59.632540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.632653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.734 [2024-04-23 05:14:59.632679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.734 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.632787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.632894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.632920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.633039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.633283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.633539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.633784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.633930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.634063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.634214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.634240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.634346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.634456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.634491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.634650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.634789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.634831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.634977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.635254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.635530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.635783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.635940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.636088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.636235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.636260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.636395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.636541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.636568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.636681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.636791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.636817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.636926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.637065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.637091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b4000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.637133] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19f5970 (9): Bad file descriptor 00:30:20.735 [2024-04-23 05:14:59.637288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.637444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.637474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.637632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.637740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.637768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.637910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.638208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.638490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.638779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.638941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.639077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.639179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.639203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.639341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.639473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.639499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.639628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.639779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.639806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.639975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.640083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.640108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.640241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.640347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.640372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.640491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.640616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.640642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.735 qpair failed and we were unable to recover it. 00:30:20.735 [2024-04-23 05:14:59.640749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.735 [2024-04-23 05:14:59.640889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.640914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.641068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.641317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.641584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.641829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.641964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.642099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.642230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.642256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.642371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.642485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.642512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.642634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.642740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.642770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.642879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.643185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.643458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.643715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.643855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.643968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.644212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.644479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.644722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.644852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.644990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.645290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.645554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.645787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.645957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.646093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.646247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.646273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.646380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.646484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.646510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.646640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.646754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.646780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.646884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.646988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.647014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.647146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.647305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.647331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.647442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.647549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.647575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.647690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.647798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.647824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.647933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.648038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.648064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.648171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.648336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.648366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.736 qpair failed and we were unable to recover it. 00:30:20.736 [2024-04-23 05:14:59.648473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.736 [2024-04-23 05:14:59.648602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.648629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.648737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.648850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.648876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.648990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.649148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.649174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.649288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.649421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.649446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.649584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.649692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.649719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.649828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.649993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.650019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.650150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.650279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.650304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.650438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.650550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.650577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.650688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.650800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.650825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.650930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.651211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.651493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.651745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.651874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.651985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.652293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.652537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.652794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.652957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.653063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.653295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.653573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.653828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.653963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.654077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.654211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.654236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.654347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.654452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.654478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.654601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.654714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.654739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.654850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.654982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.655007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.655128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.655244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.655270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.655380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.655488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.655512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.655644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.655756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.655782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.655916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.656034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.656059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.737 qpair failed and we were unable to recover it. 00:30:20.737 [2024-04-23 05:14:59.656160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.737 [2024-04-23 05:14:59.656269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.656299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.656406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.656509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.656541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.656649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.656763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.656789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.656893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.657156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.657455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.657733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.657900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.658006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.658140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.658166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.658303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.658437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.658462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.658584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.658691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.658718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.658821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.658989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.659015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.659150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.659261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.659287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.659396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.659508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.659541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.659651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.659761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.659787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.659921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.660194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.660478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.660735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.660865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.660978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.661115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.661142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.661278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.661386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.661411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.662128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.662280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.662307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.663013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.663190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.663217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.663332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.663493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.663528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.663666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.663783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.663809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.663911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.664049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.664074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.664212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.664314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.664339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.738 qpair failed and we were unable to recover it. 00:30:20.738 [2024-04-23 05:14:59.664452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.664558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.738 [2024-04-23 05:14:59.664584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.664690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.664802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.664827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.664941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.664981] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:30:20.739 [2024-04-23 05:14:59.665053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.665062] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:20.739 [2024-04-23 05:14:59.665079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.665216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.665346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.665369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.665485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.665606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.665631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.665741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.665904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.665931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.666094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.666242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.666268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.666371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.666537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.666565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.666675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.666787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.666813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.666926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.667177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.667479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.667736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.667868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.668016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668149] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.668290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.668563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.668837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.668994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.669283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.669442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.669469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.669592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.669699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.669725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.669860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.669965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.669991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.670125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.670230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.670256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.670395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.670557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.670582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.670697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.670821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.670847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.670980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.671116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.671142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.671277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.671411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.671437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.671565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.671679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.671707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.671843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.671986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.672012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.739 qpair failed and we were unable to recover it. 00:30:20.739 [2024-04-23 05:14:59.672156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.739 [2024-04-23 05:14:59.672267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.672292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.672398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.672507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.672542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.672666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.672802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.672827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.672963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.673240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.673500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.673767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.673900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.674022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.674173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.674198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.674338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.674507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.674542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.674656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.674759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.674785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.674914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.675164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.675477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.675749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.675912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.676052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.676167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.676193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.676329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.676463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.676488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.676633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.676740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.676765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.676898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.677230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.677471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.677736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.677899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.678040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.678291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.678319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.678490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.678638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.678664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.678768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.678869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.678894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.679059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.679204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.679229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.679366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.679479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.679504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.679641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.679778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.679804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.679944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.680085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.680110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.680241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.680346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.740 [2024-04-23 05:14:59.680371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.740 qpair failed and we were unable to recover it. 00:30:20.740 [2024-04-23 05:14:59.680503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.680628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.680655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.680767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.680879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.680904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.681013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.681286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.681564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.681807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.681981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.682143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.682244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.682269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.682396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.682544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.682570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.682675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.682787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.682814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.682928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.683204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.683488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.683758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.683882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.684026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.684163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.684188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.684296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.684456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.684481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.684594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.684709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.684735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.684866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.684999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.685025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.685150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.685288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.685314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.685447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.685580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.685611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.685725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.685870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.685895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.686038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.686150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.686176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.686336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.686474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.686500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.686621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.686724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.686749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.686890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.687174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.687427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.687685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.687820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.687955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.688100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.688127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.688263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.688380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.741 [2024-04-23 05:14:59.688409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.741 qpair failed and we were unable to recover it. 00:30:20.741 [2024-04-23 05:14:59.688533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.688672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.688697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.688804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.688918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.688946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.689057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.689188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.689213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.689335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.689441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.689467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.689611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.689730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.689755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.689880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.690165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.690475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.690735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.690869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.690984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.691257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.691537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.691798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.691958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.692093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.692223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.692248] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.692361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.692466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.692492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.692616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.692725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.692751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.692888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.693157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.693397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.693638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.693776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.693890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.694171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.694470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.694718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.694852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.694995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.695103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.695128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.695264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.695368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.695393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.695529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.695637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.695663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.695772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.696477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.696507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.742 qpair failed and we were unable to recover it. 00:30:20.742 [2024-04-23 05:14:59.696663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.742 [2024-04-23 05:14:59.696768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.696794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.696927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.697235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.697512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.697778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.697941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.698051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.698292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.698560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.698812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.698948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.699106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.699266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.699292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.699404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.699507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.699541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.699657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.699758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.699783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.699898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.700166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.700443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.700745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.700912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.701025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.701287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.701555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.701815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.701956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.702067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.702177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.702202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.702337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.702438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.702463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.702594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.702707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.702732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.702876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.703025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.703050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.703186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.703345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.703370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.743 qpair failed and we were unable to recover it. 00:30:20.743 [2024-04-23 05:14:59.703523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.743 [2024-04-23 05:14:59.703637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.703665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.703775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.703882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.703908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.704071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.704197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.704222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.704336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.704471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.704495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.704611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.704711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.704736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.704902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.705174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.705416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.705680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.705811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.705925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.706181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.706447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.706692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.706824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.744 [2024-04-23 05:14:59.706935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.707171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.707433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.707701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.707887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.708003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.708300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.708599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.708849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.708993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.709128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.709267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.709293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.709449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.709586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.709613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.709725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.709837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.709864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.709977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.710131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.710157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.710298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.710449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.710474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.710661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.710779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.710805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.710926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.711084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.711110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.744 [2024-04-23 05:14:59.711248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.711352] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:30:20.744 [2024-04-23 05:14:59.711386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.744 [2024-04-23 05:14:59.711410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.744 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.711538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.711673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.711699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.711807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.711936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.711962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.712060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.712195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.712221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.712361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.712465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.712491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.712615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.712724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.712751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.712921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.713185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.713443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.713700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.713867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.714003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.714139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.714164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.714300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.715289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.715569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.715827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.715967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.716104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.716214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.716240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.716377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.716495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.716528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.716639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.716746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.716781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.716899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.717183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.717448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.717725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.717853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.718007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.718256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.718526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.718782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.718935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.719054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.719194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.719220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.719334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.719466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.719492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.719644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.719769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.719804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.745 [2024-04-23 05:14:59.719924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.720065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.745 [2024-04-23 05:14:59.720090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.745 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.721087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.721256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.721284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.721427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.721571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.721598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.721713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.721851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.721876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.722017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.722119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.722145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.722285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.722447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.722473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.722614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.722753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.722779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.722922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.723085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.723111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.723278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.723378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.723403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.724155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.724304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.724330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.724456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.724568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.724595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.724710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.724812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.724837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.724979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.725093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.725119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.725281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.725428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.725454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.725609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.725722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.725748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.725905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.726143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.726447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.726723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.726875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.727028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.727130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.727157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.727326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.727462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.727488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.727629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.727745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.727771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.727904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.728056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.728082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.728228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.728365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.728391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.728531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.728695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.728721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.728862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.728994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.729020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.729129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.729250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.729276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.729416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.729549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.729577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.729713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.729829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.746 [2024-04-23 05:14:59.729855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.746 qpair failed and we were unable to recover it. 00:30:20.746 [2024-04-23 05:14:59.729988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.730122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.730148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.730277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.730432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.730458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.730594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.730751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.730788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.730927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.731074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.731100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.731228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.731395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.731420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.731553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.731687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.731713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.731833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.731976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.732003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.732141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.732282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.732308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.732444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.732583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.732610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.732751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.732895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.732921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.733025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.733163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.733189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.733300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.733464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.733490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.733627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.733741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.733767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.733881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.734157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.734480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.734788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.734946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.735049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.735174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.735200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.735302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.735406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.735443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.735583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.735724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.735750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.735912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.736183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.736457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.736701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.736838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.736946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.737083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.737109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.737231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.737370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.737396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.737559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.737681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.737706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.737835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.737971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.738009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.747 [2024-04-23 05:14:59.738150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.738285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.747 [2024-04-23 05:14:59.738311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.747 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.738439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.738546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.738584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.738720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.738881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.738907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.739019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.739126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.739152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.739267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.739400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.739425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.739596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.739737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.739763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.739871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.740176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.740532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.740810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.740970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.741073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.741206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.741232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.741365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.741492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.741523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.741653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.741766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.741802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.741908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.742105] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:20.748 [2024-04-23 05:14:59.742172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.742470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.742777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.742971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.743080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.743214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.743240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.743346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.743478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.743503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.743676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.743874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.743899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.744033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.744143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.744169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.744329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.744469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.744495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.744650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.744765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.744792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.744909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.745047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.745074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.748 [2024-04-23 05:14:59.745215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.745360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.748 [2024-04-23 05:14:59.745387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.748 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.745540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.745652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.745677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.745789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.745936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.745962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.746066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.746200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.746226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.746347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.746495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.746527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.746634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.746770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.746797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.746964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.747078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.747103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.747268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.747377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.747414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.747561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.747723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.747748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.747932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.748069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.748101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.748252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.748432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.748458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.748595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.748731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.748757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.748903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.749194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.749467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.749796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.749927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.750040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.750198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.750223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.750363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.750463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.750488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.750656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.750789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.750815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.750954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.751090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.751117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.751247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.751358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.751384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.751548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.751684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.751709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.751830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.751985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.752011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.752146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.752258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.752284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.752468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.752612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.752638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.752778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.752883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.752908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.753019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.753152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.753177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.753319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.753453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.753480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.753649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.753764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.753799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.749 [2024-04-23 05:14:59.753960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.754069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.749 [2024-04-23 05:14:59.754095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.749 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.754238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.754358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.754388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.754495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.754689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.754715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.754847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.755145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.755438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.755732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.755930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.756073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.756187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.756213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.756349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.756456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.756482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.756609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.756746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.756781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.756914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.757181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.757489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.757745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.757921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.758078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.758212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.758238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.758375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.758518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.758546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.758652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.758765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.758791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.758900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.759167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.759479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.759736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.759901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.760012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.760122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.760148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.760271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.760398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.760425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.760591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.760695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.760722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.760843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.761143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.761443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.761762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.761907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.762043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.762181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.762208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.750 [2024-04-23 05:14:59.762315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.762455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.750 [2024-04-23 05:14:59.762482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.750 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.762606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.762753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.762790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.762934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.763265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.763558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.763810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.763960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.764122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.764261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.764288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.764431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.764569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.764596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.764735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.764868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.764895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.765027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.765153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.765179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.765291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.765426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.765453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.765611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.765753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.765788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.765924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.766174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.766510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.766843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.766976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.767110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.767260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.767286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.767402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.767543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.767577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.767688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.767828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.767854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.768021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.768156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.768182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.768344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.768484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.768513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.768658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.768781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.768808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.768977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.769222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.769551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.769834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.769997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.770138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.770264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.770290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.770403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.770540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.770567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.770704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.770828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.770855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.770987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.771105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.751 [2024-04-23 05:14:59.771132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.751 qpair failed and we were unable to recover it. 00:30:20.751 [2024-04-23 05:14:59.771272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.771393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.771420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.771603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.771706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.771733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.771895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.772219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.772490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.772778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.772945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.773082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.773196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.773223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.773360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.773502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.773535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.773673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.773814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.773841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.773952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.774088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.774114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.774248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.774381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.774407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.774573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.774705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.774730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.774888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.774991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.775018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.775159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.775325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.775351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.775462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.775602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.775628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.775739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.775899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.775926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.776031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.776165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.776192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.776333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.776477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.776504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.776650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.776765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.776791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.776929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.777229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.777529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.777827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.777960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.778096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.778236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.778264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.778408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.778555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.752 [2024-04-23 05:14:59.778583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.752 qpair failed and we were unable to recover it. 00:30:20.752 [2024-04-23 05:14:59.778695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.778855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.778881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.779018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.779285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.779582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.779819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.779989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.780124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.780289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.780316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.780453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.780589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.780617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.780752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.780862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.780888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.781026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.781273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.781548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.781796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.781940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.782101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.782210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.782235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.782348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.782459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.782485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.782656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.782759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.782785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.782921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.783234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.783537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.783789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.783946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.784086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.784202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.784229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.784346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.784461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.784488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.784605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.784762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.784789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.784901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.785199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.785440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.785696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.785836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.785940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.786044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.786070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.786174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.786304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.786331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.786444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.786569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.786597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.753 qpair failed and we were unable to recover it. 00:30:20.753 [2024-04-23 05:14:59.786699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.753 [2024-04-23 05:14:59.786799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.786828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.786967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.787248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.787520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.787829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.787977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.788142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.788278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.788304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.788471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.788608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.788635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.788749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.788885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.788910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.789071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.789208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.789233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.789340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.789444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.789479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.789634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.789743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.789770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.789913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.790184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.790458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.790764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.790921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.791032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.791166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.791193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.791302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.791434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.791459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.791602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.791710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.791735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.791870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.792171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.792477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.792814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.792947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.793106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.793276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.793301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.793436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.793573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.793609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.793738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.793899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.793925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.794059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.794198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.794224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.794369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.794501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.794533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.794698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.794813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.794839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.794955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.795115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.754 [2024-04-23 05:14:59.795141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.754 qpair failed and we were unable to recover it. 00:30:20.754 [2024-04-23 05:14:59.795300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.795404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.795429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.795537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.795674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.795700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.795865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.795971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.795996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.796179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.796310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.796336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.796450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.796614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.796641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.796756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.796891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.796917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.797079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.797220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.797246] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.797354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.797462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.797488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.797630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.797794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.797820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.797984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.798086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.798113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.798250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.798388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.798414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.798589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.798734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.798759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.798866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.799196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.799501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.799820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.799995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.800110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.800272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.800298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.800398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.800540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.800567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.800709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.800846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.800872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.801031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.801194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.801220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.801327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.801440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.801467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.801633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.801775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.801801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.801910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.802221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.802498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.802756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.802919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.803048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.803185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.803212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.803379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.803510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.803572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.803678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.803820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.803848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.755 qpair failed and we were unable to recover it. 00:30:20.755 [2024-04-23 05:14:59.803967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.755 [2024-04-23 05:14:59.804130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.804157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.804294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.804459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.804486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.804611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.804725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.804751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.804864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.804973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.805000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.805142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.805257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.805291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.805451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.805589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.805617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.805754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.805890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.805916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.806030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.806162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.806188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.806322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.806457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.806483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.806606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.806770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.806797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.806939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.807212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.807510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.807789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.807950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.808091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.808223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.808250] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.808408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.808546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.808572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.808710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.808823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.808849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.808955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.809064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.809090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.809220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.809368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.809394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.809535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.809699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.809725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.809841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.809999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.810024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.810184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.810323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.810349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.810460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.810595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.810623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.810767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.810916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.810942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.811087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.811199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.811227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.811372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.811547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.811575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.811694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.811831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.811857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.811993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.812114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.812141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.812277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.812385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.812411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.756 qpair failed and we were unable to recover it. 00:30:20.756 [2024-04-23 05:14:59.812547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.756 [2024-04-23 05:14:59.812708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.812734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.812871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.813136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.813450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.813718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.813910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.814025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.814161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.814188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.814299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.814437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.814463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.814639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.814749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.814775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.814911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.815234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.815531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.815799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.815958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.816099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.816242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.816268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.816373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.816547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.816573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.816709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.816824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.816852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.816963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.817099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.817128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.817236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.817372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.817399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.817499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.817740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.817768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.817882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.818187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.818450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.818728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.818896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.819041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.819151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.819183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.819320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.819471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.819497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.819654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.819786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.819812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.757 qpair failed and we were unable to recover it. 00:30:20.757 [2024-04-23 05:14:59.819952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.757 [2024-04-23 05:14:59.820090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.820121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.820284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.820405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.820431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.820540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.820702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.820728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.820866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.820997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.821024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.821193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.821330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.821356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.821518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.821634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.821660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.821772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.821878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.821906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.822043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.822348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.822590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.822851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.822989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.823110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.823275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.823302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.823440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.823603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.823631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.823749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.823887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.823914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.824022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.824174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.824201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.824311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.824474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.824501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.824670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.824812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.824839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.825007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.825149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.825176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.825337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.825452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.825479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.825648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.825760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.825786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.825932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.826221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.826552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.826844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.826990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.827100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.827264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.827290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.827430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.827553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.827582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.827718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.827851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.827877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.828012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.828174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.828201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.828335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.828477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.828502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.758 qpair failed and we were unable to recover it. 00:30:20.758 [2024-04-23 05:14:59.828643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.828805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.758 [2024-04-23 05:14:59.828831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.828964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.829080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.829105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.829235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.829351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.829378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.829521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.829621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.829646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.829808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.829979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.830006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.830121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.830234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.830260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.830397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.830504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.830535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.830682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.830790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.830816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.830950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.831256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.831553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.831792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.831918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.832049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.832182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.832213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.832378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.832498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.832529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.832665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.832775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.832801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.832913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.833200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.833502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.833809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.833987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.834126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.834236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.834263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.834368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.834471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.834497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.834620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.834758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.834783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.834889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.835136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.835308] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:20.759 [2024-04-23 05:14:59.835345] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:20.759 [2024-04-23 05:14:59.835359] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:20.759 [2024-04-23 05:14:59.835371] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:20.759 [2024-04-23 05:14:59.835367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835382] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:20.759 [2024-04-23 05:14:59.835473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 [2024-04-23 05:14:59.835440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.835491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:20.759 [2024-04-23 05:14:59.835614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:20.759 [2024-04-23 05:14:59.835540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:20.759 [2024-04-23 05:14:59.835722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.835746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.835883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.836017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.836041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.759 qpair failed and we were unable to recover it. 00:30:20.759 [2024-04-23 05:14:59.836161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.759 [2024-04-23 05:14:59.836277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.836302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.836422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.836550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.836576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.836714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.836876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.836902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.837023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.837283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.837606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.837843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.837966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.838076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.838308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.838566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.838812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.838976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.839080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.839222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.839248] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.839364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.839495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.839527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.839660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.839764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.839794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.839934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.840173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.840426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.840685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.840813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.840926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.841201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.841458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.841715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.841887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.841995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.842231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.842533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.842770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.842956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.843059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.843315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.843566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.760 qpair failed and we were unable to recover it. 00:30:20.760 [2024-04-23 05:14:59.843804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.760 [2024-04-23 05:14:59.843991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.844140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.844275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.844301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.844442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.844580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.844607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.844717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.844824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.844850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.845021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.845300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.845573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.845814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.845947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.846051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.846183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.846209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.846370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.846522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.846548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.846689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.846794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.846820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.846939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.847204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.847503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.847794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.847922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.848059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.848324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.848597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.848844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.848977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.849082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.849313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.849556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.849836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.849970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.850131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.850240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.850266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.850376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.850488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.850521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.761 qpair failed and we were unable to recover it. 00:30:20.761 [2024-04-23 05:14:59.850680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.850791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.761 [2024-04-23 05:14:59.850817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.850975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.851248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.851510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.851791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.851952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.852082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.852317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.852556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.852792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.852925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.853110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.853218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.853244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.853356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.853492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.853531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.853643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.853748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.853776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.853888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.854190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.854410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.854679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.854866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.855027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.855182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.855208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.855313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.855445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.855471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.855629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.855753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.855779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.855893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.856182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.856426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.856741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.856879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.856984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.857228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.857455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.857742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.857877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.857984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.858119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.858147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.858254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.858361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.858387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.762 [2024-04-23 05:14:59.858552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.858659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.762 [2024-04-23 05:14:59.858685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.762 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.858788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.858904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.858930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.859082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.859186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.859212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.859397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.859521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.859547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.859683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.859797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.859823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.859959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.860217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.860484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.860727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.860862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.860980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.861281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.861504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.861751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.861883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.861987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.862256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.862546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.862803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.862931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.863064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.863175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.863201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.863311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.863441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.863467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.863631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.863742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.863767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.863876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.863983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.864009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.864111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.864242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.864269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.864384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.864503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.864550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.864740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.864844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.864870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.864986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.865231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.865488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.865741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.865865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.865964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.866098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.866126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.866242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.866380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.763 [2024-04-23 05:14:59.866407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.763 qpair failed and we were unable to recover it. 00:30:20.763 [2024-04-23 05:14:59.866537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.866649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.866675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.866782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.866917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.866943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.867071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.867228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.867257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.867372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.867537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.867563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.867672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.867784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.867810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.867910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.868155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.868435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.868722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.868875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.869006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.869263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.869511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.869787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.869959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.870070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.870336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.870611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.870854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.870978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.871083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.871215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.871241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.871387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.871496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.871544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.871654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.871769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.871795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.871909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.872163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.872445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.872684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.872871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.872983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.873265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.873502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.873813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.873960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.764 qpair failed and we were unable to recover it. 00:30:20.764 [2024-04-23 05:14:59.874064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.764 [2024-04-23 05:14:59.874164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.874189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.874351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.874476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.874504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.874633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.874749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.874778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.874890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.875221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.875471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.875752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.875919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.876031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.876160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.876186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.876292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.876394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.876430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:20.765 qpair failed and we were unable to recover it. 00:30:20.765 [2024-04-23 05:14:59.876543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.765 [2024-04-23 05:14:59.876652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.876677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.040 qpair failed and we were unable to recover it. 00:30:21.040 [2024-04-23 05:14:59.876784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.876894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.876920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.040 qpair failed and we were unable to recover it. 00:30:21.040 [2024-04-23 05:14:59.877052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.877217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.877243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.040 qpair failed and we were unable to recover it. 00:30:21.040 [2024-04-23 05:14:59.877379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.877510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.877542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.040 qpair failed and we were unable to recover it. 00:30:21.040 [2024-04-23 05:14:59.877681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.877784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.040 [2024-04-23 05:14:59.877811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.040 qpair failed and we were unable to recover it. 00:30:21.040 [2024-04-23 05:14:59.877914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.878177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.878450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.878694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.878837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.879002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.879135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.879160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.879270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.879403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.879429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.879562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.879703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.879729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.879862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.879990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.880017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.880167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.880279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.880306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.880437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.880538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.880565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.880673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.880781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.880807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.880918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.881176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.881444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.881745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.881905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.882034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.882276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.882545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.882780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.882922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.883110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.883217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.883242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.883371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.883480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.883505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.883645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.883776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.883806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.883917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.884164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.884441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.884748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.884911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.885024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.885129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.885154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.885291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.885401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.885426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.041 [2024-04-23 05:14:59.885533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.885641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.041 [2024-04-23 05:14:59.885666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.041 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.885764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.885865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.885890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.886030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.886281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.886568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.886831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.886992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.887126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.887268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.887293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.887443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.887555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.887582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.887721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.887834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.887860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.887960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.888219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.888460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.888709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.888835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.888954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.889241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.889494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.889745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.889881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.889986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.890263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.890492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.890763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.890902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.891001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.891256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.891554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.891797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.891929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.892027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.892159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.892185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.892316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.892428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.892454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.892588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.892728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.892754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.892856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.892981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.893007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.042 qpair failed and we were unable to recover it. 00:30:21.042 [2024-04-23 05:14:59.893143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.893270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.042 [2024-04-23 05:14:59.893296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.893400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.893500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.893531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.893666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.893896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.893922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.894083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.894190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.894216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.894329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.894443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.894469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.894582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.894690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.894717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.894854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.894985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.895011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.895144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.895242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.895268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.895430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.895570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.895596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.895703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.895821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.895849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.895950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.896238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.896508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.896786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.896920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.897026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.897295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.897562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.897803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.897938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.898069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.898329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.898604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.898870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.898998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.899130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.899261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.899286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.899384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.899525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.899551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.899650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.899760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.899786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.899901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.900187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.900450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.900730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.900889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.043 qpair failed and we were unable to recover it. 00:30:21.043 [2024-04-23 05:14:59.901004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.043 [2024-04-23 05:14:59.901115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.901140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.901274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.901435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.901461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.901573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.901715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.901741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.901879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.901986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.902013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.902149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.902257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.902282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.902416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.902546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.902571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.902673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.902782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.902809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.902952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.903221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.903511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.903807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.903959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.904077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.904175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.904200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.904337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.904494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.904525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.904629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.904729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.904755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.904894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.905220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.905452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.905714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.905846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.905955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.906250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.906545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.906816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.906953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.907058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.907288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.907560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.907805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.907968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.908076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.908183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.908208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.908317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.908425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.908450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.044 [2024-04-23 05:14:59.908553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.908675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.044 [2024-04-23 05:14:59.908701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.044 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.908806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.908970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.908995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.909138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.909241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.909266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.909370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.909473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.909498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.909624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.909763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.909789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.909919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.910177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.910443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.910692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.910833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.910991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.911238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.911478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.911729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.911862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.911979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.912212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.912494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.912760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.912949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.913081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.913213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.913239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.913353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.913454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.913480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.913597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.913733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.913764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.913864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.913993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.914019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.914137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.914248] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.914274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.914383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.914485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.914511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.045 [2024-04-23 05:14:59.914630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.914747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.045 [2024-04-23 05:14:59.914774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.045 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.914883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.915158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.915451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.915705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.915861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.915970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.916215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.916489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.916738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.916865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.917003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.917232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.917526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.917755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.917884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.918020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.918125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.918151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.918267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.918404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.918430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.918558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.918718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.918743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.918881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.919157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.919450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.919719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.919845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.919983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.920223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.920447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.920716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.920854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.920966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.921215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.921520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.921770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.921901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.922012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.922121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.922148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.046 [2024-04-23 05:14:59.922289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.922425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.046 [2024-04-23 05:14:59.922451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.046 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.922583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.922694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.922721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.922837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.922977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.923004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.923117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.923228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.923254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.923365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.923530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.923558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.923693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.923803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.923828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.923962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.924227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.924494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.924762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.924901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.925001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.925243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.925510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.925744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.925901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.926004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.926276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.926509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.926803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.926943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.927075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.927187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.927217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.927318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.927455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.927480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.927623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.927737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.927763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.927901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.928208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.928446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.928717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.928845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.928976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.929268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.929490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.929786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.929980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.047 qpair failed and we were unable to recover it. 00:30:21.047 [2024-04-23 05:14:59.930123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.047 [2024-04-23 05:14:59.930258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.930284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.930435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.930546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.930573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.930703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.930818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.930844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.930958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931087] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.931245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.931491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.931739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.931874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.932020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.932289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.932531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.932798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.932991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.933095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.933232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.933257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.933364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.933495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.933526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.933663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.933762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.933787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.933923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.934184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.934522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.934803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.934988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.935088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.935330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.935580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.935822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.935956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.936061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.936190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.936216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.936326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.936490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.936522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.936635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.936741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.936769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.936905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.937182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.937487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.937745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.937870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.048 qpair failed and we were unable to recover it. 00:30:21.048 [2024-04-23 05:14:59.938012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.048 [2024-04-23 05:14:59.938123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.938148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.938249] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.938414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.938441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.938560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.938665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.938690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.938795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.938913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.938938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.939098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.939235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.939261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.939365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.939531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.939557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.939669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.939775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.939803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.939910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.940215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.940453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.940732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.940898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.941009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.941140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.941169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.941310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.941444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.941471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.941613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.941742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.941768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.941874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.941983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.942008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.942138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.942274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.942300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.942409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.942523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.942550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.942659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.942789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.942815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.942946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.943182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.943442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.943711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.943877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.943997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.944301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.944570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.944818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.944942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.945097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.945241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.945267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.945406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.945539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.945565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.049 qpair failed and we were unable to recover it. 00:30:21.049 [2024-04-23 05:14:59.945676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.945811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.049 [2024-04-23 05:14:59.945837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.945949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.946269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.946529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.946796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.946957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.947064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.947192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.947218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.947352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.947468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.947493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.947628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.947729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.947755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.947868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.948141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.948399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.948704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.948869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.948972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.949269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.949538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.949779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.949903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.950016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.950269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.950555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.950826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.950961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.951070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.951201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.951228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.951365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.951467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.951493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.951607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.951717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.951743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.951857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.951988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.952014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.952114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.952227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.952253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.952358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.952472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.952497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.050 [2024-04-23 05:14:59.952616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.952755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.050 [2024-04-23 05:14:59.952781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.050 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.952883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.953168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.953427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.953677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.953815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.953916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.954182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.954481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.954730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.954898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.955033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.955299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.955542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.955776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.955934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.956069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.956314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.956582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.956830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.956954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.957088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.957325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.957566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.957809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.957960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.958067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.958227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.958254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.958363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.958477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.958502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.958647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.958747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.958773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.958907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.959195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.959445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.959722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.959859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.959970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.960077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.960103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.051 [2024-04-23 05:14:59.960247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.960351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.051 [2024-04-23 05:14:59.960377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.051 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.960484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.960603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.960628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.960735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.960866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.960891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.961003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.961287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.961571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.961813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.961935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.962043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.962312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.962563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.962812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.962940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.963079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.963182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.963207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.963316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.963451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.963477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.963612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.963724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.963749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.963862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.963994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.964019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.964151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.964297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.964323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.964461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.964563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.964589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.964702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.964805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.964830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.964932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.965203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.965439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.965717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.965853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.965988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.966287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.966534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.966778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.966941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.967044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.967293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.967553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.052 [2024-04-23 05:14:59.967795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.052 [2024-04-23 05:14:59.967939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.052 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.968077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.968214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.968244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.968351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.968475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.968501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.968611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 05:14:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:21.053 [2024-04-23 05:14:59.968714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.968740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 05:14:59 -- common/autotest_common.sh@850 -- # return 0 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.968839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 05:14:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:30:21.053 [2024-04-23 05:14:59.968967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.968994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 05:14:59 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:21.053 [2024-04-23 05:14:59.969097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 05:14:59 -- common/autotest_common.sh@10 -- # set +x 00:30:21.053 [2024-04-23 05:14:59.969205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.969233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.969338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.969444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.969471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.969597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.969708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.969734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.969874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.969980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.970009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.970118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.970244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.970271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.970400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.970553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.970580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.970693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.970799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.970824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.970959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.971220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.971457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.971725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.971854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.971957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.972235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.972501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.972782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.972916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.973022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973144] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.973258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.973538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.973804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.973940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.974069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.974178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.974204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.053 qpair failed and we were unable to recover it. 00:30:21.053 [2024-04-23 05:14:59.974347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.053 [2024-04-23 05:14:59.974472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.974498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.974620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.974734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.974772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.974899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.975177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.975418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.975675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.975809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.975916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.976195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.976511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.976748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.976912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.977043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.977205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.977230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.977338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.977446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.977472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.977580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.977710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.977736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.977877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.978123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.978399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.978638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.978831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.978973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.979226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.979481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.979748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.979895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.980010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.980278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.980527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.980783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.980934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.054 qpair failed and we were unable to recover it. 00:30:21.054 [2024-04-23 05:14:59.981045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.054 [2024-04-23 05:14:59.981175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.981200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.981306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.981441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.981471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.981618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.981728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.981754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.981866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.981996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.982022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.982124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.982254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.982280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.982393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.982527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.982553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.982688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.982791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.982817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.982977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.983270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.983570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.983821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.983960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.984070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.984325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.984600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.984842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.984974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.985084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.985207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.985232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.985337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.985449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.985476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.985619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.985726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.985751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.985878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.986160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.986415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.986688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.986817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.986928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.987223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.987458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.987766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.987946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.988042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.988157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.988184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.988346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.988489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.988521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.988636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.988737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.055 [2024-04-23 05:14:59.988763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.055 qpair failed and we were unable to recover it. 00:30:21.055 [2024-04-23 05:14:59.988873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.988985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.989014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.989136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.989251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.989277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.989394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.989530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.989556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.989663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.989772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.989799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.989955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.990247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.990485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.990798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.990958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.991073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.991235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.991262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.991396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.991507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.991560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.991670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.991797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.991822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.991933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 05:14:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:21.056 [2024-04-23 05:14:59.992066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.992094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.992199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 05:14:59 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:21.056 [2024-04-23 05:14:59.992309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.992336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 05:14:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:21.056 [2024-04-23 05:14:59.992502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.992657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 05:14:59 -- common/autotest_common.sh@10 -- # set +x 00:30:21.056 [2024-04-23 05:14:59.992683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.992785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.992918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.992943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.993085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.993337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.993614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.993845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.993968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.994099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.994345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.994611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.994869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.994991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.995113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.995259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.995285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.995387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.995491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.995523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.995644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.995750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.995776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.995913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.996016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.996041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.996140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.996247] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.056 [2024-04-23 05:14:59.996272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.056 qpair failed and we were unable to recover it. 00:30:21.056 [2024-04-23 05:14:59.996376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.996489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.996521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.996643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.996758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.996791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.996892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.997152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.997388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.997698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.997865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.997976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.998208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.998470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.998714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.998869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.998980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.999212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.999481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:14:59.999748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:14:59.999904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.000014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.000128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.000154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.000290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.000407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.000433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.000582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.000738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.000778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.000925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.001236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.001496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.001771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.001908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.002022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.002298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.002554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.002805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.002939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.003038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.003348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.003601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.003856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.003994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.057 qpair failed and we were unable to recover it. 00:30:21.057 [2024-04-23 05:15:00.004132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.057 [2024-04-23 05:15:00.004236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.004262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.004409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.004522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.004549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.004670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.004850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.004876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.005008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.005123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.005149] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.005256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.005387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.005413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.005529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.005760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.005786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.006014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.006285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.006568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.006809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.006973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.007091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.007228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.007254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.007382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.007554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.007581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.007737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.007861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.007886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.008022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.008292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.008557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.008803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.008950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.009068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.009206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.009232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.009341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.009478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.009503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.009616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.009729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.009754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.009886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.010184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.010437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.010726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.010876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.011015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.011137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.011185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.011352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.011562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.011605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.012316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.012460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.012491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.012633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.012758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.012786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.058 [2024-04-23 05:15:00.012909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.013051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.058 [2024-04-23 05:15:00.013076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.058 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.013213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.013332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.013367] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.013523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.013647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.013681] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.013807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.013941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.013976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.014134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.014286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.014323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.014502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.014642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.014677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.014820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.014943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.014978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.015116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.015254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.015288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.015412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.015577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.015612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19e7e40 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.015776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.015931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.015959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.016098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.016222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.016249] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.016378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.016527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.016554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.016671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.016785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.016811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.016919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.017172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.017427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.017704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.017868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.017983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.018265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.018534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 [2024-04-23 05:15:00.018785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.018946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 Malloc0 00:30:21.059 [2024-04-23 05:15:00.019092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.019200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.019227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 05:15:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:21.059 [2024-04-23 05:15:00.019354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.019465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.019490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 05:15:00 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:21.059 [2024-04-23 05:15:00.019617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 05:15:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:21.059 [2024-04-23 05:15:00.019731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.019756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.059 05:15:00 -- common/autotest_common.sh@10 -- # set +x 00:30:21.059 [2024-04-23 05:15:00.019858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.019968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.059 [2024-04-23 05:15:00.019994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.059 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.020116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.020229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.020255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.020379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.020494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.020528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.020646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.020770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.020795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.020917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.021199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.021457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.021771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.021910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.022015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.022265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.022529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.022733] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:21.060 [2024-04-23 05:15:00.022787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.022918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.023029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.023296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.023535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.023829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.023965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.024079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.024183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.024215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.024333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.024443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.024468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.024617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.024730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.024757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.024902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.025133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.025377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.025664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.025805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.025915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.026159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.026394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.026681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.026828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.026931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.027061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.027086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.027202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.027316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.027341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.060 qpair failed and we were unable to recover it. 00:30:21.060 [2024-04-23 05:15:00.027470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.060 [2024-04-23 05:15:00.027618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.027644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.027747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.027857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.027884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.027996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.028246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.028501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.028779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.028951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.029088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.029326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.029584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.029857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.029990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.030099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.030218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.030245] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.030382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.030497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.030531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.030659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.030765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.030796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.030899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.031037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.031062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 05:15:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:21.061 [2024-04-23 05:15:00.031173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 05:15:00 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:21.061 [2024-04-23 05:15:00.031315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.031341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 05:15:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.031442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 05:15:00 -- common/autotest_common.sh@10 -- # set +x 00:30:21.061 [2024-04-23 05:15:00.031554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.031587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.031723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.031841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.031867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.031979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.032253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.032507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.032752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.032924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.033033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.033281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.033543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.033803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.033938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.034060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.034192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.034217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.034332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.034428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.034453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.034568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.034681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.034706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.061 qpair failed and we were unable to recover it. 00:30:21.061 [2024-04-23 05:15:00.034870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.061 [2024-04-23 05:15:00.035001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.035027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.035141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.035246] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.035272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.035374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.035485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.035511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.035647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.035767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.035798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.035912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.036210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.036438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.036740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.036869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.037000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.037232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.037499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.037734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.037886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.037993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.038259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.038520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.038781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.038924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 05:15:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:21.062 [2024-04-23 05:15:00.039038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.039149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.039174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b9 05:15:00 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:21.062 0 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 05:15:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:21.062 [2024-04-23 05:15:00.039314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 05:15:00 -- common/autotest_common.sh@10 -- # set +x 00:30:21.062 [2024-04-23 05:15:00.039423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.039450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.039573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.039680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.039705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.039843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.039951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.039978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.040088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.040320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.040563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.040809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.040965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.041064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.041174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.041199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.041332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.041438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.041464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.041658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.041771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.041798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.041930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.042063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.042089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.062 qpair failed and we were unable to recover it. 00:30:21.062 [2024-04-23 05:15:00.042200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.042334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.062 [2024-04-23 05:15:00.042360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.042480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.042593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.042620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.042738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.042842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.042869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.042978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.043220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.043486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.043732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.043859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.043997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.044117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.044143] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.044276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.044386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.044417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.044535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.046382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.046426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.046593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.046711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.046739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.046862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.046975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.047000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 05:15:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:21.063 [2024-04-23 05:15:00.047121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 05:15:00 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:21.063 [2024-04-23 05:15:00.047225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.047252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 05:15:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:21.063 [2024-04-23 05:15:00.047372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 05:15:00 -- common/autotest_common.sh@10 -- # set +x 00:30:21.063 [2024-04-23 05:15:00.047479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.047507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.047630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.047739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.047765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.047898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.048142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.048383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.048659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.048810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.048934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.049187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.049441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.049740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.049880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.049996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.050134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.050160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.063 qpair failed and we were unable to recover it. 00:30:21.063 [2024-04-23 05:15:00.050271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.050375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.063 [2024-04-23 05:15:00.050401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.050525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.064 [2024-04-23 05:15:00.050630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.064 [2024-04-23 05:15:00.050658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.050776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.064 [2024-04-23 05:15:00.050878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.064 [2024-04-23 05:15:00.050905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f41b0000b90 with addr=10.0.0.2, port=4420 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.051065] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:21.064 [2024-04-23 05:15:00.053488] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.053648] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.053683] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.053700] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.053714] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.053749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 05:15:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:21.064 05:15:00 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:21.064 05:15:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:21.064 05:15:00 -- common/autotest_common.sh@10 -- # set +x 00:30:21.064 05:15:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:21.064 05:15:00 -- host/target_disconnect.sh@58 -- # wait 2526801 00:30:21.064 [2024-04-23 05:15:00.063318] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.063445] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.063473] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.063488] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.063501] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.063538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.073366] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.073502] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.073549] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.073565] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.073578] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.073608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.083330] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.083455] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.083486] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.083501] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.083521] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.083552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.093378] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.093507] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.093544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.093559] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.093572] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.093601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.103367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.103484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.103509] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.103532] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.103546] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.103575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.113356] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.113463] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.113490] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.113505] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.113529] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.113561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.123389] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.123506] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.123538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.123562] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.123575] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.123604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.133420] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.133555] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.133582] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.133596] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.133614] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.133644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.143438] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.143554] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.143579] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.143594] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.143607] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.143635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.153470] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.153592] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.153620] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.153634] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.153647] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.064 [2024-04-23 05:15:00.153677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.064 qpair failed and we were unable to recover it. 00:30:21.064 [2024-04-23 05:15:00.163539] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.064 [2024-04-23 05:15:00.163669] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.064 [2024-04-23 05:15:00.163696] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.064 [2024-04-23 05:15:00.163711] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.064 [2024-04-23 05:15:00.163723] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.065 [2024-04-23 05:15:00.163753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.065 qpair failed and we were unable to recover it. 00:30:21.065 [2024-04-23 05:15:00.173590] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.065 [2024-04-23 05:15:00.173711] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.065 [2024-04-23 05:15:00.173738] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.065 [2024-04-23 05:15:00.173753] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.065 [2024-04-23 05:15:00.173765] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.065 [2024-04-23 05:15:00.173794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.065 qpair failed and we were unable to recover it. 00:30:21.065 [2024-04-23 05:15:00.183618] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.065 [2024-04-23 05:15:00.183750] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.065 [2024-04-23 05:15:00.183776] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.065 [2024-04-23 05:15:00.183791] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.065 [2024-04-23 05:15:00.183804] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.065 [2024-04-23 05:15:00.183832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.065 qpair failed and we were unable to recover it. 00:30:21.325 [2024-04-23 05:15:00.193604] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.325 [2024-04-23 05:15:00.193718] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.325 [2024-04-23 05:15:00.193743] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.325 [2024-04-23 05:15:00.193758] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.325 [2024-04-23 05:15:00.193771] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.325 [2024-04-23 05:15:00.193800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.325 qpair failed and we were unable to recover it. 00:30:21.325 [2024-04-23 05:15:00.203632] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.325 [2024-04-23 05:15:00.203756] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.325 [2024-04-23 05:15:00.203781] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.325 [2024-04-23 05:15:00.203796] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.325 [2024-04-23 05:15:00.203812] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.325 [2024-04-23 05:15:00.203841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.325 qpair failed and we were unable to recover it. 00:30:21.325 [2024-04-23 05:15:00.213720] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.325 [2024-04-23 05:15:00.213880] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.325 [2024-04-23 05:15:00.213907] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.325 [2024-04-23 05:15:00.213922] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.325 [2024-04-23 05:15:00.213935] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.325 [2024-04-23 05:15:00.213964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.325 qpair failed and we were unable to recover it. 00:30:21.325 [2024-04-23 05:15:00.223756] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.325 [2024-04-23 05:15:00.223874] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.325 [2024-04-23 05:15:00.223899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.325 [2024-04-23 05:15:00.223921] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.325 [2024-04-23 05:15:00.223936] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.325 [2024-04-23 05:15:00.223967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.325 qpair failed and we were unable to recover it. 00:30:21.325 [2024-04-23 05:15:00.233834] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.325 [2024-04-23 05:15:00.233969] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.325 [2024-04-23 05:15:00.233994] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.234008] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.234020] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.234063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.243745] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.243883] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.243910] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.243925] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.243938] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.243967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.253766] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.253874] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.253899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.253913] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.253926] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.253955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.263818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.263934] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.263961] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.263975] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.263987] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.264016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.273844] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.273956] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.273983] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.273998] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.274010] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.274040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.283857] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.283974] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.283999] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.284013] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.284027] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.284055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.293908] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.294024] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.294049] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.294063] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.294077] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.294105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.303960] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.304086] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.304111] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.304126] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.304139] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.304167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.313957] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.314067] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.314092] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.314111] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.314126] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.314155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.324006] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.324130] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.324155] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.324169] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.324182] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.324211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.334028] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.334157] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.334185] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.334203] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.334216] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.334247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.344068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.344182] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.344209] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.344224] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.344237] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.344267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.354064] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.354181] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.354207] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.354221] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.326 [2024-04-23 05:15:00.354233] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.326 [2024-04-23 05:15:00.354262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.326 qpair failed and we were unable to recover it. 00:30:21.326 [2024-04-23 05:15:00.364082] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.326 [2024-04-23 05:15:00.364209] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.326 [2024-04-23 05:15:00.364235] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.326 [2024-04-23 05:15:00.364250] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.364262] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.364290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.374122] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.374250] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.374274] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.374288] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.374302] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.374330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.384184] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.384299] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.384324] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.384339] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.384351] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.384392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.394171] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.394273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.394298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.394312] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.394324] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.394353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.404203] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.404333] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.404366] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.404382] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.404395] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.404425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.414242] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.414389] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.414416] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.414430] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.414443] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.414472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.424260] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.424385] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.424411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.424426] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.424439] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.424468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.434283] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.434397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.434423] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.434437] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.434449] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.434478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.444305] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.444424] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.444449] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.444463] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.444476] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.444510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.454358] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.454475] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.454501] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.454523] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.454538] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.454566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.464462] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.464592] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.464619] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.464633] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.464645] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.464675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.474389] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.474509] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.474542] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.474557] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.474570] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.474599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.327 [2024-04-23 05:15:00.484413] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.327 [2024-04-23 05:15:00.484535] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.327 [2024-04-23 05:15:00.484561] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.327 [2024-04-23 05:15:00.484576] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.327 [2024-04-23 05:15:00.484588] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.327 [2024-04-23 05:15:00.484617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.327 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.494577] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.494701] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.494738] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.494755] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.494768] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.494798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.504460] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.504596] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.504622] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.504636] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.504648] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.504678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.514480] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.514608] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.514633] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.514647] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.514660] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.514689] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.524631] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.524757] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.524784] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.524805] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.524818] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.524847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.534615] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.534732] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.534758] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.534773] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.534790] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.534820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.544587] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.544703] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.544729] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.544744] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.544756] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.544784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.554652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.554778] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.554804] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.554827] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.554840] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.554869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.564678] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.564810] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.564837] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.564852] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.564865] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.564894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.574795] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.574923] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.574948] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.574962] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.574974] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.575004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.584701] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.584826] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.584854] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.584869] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.584884] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.584913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.594740] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.588 [2024-04-23 05:15:00.594860] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.588 [2024-04-23 05:15:00.594887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.588 [2024-04-23 05:15:00.594901] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.588 [2024-04-23 05:15:00.594913] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.588 [2024-04-23 05:15:00.594942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.588 qpair failed and we were unable to recover it. 00:30:21.588 [2024-04-23 05:15:00.604801] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.604937] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.604962] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.604977] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.604989] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.605018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.614848] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.615007] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.615033] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.615048] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.615060] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.615089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.624828] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.624959] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.624985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.625002] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.625022] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.625068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.634828] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.634936] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.634963] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.634978] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.634991] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.635020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.644956] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.645088] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.645114] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.645129] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.645142] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.645171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.654879] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.654997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.655023] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.655038] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.655050] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.655079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.664946] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.665103] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.665130] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.665146] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.665162] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.665207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.674938] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.675082] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.675107] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.675121] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.675133] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.675162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.684985] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.685107] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.685133] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.685148] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.685160] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.685189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.695032] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.695150] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.695176] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.695191] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.695203] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.695231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.705028] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.705147] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.705172] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.705187] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.705199] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.705228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.715059] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.715186] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.715212] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.715231] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.715244] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.715273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.725148] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.725264] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.725291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.589 [2024-04-23 05:15:00.725305] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.589 [2024-04-23 05:15:00.725318] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.589 [2024-04-23 05:15:00.725347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.589 qpair failed and we were unable to recover it. 00:30:21.589 [2024-04-23 05:15:00.735132] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.589 [2024-04-23 05:15:00.735253] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.589 [2024-04-23 05:15:00.735278] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.590 [2024-04-23 05:15:00.735293] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.590 [2024-04-23 05:15:00.735305] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.590 [2024-04-23 05:15:00.735334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.590 qpair failed and we were unable to recover it. 00:30:21.590 [2024-04-23 05:15:00.745162] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.590 [2024-04-23 05:15:00.745273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.590 [2024-04-23 05:15:00.745298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.590 [2024-04-23 05:15:00.745312] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.590 [2024-04-23 05:15:00.745324] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.590 [2024-04-23 05:15:00.745354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.590 qpair failed and we were unable to recover it. 00:30:21.849 [2024-04-23 05:15:00.755190] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.849 [2024-04-23 05:15:00.755314] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.849 [2024-04-23 05:15:00.755341] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.849 [2024-04-23 05:15:00.755355] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.849 [2024-04-23 05:15:00.755367] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.849 [2024-04-23 05:15:00.755396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.849 qpair failed and we were unable to recover it. 00:30:21.849 [2024-04-23 05:15:00.765259] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.849 [2024-04-23 05:15:00.765419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.849 [2024-04-23 05:15:00.765445] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.849 [2024-04-23 05:15:00.765459] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.849 [2024-04-23 05:15:00.765472] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.849 [2024-04-23 05:15:00.765500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.849 qpair failed and we were unable to recover it. 00:30:21.849 [2024-04-23 05:15:00.775257] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.849 [2024-04-23 05:15:00.775374] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.849 [2024-04-23 05:15:00.775401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.849 [2024-04-23 05:15:00.775415] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.849 [2024-04-23 05:15:00.775428] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.849 [2024-04-23 05:15:00.775457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.849 qpair failed and we were unable to recover it. 00:30:21.849 [2024-04-23 05:15:00.785364] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.849 [2024-04-23 05:15:00.785490] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.849 [2024-04-23 05:15:00.785532] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.849 [2024-04-23 05:15:00.785549] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.849 [2024-04-23 05:15:00.785561] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.849 [2024-04-23 05:15:00.785590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.849 qpair failed and we were unable to recover it. 00:30:21.849 [2024-04-23 05:15:00.795335] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.849 [2024-04-23 05:15:00.795457] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.849 [2024-04-23 05:15:00.795483] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.849 [2024-04-23 05:15:00.795497] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.849 [2024-04-23 05:15:00.795524] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.849 [2024-04-23 05:15:00.795555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.849 qpair failed and we were unable to recover it. 00:30:21.849 [2024-04-23 05:15:00.805317] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.849 [2024-04-23 05:15:00.805448] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.849 [2024-04-23 05:15:00.805478] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.849 [2024-04-23 05:15:00.805493] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.805525] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.805556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.815382] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.815501] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.815544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.815559] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.815571] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.815600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.825369] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.825510] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.825544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.825568] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.825580] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.825609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.835426] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.835552] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.835579] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.835593] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.835606] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.835634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.845452] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.845598] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.845624] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.845639] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.845652] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.845686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.855637] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.855768] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.855794] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.855820] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.855832] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.855861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.865551] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.865667] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.865693] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.865708] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.865721] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.865750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.875621] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.875727] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.875753] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.875767] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.875780] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.875820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.885638] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.885757] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.885783] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.885808] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.885821] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.885849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.895712] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.895844] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.895875] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.895891] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.895903] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.895932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.905646] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.905824] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.905852] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.905870] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.905898] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.905928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.915634] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.915753] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.915780] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.915794] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.850 [2024-04-23 05:15:00.915810] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.850 [2024-04-23 05:15:00.915839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.850 qpair failed and we were unable to recover it. 00:30:21.850 [2024-04-23 05:15:00.925726] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.850 [2024-04-23 05:15:00.925885] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.850 [2024-04-23 05:15:00.925911] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.850 [2024-04-23 05:15:00.925925] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.925937] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.925966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:00.935713] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:00.935826] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:00.935852] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:00.935867] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.935885] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.935915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:00.945848] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:00.945967] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:00.945993] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:00.946007] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.946020] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.946050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:00.955785] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:00.955928] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:00.955953] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:00.955967] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.955979] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.956024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:00.965841] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:00.965994] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:00.966021] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:00.966035] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.966048] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.966076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:00.975832] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:00.975949] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:00.975976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:00.975990] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.976002] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.976031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:00.985853] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:00.985981] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:00.986007] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:00.986021] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.986033] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.986077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:00.995877] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:00.995998] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:00.996022] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:00.996036] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:00.996049] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:00.996077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:21.851 [2024-04-23 05:15:01.005880] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.851 [2024-04-23 05:15:01.005996] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.851 [2024-04-23 05:15:01.006021] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.851 [2024-04-23 05:15:01.006036] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.851 [2024-04-23 05:15:01.006048] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:21.851 [2024-04-23 05:15:01.006077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:21.851 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.015920] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.016042] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.016068] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.016083] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.016096] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:22.111 [2024-04-23 05:15:01.016125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.026024] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.026137] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.026163] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.026178] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.026196] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:22.111 [2024-04-23 05:15:01.026226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.036008] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.036155] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.036182] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.036196] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.036223] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:22.111 [2024-04-23 05:15:01.036253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.046111] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.046225] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.046250] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.046264] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.046276] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:22.111 [2024-04-23 05:15:01.046305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.056072] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.056194] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.056220] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.056235] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.056247] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:22.111 [2024-04-23 05:15:01.056275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.066059] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.066172] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.066198] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.066212] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.066225] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f41b0000b90 00:30:22.111 [2024-04-23 05:15:01.066254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.076097] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.076227] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.076261] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.076277] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.076290] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.111 [2024-04-23 05:15:01.076319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.086129] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.086257] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.086286] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.086300] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.086313] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.111 [2024-04-23 05:15:01.086340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.096133] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.096253] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.096281] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.096296] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.096308] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.111 [2024-04-23 05:15:01.096336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.106178] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.106345] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.106372] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.106387] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.111 [2024-04-23 05:15:01.106414] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.111 [2024-04-23 05:15:01.106441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.111 qpair failed and we were unable to recover it. 00:30:22.111 [2024-04-23 05:15:01.116227] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.111 [2024-04-23 05:15:01.116387] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.111 [2024-04-23 05:15:01.116415] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.111 [2024-04-23 05:15:01.116435] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.116449] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.116491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.126225] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.126356] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.126381] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.126396] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.126408] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.126436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.136279] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.136409] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.136436] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.136451] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.136464] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.136491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.146373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.146488] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.146522] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.146538] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.146551] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.146579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.156304] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.156419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.156446] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.156461] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.156473] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.156500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.166389] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.166539] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.166566] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.166581] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.166593] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.166621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.176363] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.176479] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.176506] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.176530] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.176543] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.176571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.186390] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.186521] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.186548] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.186563] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.186575] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.186603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.196424] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.196562] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.196589] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.196603] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.196616] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.196643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.206529] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.206663] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.206690] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.206710] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.206724] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.206751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.216501] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.216632] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.216658] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.216673] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.216686] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.216714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.226603] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.226712] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.226738] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.226753] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.226766] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.226793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.236552] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.236661] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.236688] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.236704] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.236716] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.236744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.246608] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.246732] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.246759] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.246774] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.246787] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.246821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.256617] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.256778] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.256804] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.256819] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.256832] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.256859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.112 [2024-04-23 05:15:01.266640] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.112 [2024-04-23 05:15:01.266766] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.112 [2024-04-23 05:15:01.266792] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.112 [2024-04-23 05:15:01.266809] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.112 [2024-04-23 05:15:01.266822] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.112 [2024-04-23 05:15:01.266849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.112 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.276649] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.276760] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.276788] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.276814] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.276827] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.276856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.286704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.286820] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.286848] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.286863] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.286875] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.286903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.296720] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.296829] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.296861] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.296877] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.296890] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.296917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.306744] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.306855] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.306885] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.306899] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.306912] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.306939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.316796] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.316919] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.316945] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.316960] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.316973] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.317000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.326869] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.327032] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.327058] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.327073] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.327086] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.327113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.336874] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.337020] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.337047] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.337062] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.337075] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.337102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.346897] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.347005] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.347032] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.347047] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.347059] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.347086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.356909] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.357013] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.357040] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.357055] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.357067] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.357094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.366964] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.367133] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.367169] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.367184] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.372 [2024-04-23 05:15:01.367196] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.372 [2024-04-23 05:15:01.367224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.372 qpair failed and we were unable to recover it. 00:30:22.372 [2024-04-23 05:15:01.376973] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.372 [2024-04-23 05:15:01.377094] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.372 [2024-04-23 05:15:01.377121] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.372 [2024-04-23 05:15:01.377136] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.377149] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.377178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.386992] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.387114] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.387147] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.387163] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.387176] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.387205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.396995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.397106] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.397132] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.397146] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.397159] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.397186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.407064] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.407191] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.407215] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.407230] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.407243] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.407271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.417086] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.417198] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.417224] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.417239] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.417251] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.417278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.427102] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.427211] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.427237] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.427252] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.427265] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.427298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.437204] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.437311] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.437338] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.437368] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.437380] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.437407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.447173] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.447284] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.447311] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.447326] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.447339] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.447367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.457177] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.457286] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.457312] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.457327] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.457340] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.457367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.467256] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.467375] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.467400] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.467414] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.467427] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.467455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.477242] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.477358] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.477391] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.477406] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.477419] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.477446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.487279] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.487422] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.487450] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.487465] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.487477] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.487505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.497298] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.497436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.497465] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.497481] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.497498] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.497534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.507327] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.373 [2024-04-23 05:15:01.507442] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.373 [2024-04-23 05:15:01.507469] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.373 [2024-04-23 05:15:01.507484] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.373 [2024-04-23 05:15:01.507500] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.373 [2024-04-23 05:15:01.507537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.373 qpair failed and we were unable to recover it. 00:30:22.373 [2024-04-23 05:15:01.517342] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.374 [2024-04-23 05:15:01.517455] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.374 [2024-04-23 05:15:01.517481] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.374 [2024-04-23 05:15:01.517496] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.374 [2024-04-23 05:15:01.517511] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.374 [2024-04-23 05:15:01.517554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.374 qpair failed and we were unable to recover it. 00:30:22.374 [2024-04-23 05:15:01.527385] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.374 [2024-04-23 05:15:01.527543] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.374 [2024-04-23 05:15:01.527576] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.374 [2024-04-23 05:15:01.527590] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.374 [2024-04-23 05:15:01.527603] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.374 [2024-04-23 05:15:01.527631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.374 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.537465] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.537627] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.537655] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.537670] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.537683] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.537712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.547431] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.547550] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.547578] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.547593] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.547605] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.547633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.557473] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.557588] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.557614] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.557629] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.557642] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.557669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.567504] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.567646] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.567679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.567697] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.567710] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.567738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.577543] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.577657] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.577685] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.577701] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.577717] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.577747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.587564] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.587683] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.587710] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.587725] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.587738] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.587766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.597672] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.597810] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.597836] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.597856] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.597869] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.597897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.607624] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.607743] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.607769] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.607784] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.607802] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.607836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.617646] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.617774] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.617801] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.617817] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.617829] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.617857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.627687] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.627831] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.627856] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.627871] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.627884] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.810 [2024-04-23 05:15:01.627913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.810 qpair failed and we were unable to recover it. 00:30:22.810 [2024-04-23 05:15:01.637739] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.810 [2024-04-23 05:15:01.637860] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.810 [2024-04-23 05:15:01.637887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.810 [2024-04-23 05:15:01.637903] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.810 [2024-04-23 05:15:01.637916] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.637944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.647744] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.647878] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.647903] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.647918] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.647931] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.647959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.657839] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.657955] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.657980] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.657995] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.658008] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.658036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.667792] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.667903] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.667928] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.667942] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.667956] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.667984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.677808] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.677924] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.677948] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.677962] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.677975] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.678002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.687888] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.688042] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.688068] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.688083] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.688096] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.688124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.697878] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.697996] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.698024] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.698039] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.698058] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.698086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.707877] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.708031] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.708058] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.708073] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.708086] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.708128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.717894] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.718016] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.718043] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.718058] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.718071] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.718098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.727969] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.728084] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.728111] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.728125] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.728139] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.728166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.738053] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.738166] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.738192] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.738207] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.738220] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.738247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.748039] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.748200] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.748226] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.748241] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.748253] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.748295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.758007] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.758114] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.758140] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.758154] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.758167] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.758196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.768049] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.768177] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.768201] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.768216] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.768229] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.768256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.778115] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.778237] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.778262] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.778277] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.778290] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.778317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.788121] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.788235] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.788261] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.788275] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.788293] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.788322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.798179] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.798301] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.798326] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.798341] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.798354] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.798382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.808193] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.808346] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.808376] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.808392] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.808406] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.808435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.818215] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.818334] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.818360] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.818374] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.818387] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.818414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.828288] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.828402] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.828427] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.828441] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.828454] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.828482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.838263] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.838376] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.838403] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.838418] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.838431] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.838458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.848296] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.848455] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.848482] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.848497] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.848509] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.848545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.858301] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.858435] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.858462] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.858476] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.858489] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.858525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.868361] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.868471] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.868495] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.868509] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.868530] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.868559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.878382] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.878497] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.878528] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.878549] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.878570] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.878598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.888449] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.888570] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.888594] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.888609] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.888621] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.888649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.898444] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.898563] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.898589] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.898603] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.898616] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.898644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.908542] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.908681] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.908708] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.908723] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.908736] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.908764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.918469] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.918585] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.918610] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.918625] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.918637] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.918665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.928526] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.928672] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.928699] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.928714] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.928727] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.928754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.938536] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.938654] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.938680] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.938696] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.938708] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.938735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.948559] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.948663] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.948688] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.811 [2024-04-23 05:15:01.948702] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.811 [2024-04-23 05:15:01.948715] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.811 [2024-04-23 05:15:01.948742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.811 qpair failed and we were unable to recover it. 00:30:22.811 [2024-04-23 05:15:01.958587] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.811 [2024-04-23 05:15:01.958695] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.811 [2024-04-23 05:15:01.958719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.812 [2024-04-23 05:15:01.958733] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.812 [2024-04-23 05:15:01.958746] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.812 [2024-04-23 05:15:01.958774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.812 qpair failed and we were unable to recover it. 00:30:22.812 [2024-04-23 05:15:01.968661] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.812 [2024-04-23 05:15:01.968779] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.812 [2024-04-23 05:15:01.968806] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.812 [2024-04-23 05:15:01.968826] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.812 [2024-04-23 05:15:01.968839] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:22.812 [2024-04-23 05:15:01.968866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:22.812 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:01.978701] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:01.978819] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:01.978847] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:01.978862] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:01.978875] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:01.978903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:01.988803] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:01.988966] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:01.988993] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:01.989008] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:01.989020] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:01.989063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:01.998720] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:01.998839] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:01.998876] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:01.998891] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:01.998904] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:01.998932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.008787] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.008909] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.008934] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.008949] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.008961] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.008989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.018806] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.018969] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.018994] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.019009] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.019021] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.019049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.028923] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.029050] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.029075] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.029089] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.029106] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.029134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.038796] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.038909] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.038934] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.038948] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.038960] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.038988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.048882] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.048996] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.049021] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.049035] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.049048] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.049074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.058903] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.059013] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.059038] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.059057] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.059071] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.059098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.068925] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.069074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.069099] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.069114] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.069126] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.069154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.078907] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.079030] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.079054] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.079069] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.079082] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.079109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.088993] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.089107] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.089133] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.089148] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.089161] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.089188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.099021] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.099142] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.099167] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.099182] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.099196] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.099223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.109048] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.109181] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.109208] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.109224] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.109240] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.109269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.119018] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.119129] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.119156] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.119170] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.119183] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.119211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.129098] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.129212] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.129238] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.129253] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.129266] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.129293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.139116] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.139230] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.139255] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.139269] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.139282] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.139310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.149148] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.149261] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.149291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.149307] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.149320] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.149347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.159150] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.159286] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.159311] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.159326] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.159339] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.159380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.169178] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.072 [2024-04-23 05:15:02.169291] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.072 [2024-04-23 05:15:02.169316] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.072 [2024-04-23 05:15:02.169330] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.072 [2024-04-23 05:15:02.169343] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.072 [2024-04-23 05:15:02.169370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.072 qpair failed and we were unable to recover it. 00:30:23.072 [2024-04-23 05:15:02.179190] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.073 [2024-04-23 05:15:02.179302] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.073 [2024-04-23 05:15:02.179328] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.073 [2024-04-23 05:15:02.179343] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.073 [2024-04-23 05:15:02.179355] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.073 [2024-04-23 05:15:02.179383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.073 qpair failed and we were unable to recover it. 00:30:23.073 [2024-04-23 05:15:02.189230] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.073 [2024-04-23 05:15:02.189340] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.073 [2024-04-23 05:15:02.189366] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.073 [2024-04-23 05:15:02.189380] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.073 [2024-04-23 05:15:02.189393] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.073 [2024-04-23 05:15:02.189426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.073 qpair failed and we were unable to recover it. 00:30:23.073 [2024-04-23 05:15:02.199248] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.073 [2024-04-23 05:15:02.199353] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.073 [2024-04-23 05:15:02.199378] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.073 [2024-04-23 05:15:02.199393] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.073 [2024-04-23 05:15:02.199406] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.073 [2024-04-23 05:15:02.199433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.073 qpair failed and we were unable to recover it. 00:30:23.073 [2024-04-23 05:15:02.209316] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.073 [2024-04-23 05:15:02.209447] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.073 [2024-04-23 05:15:02.209472] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.073 [2024-04-23 05:15:02.209487] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.073 [2024-04-23 05:15:02.209499] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.073 [2024-04-23 05:15:02.209534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.073 qpair failed and we were unable to recover it. 00:30:23.073 [2024-04-23 05:15:02.219319] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.073 [2024-04-23 05:15:02.219441] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.073 [2024-04-23 05:15:02.219466] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.073 [2024-04-23 05:15:02.219482] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.073 [2024-04-23 05:15:02.219494] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.073 [2024-04-23 05:15:02.219529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.073 qpair failed and we were unable to recover it. 00:30:23.073 [2024-04-23 05:15:02.229336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.073 [2024-04-23 05:15:02.229442] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.073 [2024-04-23 05:15:02.229467] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.073 [2024-04-23 05:15:02.229482] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.073 [2024-04-23 05:15:02.229495] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.073 [2024-04-23 05:15:02.229530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.073 qpair failed and we were unable to recover it. 00:30:23.331 [2024-04-23 05:15:02.239369] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.331 [2024-04-23 05:15:02.239481] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.331 [2024-04-23 05:15:02.239512] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.331 [2024-04-23 05:15:02.239535] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.331 [2024-04-23 05:15:02.239548] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.331 [2024-04-23 05:15:02.239577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.331 qpair failed and we were unable to recover it. 00:30:23.331 [2024-04-23 05:15:02.249403] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.331 [2024-04-23 05:15:02.249524] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.331 [2024-04-23 05:15:02.249551] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.331 [2024-04-23 05:15:02.249565] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.331 [2024-04-23 05:15:02.249579] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.331 [2024-04-23 05:15:02.249607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.331 qpair failed and we were unable to recover it. 00:30:23.331 [2024-04-23 05:15:02.259434] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.331 [2024-04-23 05:15:02.259546] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.331 [2024-04-23 05:15:02.259572] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.331 [2024-04-23 05:15:02.259586] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.331 [2024-04-23 05:15:02.259599] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.331 [2024-04-23 05:15:02.259627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.331 qpair failed and we were unable to recover it. 00:30:23.331 [2024-04-23 05:15:02.269548] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.331 [2024-04-23 05:15:02.269673] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.331 [2024-04-23 05:15:02.269698] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.331 [2024-04-23 05:15:02.269713] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.331 [2024-04-23 05:15:02.269726] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.331 [2024-04-23 05:15:02.269754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.331 qpair failed and we were unable to recover it. 00:30:23.331 [2024-04-23 05:15:02.279594] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.331 [2024-04-23 05:15:02.279707] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.331 [2024-04-23 05:15:02.279732] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.331 [2024-04-23 05:15:02.279746] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.331 [2024-04-23 05:15:02.279759] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.279792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.289535] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.289656] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.289681] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.289695] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.289708] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.289736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.299534] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.299646] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.299671] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.299686] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.299698] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.299726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.309576] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.309676] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.309702] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.309717] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.309730] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.309758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.319614] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.319723] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.319748] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.319763] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.319776] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.319804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.329652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.329762] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.329793] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.329808] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.329821] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.329849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.339656] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.339765] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.339790] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.339804] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.339818] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.339845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.349693] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.349798] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.349825] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.349839] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.349852] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.349880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.359740] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.359867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.359893] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.359908] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.359921] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.359948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.369776] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.369890] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.369916] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.369932] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.369944] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.369978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.379789] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.379900] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.379924] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.379939] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.379952] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.379979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.389828] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.389954] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.389982] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.389996] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.390009] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.390036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.399851] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.399982] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.400008] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.400023] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.400035] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.400063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.409847] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.409969] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.332 [2024-04-23 05:15:02.409995] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.332 [2024-04-23 05:15:02.410009] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.332 [2024-04-23 05:15:02.410021] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.332 [2024-04-23 05:15:02.410049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.332 qpair failed and we were unable to recover it. 00:30:23.332 [2024-04-23 05:15:02.419904] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.332 [2024-04-23 05:15:02.420027] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.420058] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.420074] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.420086] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.420113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.333 [2024-04-23 05:15:02.429921] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.333 [2024-04-23 05:15:02.430050] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.430077] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.430092] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.430104] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.430131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.333 [2024-04-23 05:15:02.439916] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.333 [2024-04-23 05:15:02.440029] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.440055] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.440070] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.440083] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.440110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.333 [2024-04-23 05:15:02.449995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.333 [2024-04-23 05:15:02.450114] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.450141] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.450155] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.450168] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.450195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.333 [2024-04-23 05:15:02.460017] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.333 [2024-04-23 05:15:02.460139] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.460165] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.460180] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.460197] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.460226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.333 [2024-04-23 05:15:02.470119] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.333 [2024-04-23 05:15:02.470237] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.470277] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.470291] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.470303] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.470344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.333 [2024-04-23 05:15:02.480050] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.333 [2024-04-23 05:15:02.480163] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.480189] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.480204] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.480216] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.480243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.333 [2024-04-23 05:15:02.490100] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.333 [2024-04-23 05:15:02.490224] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.333 [2024-04-23 05:15:02.490251] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.333 [2024-04-23 05:15:02.490265] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.333 [2024-04-23 05:15:02.490277] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.333 [2024-04-23 05:15:02.490304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.333 qpair failed and we were unable to recover it. 00:30:23.591 [2024-04-23 05:15:02.500130] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.591 [2024-04-23 05:15:02.500282] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.591 [2024-04-23 05:15:02.500308] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.591 [2024-04-23 05:15:02.500323] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.591 [2024-04-23 05:15:02.500335] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.591 [2024-04-23 05:15:02.500363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.591 qpair failed and we were unable to recover it. 00:30:23.591 [2024-04-23 05:15:02.510147] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.591 [2024-04-23 05:15:02.510304] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.591 [2024-04-23 05:15:02.510331] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.591 [2024-04-23 05:15:02.510346] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.591 [2024-04-23 05:15:02.510359] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.591 [2024-04-23 05:15:02.510387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.591 qpair failed and we were unable to recover it. 00:30:23.591 [2024-04-23 05:15:02.520162] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.591 [2024-04-23 05:15:02.520278] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.520305] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.520319] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.520332] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.520360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.530238] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.530359] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.530385] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.530400] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.530413] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.530441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.540213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.540330] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.540357] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.540372] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.540385] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.540412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.550271] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.550399] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.550425] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.550439] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.550461] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.550504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.560332] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.560493] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.560524] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.560540] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.560553] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.560581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.570327] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.570448] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.570474] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.570489] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.570502] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.570537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.580326] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.580445] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.580469] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.580484] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.580497] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.580530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.590359] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.590477] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.590513] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.590535] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.590548] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.590576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.600397] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.600536] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.600563] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.600577] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.600590] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.600617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.610419] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.610551] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.610577] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.610592] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.610604] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.610632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.620426] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.620554] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.620583] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.620604] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.620616] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.620644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.630479] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.630606] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.630643] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.630657] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.630669] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.630697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.640572] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.640683] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.640710] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.640731] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.640744] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.640772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.592 qpair failed and we were unable to recover it. 00:30:23.592 [2024-04-23 05:15:02.650561] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.592 [2024-04-23 05:15:02.650680] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.592 [2024-04-23 05:15:02.650706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.592 [2024-04-23 05:15:02.650720] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.592 [2024-04-23 05:15:02.650733] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.592 [2024-04-23 05:15:02.650760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.660550] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.660667] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.660693] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.660708] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.660720] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.660747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.670661] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.670779] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.670805] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.670820] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.670832] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.670859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.680702] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.680818] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.680857] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.680870] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.680882] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.680924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.690753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.690867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.690893] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.690907] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.690920] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.690948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.700670] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.700786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.700813] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.700828] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.700840] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.700868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.710703] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.710822] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.710849] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.710863] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.710876] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.710904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.720727] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.720850] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.720877] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.720892] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.720904] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.720932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.730767] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.730887] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.730914] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.730934] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.730947] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.730975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.740778] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.740896] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.740923] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.740938] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.740950] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.740978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.593 [2024-04-23 05:15:02.750861] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.593 [2024-04-23 05:15:02.750979] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.593 [2024-04-23 05:15:02.751005] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.593 [2024-04-23 05:15:02.751020] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.593 [2024-04-23 05:15:02.751033] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.593 [2024-04-23 05:15:02.751061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.593 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.760844] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.761003] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.761030] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.761046] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.761059] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.761095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.770889] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.771010] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.771037] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.771052] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.771064] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.771092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.780882] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.781001] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.781028] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.781042] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.781055] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.781083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.790982] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.791102] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.791130] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.791148] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.791161] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.791190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.800949] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.801070] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.801096] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.801111] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.801123] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.801152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.810995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.811114] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.811140] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.811155] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.811168] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.811195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.821042] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.821164] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.821191] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.821211] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.821224] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.821252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.831065] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.831212] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.831240] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.831255] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.831268] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.831310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.841067] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.841191] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.841217] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.853 [2024-04-23 05:15:02.841231] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.853 [2024-04-23 05:15:02.841244] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.853 [2024-04-23 05:15:02.841271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.853 qpair failed and we were unable to recover it. 00:30:23.853 [2024-04-23 05:15:02.851124] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.853 [2024-04-23 05:15:02.851295] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.853 [2024-04-23 05:15:02.851322] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.851336] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.851349] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.851376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.861119] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.861241] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.861267] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.861282] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.861295] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.861322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.871177] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.871307] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.871334] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.871348] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.871361] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.871388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.881188] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.881304] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.881329] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.881343] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.881358] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.881385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.891214] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.891337] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.891364] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.891379] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.891392] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.891419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.901372] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.901508] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.901541] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.901556] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.901575] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.901603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.911300] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.911425] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.911455] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.911472] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.911485] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.911512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.921294] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.921411] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.921437] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.921452] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.921464] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.921492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.931372] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.931497] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.931533] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.931549] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.931562] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.931590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.941361] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.941476] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.941504] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.941525] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.941538] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.941567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.951384] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.951501] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.951534] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.951550] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.951562] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.951590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.961421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.961560] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.961587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.961602] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.961614] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.961641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.971447] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.971574] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.971600] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.971615] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.971628] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.971656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.854 [2024-04-23 05:15:02.981465] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.854 [2024-04-23 05:15:02.981577] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.854 [2024-04-23 05:15:02.981603] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.854 [2024-04-23 05:15:02.981618] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.854 [2024-04-23 05:15:02.981630] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.854 [2024-04-23 05:15:02.981658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.854 qpair failed and we were unable to recover it. 00:30:23.855 [2024-04-23 05:15:02.991505] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.855 [2024-04-23 05:15:02.991635] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.855 [2024-04-23 05:15:02.991661] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.855 [2024-04-23 05:15:02.991676] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.855 [2024-04-23 05:15:02.991688] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.855 [2024-04-23 05:15:02.991716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.855 qpair failed and we were unable to recover it. 00:30:23.855 [2024-04-23 05:15:03.001555] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.855 [2024-04-23 05:15:03.001668] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.855 [2024-04-23 05:15:03.001699] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.855 [2024-04-23 05:15:03.001715] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.855 [2024-04-23 05:15:03.001728] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.855 [2024-04-23 05:15:03.001756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.855 qpair failed and we were unable to recover it. 00:30:23.855 [2024-04-23 05:15:03.011583] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.855 [2024-04-23 05:15:03.011705] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.855 [2024-04-23 05:15:03.011731] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.855 [2024-04-23 05:15:03.011746] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.855 [2024-04-23 05:15:03.011759] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:23.855 [2024-04-23 05:15:03.011786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:23.855 qpair failed and we were unable to recover it. 00:30:24.114 [2024-04-23 05:15:03.021620] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.114 [2024-04-23 05:15:03.021777] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.114 [2024-04-23 05:15:03.021824] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.114 [2024-04-23 05:15:03.021843] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.114 [2024-04-23 05:15:03.021870] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.114 [2024-04-23 05:15:03.021910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.114 qpair failed and we were unable to recover it. 00:30:24.114 [2024-04-23 05:15:03.031628] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.114 [2024-04-23 05:15:03.031732] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.114 [2024-04-23 05:15:03.031759] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.114 [2024-04-23 05:15:03.031774] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.114 [2024-04-23 05:15:03.031786] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.114 [2024-04-23 05:15:03.031815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.114 qpair failed and we were unable to recover it. 00:30:24.114 [2024-04-23 05:15:03.041660] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.114 [2024-04-23 05:15:03.041767] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.114 [2024-04-23 05:15:03.041794] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.114 [2024-04-23 05:15:03.041808] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.114 [2024-04-23 05:15:03.041821] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.114 [2024-04-23 05:15:03.041854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.114 qpair failed and we were unable to recover it. 00:30:24.114 [2024-04-23 05:15:03.051703] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.114 [2024-04-23 05:15:03.051837] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.114 [2024-04-23 05:15:03.051864] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.114 [2024-04-23 05:15:03.051879] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.114 [2024-04-23 05:15:03.051892] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.114 [2024-04-23 05:15:03.051919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.114 qpair failed and we were unable to recover it. 00:30:24.114 [2024-04-23 05:15:03.061869] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.114 [2024-04-23 05:15:03.062045] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.114 [2024-04-23 05:15:03.062071] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.114 [2024-04-23 05:15:03.062085] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.114 [2024-04-23 05:15:03.062097] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.114 [2024-04-23 05:15:03.062125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.114 qpair failed and we were unable to recover it. 00:30:24.114 [2024-04-23 05:15:03.071764] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.114 [2024-04-23 05:15:03.071896] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.114 [2024-04-23 05:15:03.071922] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.114 [2024-04-23 05:15:03.071936] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.114 [2024-04-23 05:15:03.071948] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.114 [2024-04-23 05:15:03.071991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.114 qpair failed and we were unable to recover it. 00:30:24.114 [2024-04-23 05:15:03.081805] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.114 [2024-04-23 05:15:03.081917] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.114 [2024-04-23 05:15:03.081943] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.114 [2024-04-23 05:15:03.081958] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.114 [2024-04-23 05:15:03.081978] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.114 [2024-04-23 05:15:03.082005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.114 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.091819] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.091945] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.091975] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.091990] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.092003] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.092031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.101849] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.102008] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.102034] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.102049] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.102062] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.102089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.111856] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.111971] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.111997] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.112012] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.112024] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.112051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.121953] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.122109] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.122135] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.122150] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.122165] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.122207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.131922] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.132046] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.132071] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.132085] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.132098] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.132131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.141992] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.142150] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.142177] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.142195] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.142209] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.142238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.151992] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.152112] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.152139] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.152154] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.152167] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.152195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.162035] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.162156] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.162183] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.162197] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.162210] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.162237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.172081] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.172202] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.172229] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.172243] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.172256] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.172283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.115 [2024-04-23 05:15:03.182094] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.115 [2024-04-23 05:15:03.182217] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.115 [2024-04-23 05:15:03.182248] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.115 [2024-04-23 05:15:03.182263] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.115 [2024-04-23 05:15:03.182276] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.115 [2024-04-23 05:15:03.182303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.115 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.192097] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.192223] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.192249] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.192264] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.192276] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.192305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.202111] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.202242] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.202268] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.202283] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.202296] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.202323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.212164] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.212280] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.212306] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.212321] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.212333] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.212360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.222154] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.222292] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.222318] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.222333] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.222351] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.222379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.232193] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.232332] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.232358] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.232372] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.232385] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.232412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.242241] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.242355] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.242381] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.242397] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.242409] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.242436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.252257] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.252414] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.252440] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.252454] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.252467] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.252495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.262391] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.262522] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.262548] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.262563] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.262575] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.262603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.116 [2024-04-23 05:15:03.272338] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.116 [2024-04-23 05:15:03.272505] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.116 [2024-04-23 05:15:03.272538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.116 [2024-04-23 05:15:03.272553] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.116 [2024-04-23 05:15:03.272566] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.116 [2024-04-23 05:15:03.272594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.116 qpair failed and we were unable to recover it. 00:30:24.374 [2024-04-23 05:15:03.282366] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.374 [2024-04-23 05:15:03.282482] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.374 [2024-04-23 05:15:03.282509] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.374 [2024-04-23 05:15:03.282534] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.374 [2024-04-23 05:15:03.282548] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.374 [2024-04-23 05:15:03.282576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.374 qpair failed and we were unable to recover it. 00:30:24.374 [2024-04-23 05:15:03.292407] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.374 [2024-04-23 05:15:03.292556] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.374 [2024-04-23 05:15:03.292583] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.374 [2024-04-23 05:15:03.292598] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.374 [2024-04-23 05:15:03.292610] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.374 [2024-04-23 05:15:03.292638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.374 qpair failed and we were unable to recover it. 00:30:24.374 [2024-04-23 05:15:03.302410] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.374 [2024-04-23 05:15:03.302541] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.374 [2024-04-23 05:15:03.302567] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.374 [2024-04-23 05:15:03.302581] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.374 [2024-04-23 05:15:03.302595] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.374 [2024-04-23 05:15:03.302623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.374 qpair failed and we were unable to recover it. 00:30:24.374 [2024-04-23 05:15:03.312444] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.374 [2024-04-23 05:15:03.312560] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.374 [2024-04-23 05:15:03.312586] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.374 [2024-04-23 05:15:03.312600] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.374 [2024-04-23 05:15:03.312621] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.374 [2024-04-23 05:15:03.312650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.374 qpair failed and we were unable to recover it. 00:30:24.374 [2024-04-23 05:15:03.322445] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.374 [2024-04-23 05:15:03.322562] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.374 [2024-04-23 05:15:03.322587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.374 [2024-04-23 05:15:03.322601] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.374 [2024-04-23 05:15:03.322614] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.374 [2024-04-23 05:15:03.322642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.374 qpair failed and we were unable to recover it. 00:30:24.374 [2024-04-23 05:15:03.332529] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.374 [2024-04-23 05:15:03.332652] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.374 [2024-04-23 05:15:03.332676] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.374 [2024-04-23 05:15:03.332691] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.374 [2024-04-23 05:15:03.332703] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.374 [2024-04-23 05:15:03.332731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.374 qpair failed and we were unable to recover it. 00:30:24.374 [2024-04-23 05:15:03.342543] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.374 [2024-04-23 05:15:03.342655] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.374 [2024-04-23 05:15:03.342679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.374 [2024-04-23 05:15:03.342694] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.374 [2024-04-23 05:15:03.342706] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.374 [2024-04-23 05:15:03.342734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.352628] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.352745] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.352771] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.352785] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.352798] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.352825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.362568] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.362699] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.362725] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.362740] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.362753] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.362781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.372623] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.372742] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.372768] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.372783] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.372796] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.372824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.382651] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.382771] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.382797] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.382812] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.382825] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.382853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.392650] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.392760] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.392786] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.392800] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.392813] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.392841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.402663] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.402810] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.402836] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.402850] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.402868] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.402897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.412725] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.412861] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.412887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.412902] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.412915] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.412943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.422763] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.422874] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.422899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.422914] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.422926] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.422955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.432785] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.432918] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.432944] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.432958] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.432971] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.432999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.442777] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.375 [2024-04-23 05:15:03.442881] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.375 [2024-04-23 05:15:03.442906] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.375 [2024-04-23 05:15:03.442921] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.375 [2024-04-23 05:15:03.442934] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19e7e40 00:30:24.375 [2024-04-23 05:15:03.442962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:24.375 qpair failed and we were unable to recover it. 00:30:24.375 [2024-04-23 05:15:03.442999] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:24.375 A controller has encountered a failure and is being reset. 00:30:24.633 Controller properly reset. 00:30:27.165 Initializing NVMe Controllers 00:30:27.165 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:27.166 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:27.166 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:27.166 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:27.166 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:27.166 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:27.166 Initialization complete. Launching workers. 00:30:27.166 Starting thread on core 1 00:30:27.166 Starting thread on core 2 00:30:27.166 Starting thread on core 3 00:30:27.166 Starting thread on core 0 00:30:27.166 05:15:05 -- host/target_disconnect.sh@59 -- # sync 00:30:27.166 00:30:27.166 real 0m10.737s 00:30:27.166 user 0m24.479s 00:30:27.166 sys 0m5.834s 00:30:27.166 05:15:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:27.166 05:15:05 -- common/autotest_common.sh@10 -- # set +x 00:30:27.166 ************************************ 00:30:27.166 END TEST nvmf_target_disconnect_tc2 00:30:27.166 ************************************ 00:30:27.166 05:15:05 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:27.166 05:15:05 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:27.166 05:15:05 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:27.166 05:15:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:30:27.166 05:15:05 -- nvmf/common.sh@117 -- # sync 00:30:27.166 05:15:05 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:30:27.166 05:15:05 -- nvmf/common.sh@120 -- # set +e 00:30:27.166 05:15:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:30:27.166 05:15:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:30:27.166 rmmod nvme_tcp 00:30:27.166 rmmod nvme_fabrics 00:30:27.166 rmmod nvme_keyring 00:30:27.166 05:15:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:30:27.166 05:15:05 -- nvmf/common.sh@124 -- # set -e 00:30:27.166 05:15:05 -- nvmf/common.sh@125 -- # return 0 00:30:27.166 05:15:05 -- nvmf/common.sh@478 -- # '[' -n 2527213 ']' 00:30:27.166 05:15:05 -- nvmf/common.sh@479 -- # killprocess 2527213 00:30:27.166 05:15:05 -- common/autotest_common.sh@936 -- # '[' -z 2527213 ']' 00:30:27.166 05:15:05 -- common/autotest_common.sh@940 -- # kill -0 2527213 00:30:27.166 05:15:05 -- common/autotest_common.sh@941 -- # uname 00:30:27.166 05:15:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:27.166 05:15:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2527213 00:30:27.166 05:15:06 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:27.166 05:15:06 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:27.166 05:15:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2527213' 00:30:27.166 killing process with pid 2527213 00:30:27.166 05:15:06 -- common/autotest_common.sh@955 -- # kill 2527213 00:30:27.166 05:15:06 -- common/autotest_common.sh@960 -- # wait 2527213 00:30:27.166 05:15:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:30:27.166 05:15:06 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:30:27.166 05:15:06 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:30:27.166 05:15:06 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:27.166 05:15:06 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:30:27.166 05:15:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:27.166 05:15:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:27.166 05:15:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:29.701 05:15:08 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:30:29.701 00:30:29.701 real 0m15.626s 00:30:29.701 user 0m50.141s 00:30:29.701 sys 0m8.186s 00:30:29.701 05:15:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:29.701 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.701 ************************************ 00:30:29.701 END TEST nvmf_target_disconnect 00:30:29.701 ************************************ 00:30:29.701 05:15:08 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:30:29.701 05:15:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:29.701 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.701 05:15:08 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:30:29.701 00:30:29.702 real 22m49.649s 00:30:29.702 user 62m58.629s 00:30:29.702 sys 5m34.774s 00:30:29.702 05:15:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:29.702 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.702 ************************************ 00:30:29.702 END TEST nvmf_tcp 00:30:29.702 ************************************ 00:30:29.702 05:15:08 -- spdk/autotest.sh@286 -- # [[ 0 -eq 0 ]] 00:30:29.702 05:15:08 -- spdk/autotest.sh@287 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:29.702 05:15:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:29.702 05:15:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:29.702 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.702 ************************************ 00:30:29.702 START TEST spdkcli_nvmf_tcp 00:30:29.702 ************************************ 00:30:29.702 05:15:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:29.702 * Looking for test storage... 00:30:29.702 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:29.702 05:15:08 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:29.702 05:15:08 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:29.702 05:15:08 -- nvmf/common.sh@7 -- # uname -s 00:30:29.702 05:15:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:29.702 05:15:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:29.702 05:15:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:29.702 05:15:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:29.702 05:15:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:29.702 05:15:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:29.702 05:15:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:29.702 05:15:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:29.702 05:15:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:29.702 05:15:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:29.702 05:15:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:29.702 05:15:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:29.702 05:15:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:29.702 05:15:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:29.702 05:15:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:29.702 05:15:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:30:29.702 05:15:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:29.702 05:15:08 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:29.702 05:15:08 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:29.702 05:15:08 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:29.702 05:15:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:29.702 05:15:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:29.702 05:15:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:29.702 05:15:08 -- paths/export.sh@5 -- # export PATH 00:30:29.702 05:15:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:29.702 05:15:08 -- nvmf/common.sh@47 -- # : 0 00:30:29.702 05:15:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:30:29.702 05:15:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:30:29.702 05:15:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:30:29.702 05:15:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:29.702 05:15:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:29.702 05:15:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:30:29.702 05:15:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:30:29.702 05:15:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:29.702 05:15:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:29.702 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:29.702 05:15:08 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2528916 00:30:29.702 05:15:08 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:29.702 05:15:08 -- spdkcli/common.sh@34 -- # waitforlisten 2528916 00:30:29.702 05:15:08 -- common/autotest_common.sh@817 -- # '[' -z 2528916 ']' 00:30:29.702 05:15:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:29.702 05:15:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:29.702 05:15:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:29.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:29.702 05:15:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:29.702 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.702 [2024-04-23 05:15:08.593245] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:30:29.702 [2024-04-23 05:15:08.593334] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2528916 ] 00:30:29.702 EAL: No free 2048 kB hugepages reported on node 1 00:30:29.702 [2024-04-23 05:15:08.626292] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:30:29.702 [2024-04-23 05:15:08.655372] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:29.702 [2024-04-23 05:15:08.745491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:29.702 [2024-04-23 05:15:08.745494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:29.702 05:15:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:29.702 05:15:08 -- common/autotest_common.sh@850 -- # return 0 00:30:29.702 05:15:08 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:29.702 05:15:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:29.702 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.960 05:15:08 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:29.960 05:15:08 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:29.960 05:15:08 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:29.960 05:15:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:29.960 05:15:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.961 05:15:08 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:29.961 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:29.961 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:29.961 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:29.961 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:29.961 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:29.961 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:29.961 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:29.961 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:29.961 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:29.961 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:29.961 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:29.961 ' 00:30:30.219 [2024-04-23 05:15:09.258253] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:32.755 [2024-04-23 05:15:11.428131] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:33.690 [2024-04-23 05:15:12.664391] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:36.225 [2024-04-23 05:15:14.947647] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:38.130 [2024-04-23 05:15:16.909829] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:39.507 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:39.507 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:39.507 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:39.507 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:39.507 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:39.507 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:39.507 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:39.507 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:39.507 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:39.507 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:39.507 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:39.507 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:39.507 05:15:18 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:39.507 05:15:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:39.507 05:15:18 -- common/autotest_common.sh@10 -- # set +x 00:30:39.507 05:15:18 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:39.507 05:15:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:39.507 05:15:18 -- common/autotest_common.sh@10 -- # set +x 00:30:39.507 05:15:18 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:39.507 05:15:18 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:40.074 05:15:18 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:40.074 05:15:19 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:40.074 05:15:19 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:40.074 05:15:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:40.074 05:15:19 -- common/autotest_common.sh@10 -- # set +x 00:30:40.074 05:15:19 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:40.074 05:15:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:40.074 05:15:19 -- common/autotest_common.sh@10 -- # set +x 00:30:40.074 05:15:19 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:40.074 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:40.074 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:40.074 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:40.074 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:40.074 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:40.074 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:40.074 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:40.074 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:40.074 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:40.074 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:40.074 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:40.074 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:40.074 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:40.074 ' 00:30:45.348 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:45.348 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:45.348 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:45.348 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:45.348 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:45.348 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:45.348 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:45.348 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:45.348 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:45.348 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:45.348 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:45.348 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:45.348 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:45.348 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:45.348 05:15:24 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:45.348 05:15:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:45.348 05:15:24 -- common/autotest_common.sh@10 -- # set +x 00:30:45.348 05:15:24 -- spdkcli/nvmf.sh@90 -- # killprocess 2528916 00:30:45.348 05:15:24 -- common/autotest_common.sh@936 -- # '[' -z 2528916 ']' 00:30:45.348 05:15:24 -- common/autotest_common.sh@940 -- # kill -0 2528916 00:30:45.348 05:15:24 -- common/autotest_common.sh@941 -- # uname 00:30:45.348 05:15:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:45.348 05:15:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2528916 00:30:45.348 05:15:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:45.348 05:15:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:45.348 05:15:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2528916' 00:30:45.348 killing process with pid 2528916 00:30:45.348 05:15:24 -- common/autotest_common.sh@955 -- # kill 2528916 00:30:45.348 [2024-04-23 05:15:24.312914] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:45.348 05:15:24 -- common/autotest_common.sh@960 -- # wait 2528916 00:30:45.607 05:15:24 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:45.607 05:15:24 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:45.607 05:15:24 -- spdkcli/common.sh@13 -- # '[' -n 2528916 ']' 00:30:45.608 05:15:24 -- spdkcli/common.sh@14 -- # killprocess 2528916 00:30:45.608 05:15:24 -- common/autotest_common.sh@936 -- # '[' -z 2528916 ']' 00:30:45.608 05:15:24 -- common/autotest_common.sh@940 -- # kill -0 2528916 00:30:45.608 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2528916) - No such process 00:30:45.608 05:15:24 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2528916 is not found' 00:30:45.608 Process with pid 2528916 is not found 00:30:45.608 05:15:24 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:45.608 05:15:24 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:45.608 05:15:24 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:45.608 00:30:45.608 real 0m16.063s 00:30:45.608 user 0m33.988s 00:30:45.608 sys 0m0.817s 00:30:45.608 05:15:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:45.608 05:15:24 -- common/autotest_common.sh@10 -- # set +x 00:30:45.608 ************************************ 00:30:45.608 END TEST spdkcli_nvmf_tcp 00:30:45.608 ************************************ 00:30:45.608 05:15:24 -- spdk/autotest.sh@288 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:45.608 05:15:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:45.608 05:15:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:45.608 05:15:24 -- common/autotest_common.sh@10 -- # set +x 00:30:45.608 ************************************ 00:30:45.608 START TEST nvmf_identify_passthru 00:30:45.608 ************************************ 00:30:45.608 05:15:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:45.608 * Looking for test storage... 00:30:45.608 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:45.608 05:15:24 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:45.608 05:15:24 -- nvmf/common.sh@7 -- # uname -s 00:30:45.608 05:15:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:45.608 05:15:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:45.608 05:15:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:45.608 05:15:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:45.608 05:15:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:45.608 05:15:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:45.608 05:15:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:45.608 05:15:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:45.608 05:15:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:45.608 05:15:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:45.608 05:15:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.608 05:15:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.608 05:15:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:45.608 05:15:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:45.608 05:15:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:45.608 05:15:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:30:45.608 05:15:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:45.608 05:15:24 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:45.608 05:15:24 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:45.608 05:15:24 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:45.608 05:15:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- paths/export.sh@5 -- # export PATH 00:30:45.608 05:15:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- nvmf/common.sh@47 -- # : 0 00:30:45.608 05:15:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:30:45.608 05:15:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:30:45.608 05:15:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:30:45.608 05:15:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:45.608 05:15:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:45.608 05:15:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:30:45.608 05:15:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:30:45.608 05:15:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:30:45.608 05:15:24 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:45.608 05:15:24 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:45.608 05:15:24 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:45.608 05:15:24 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:45.608 05:15:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- paths/export.sh@5 -- # export PATH 00:30:45.608 05:15:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.608 05:15:24 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:45.608 05:15:24 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:30:45.608 05:15:24 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:45.608 05:15:24 -- nvmf/common.sh@437 -- # prepare_net_devs 00:30:45.608 05:15:24 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:30:45.608 05:15:24 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:30:45.608 05:15:24 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:45.608 05:15:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:45.608 05:15:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:45.608 05:15:24 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:30:45.608 05:15:24 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:30:45.608 05:15:24 -- nvmf/common.sh@285 -- # xtrace_disable 00:30:45.608 05:15:24 -- common/autotest_common.sh@10 -- # set +x 00:30:47.515 05:15:26 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:47.515 05:15:26 -- nvmf/common.sh@291 -- # pci_devs=() 00:30:47.515 05:15:26 -- nvmf/common.sh@291 -- # local -a pci_devs 00:30:47.515 05:15:26 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:30:47.515 05:15:26 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:30:47.515 05:15:26 -- nvmf/common.sh@293 -- # pci_drivers=() 00:30:47.515 05:15:26 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:30:47.515 05:15:26 -- nvmf/common.sh@295 -- # net_devs=() 00:30:47.515 05:15:26 -- nvmf/common.sh@295 -- # local -ga net_devs 00:30:47.515 05:15:26 -- nvmf/common.sh@296 -- # e810=() 00:30:47.515 05:15:26 -- nvmf/common.sh@296 -- # local -ga e810 00:30:47.515 05:15:26 -- nvmf/common.sh@297 -- # x722=() 00:30:47.515 05:15:26 -- nvmf/common.sh@297 -- # local -ga x722 00:30:47.515 05:15:26 -- nvmf/common.sh@298 -- # mlx=() 00:30:47.515 05:15:26 -- nvmf/common.sh@298 -- # local -ga mlx 00:30:47.515 05:15:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:47.515 05:15:26 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:30:47.515 05:15:26 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:30:47.515 05:15:26 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:30:47.515 05:15:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:47.515 05:15:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:47.515 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:47.515 05:15:26 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:47.515 05:15:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:47.515 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:47.515 05:15:26 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:30:47.515 05:15:26 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:30:47.515 05:15:26 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:30:47.516 05:15:26 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:30:47.516 05:15:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:47.516 05:15:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:47.516 05:15:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:47.516 05:15:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:47.516 05:15:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:47.516 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:47.516 05:15:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:47.516 05:15:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:47.516 05:15:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:47.516 05:15:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:47.516 05:15:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:47.516 05:15:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:47.516 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:47.516 05:15:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:47.516 05:15:26 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:30:47.516 05:15:26 -- nvmf/common.sh@403 -- # is_hw=yes 00:30:47.516 05:15:26 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:30:47.516 05:15:26 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:30:47.516 05:15:26 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:30:47.516 05:15:26 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:47.516 05:15:26 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:47.516 05:15:26 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:47.516 05:15:26 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:30:47.516 05:15:26 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:47.516 05:15:26 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:47.516 05:15:26 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:30:47.516 05:15:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:47.516 05:15:26 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:47.516 05:15:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:30:47.516 05:15:26 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:30:47.516 05:15:26 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:30:47.516 05:15:26 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:47.775 05:15:26 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:47.775 05:15:26 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:47.775 05:15:26 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:30:47.775 05:15:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:47.775 05:15:26 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:47.775 05:15:26 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:47.775 05:15:26 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:30:47.775 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:47.775 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:30:47.775 00:30:47.775 --- 10.0.0.2 ping statistics --- 00:30:47.775 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:47.775 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:30:47.775 05:15:26 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:47.775 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:47.775 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.138 ms 00:30:47.775 00:30:47.775 --- 10.0.0.1 ping statistics --- 00:30:47.775 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:47.775 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:30:47.775 05:15:26 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:47.775 05:15:26 -- nvmf/common.sh@411 -- # return 0 00:30:47.775 05:15:26 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:30:47.775 05:15:26 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:47.775 05:15:26 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:30:47.775 05:15:26 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:30:47.775 05:15:26 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:47.775 05:15:26 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:30:47.775 05:15:26 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:30:47.775 05:15:26 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:47.775 05:15:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:47.775 05:15:26 -- common/autotest_common.sh@10 -- # set +x 00:30:47.775 05:15:26 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:47.775 05:15:26 -- common/autotest_common.sh@1510 -- # bdfs=() 00:30:47.775 05:15:26 -- common/autotest_common.sh@1510 -- # local bdfs 00:30:47.775 05:15:26 -- common/autotest_common.sh@1511 -- # bdfs=($(get_nvme_bdfs)) 00:30:47.775 05:15:26 -- common/autotest_common.sh@1511 -- # get_nvme_bdfs 00:30:47.775 05:15:26 -- common/autotest_common.sh@1499 -- # bdfs=() 00:30:47.775 05:15:26 -- common/autotest_common.sh@1499 -- # local bdfs 00:30:47.775 05:15:26 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:47.775 05:15:26 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:47.775 05:15:26 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:30:47.775 05:15:26 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:30:47.775 05:15:26 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:88:00.0 00:30:47.775 05:15:26 -- common/autotest_common.sh@1513 -- # echo 0000:88:00.0 00:30:47.775 05:15:26 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:47.775 05:15:26 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:47.775 05:15:26 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:47.775 05:15:26 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:47.775 05:15:26 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:47.775 EAL: No free 2048 kB hugepages reported on node 1 00:30:51.974 05:15:31 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:30:51.974 05:15:31 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:51.974 05:15:31 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:51.974 05:15:31 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:51.974 EAL: No free 2048 kB hugepages reported on node 1 00:30:56.164 05:15:35 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:56.164 05:15:35 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:56.164 05:15:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:56.164 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:30:56.164 05:15:35 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:56.164 05:15:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:56.164 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:30:56.164 05:15:35 -- target/identify_passthru.sh@31 -- # nvmfpid=2533651 00:30:56.164 05:15:35 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:56.164 05:15:35 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:56.164 05:15:35 -- target/identify_passthru.sh@35 -- # waitforlisten 2533651 00:30:56.164 05:15:35 -- common/autotest_common.sh@817 -- # '[' -z 2533651 ']' 00:30:56.164 05:15:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:56.164 05:15:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:56.164 05:15:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:56.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:56.164 05:15:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:56.164 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:30:56.164 [2024-04-23 05:15:35.287289] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:30:56.164 [2024-04-23 05:15:35.287362] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:56.164 EAL: No free 2048 kB hugepages reported on node 1 00:30:56.164 [2024-04-23 05:15:35.324153] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:30:56.424 [2024-04-23 05:15:35.352483] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:56.424 [2024-04-23 05:15:35.436314] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:56.424 [2024-04-23 05:15:35.436368] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:56.424 [2024-04-23 05:15:35.436382] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:56.424 [2024-04-23 05:15:35.436393] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:56.424 [2024-04-23 05:15:35.436403] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:56.424 [2024-04-23 05:15:35.436464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:56.424 [2024-04-23 05:15:35.436529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:56.424 [2024-04-23 05:15:35.436591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:56.424 [2024-04-23 05:15:35.436593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:56.424 05:15:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:56.424 05:15:35 -- common/autotest_common.sh@850 -- # return 0 00:30:56.424 05:15:35 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:56.424 05:15:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:56.424 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:30:56.424 INFO: Log level set to 20 00:30:56.424 INFO: Requests: 00:30:56.424 { 00:30:56.424 "jsonrpc": "2.0", 00:30:56.424 "method": "nvmf_set_config", 00:30:56.424 "id": 1, 00:30:56.424 "params": { 00:30:56.424 "admin_cmd_passthru": { 00:30:56.424 "identify_ctrlr": true 00:30:56.424 } 00:30:56.424 } 00:30:56.424 } 00:30:56.424 00:30:56.424 INFO: response: 00:30:56.424 { 00:30:56.424 "jsonrpc": "2.0", 00:30:56.424 "id": 1, 00:30:56.424 "result": true 00:30:56.424 } 00:30:56.424 00:30:56.424 05:15:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:56.424 05:15:35 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:56.424 05:15:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:56.424 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:30:56.424 INFO: Setting log level to 20 00:30:56.424 INFO: Setting log level to 20 00:30:56.424 INFO: Log level set to 20 00:30:56.424 INFO: Log level set to 20 00:30:56.424 INFO: Requests: 00:30:56.424 { 00:30:56.424 "jsonrpc": "2.0", 00:30:56.424 "method": "framework_start_init", 00:30:56.424 "id": 1 00:30:56.424 } 00:30:56.424 00:30:56.424 INFO: Requests: 00:30:56.424 { 00:30:56.424 "jsonrpc": "2.0", 00:30:56.424 "method": "framework_start_init", 00:30:56.424 "id": 1 00:30:56.424 } 00:30:56.424 00:30:56.684 [2024-04-23 05:15:35.604883] nvmf_tgt.c: 453:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:30:56.684 INFO: response: 00:30:56.684 { 00:30:56.684 "jsonrpc": "2.0", 00:30:56.684 "id": 1, 00:30:56.684 "result": true 00:30:56.684 } 00:30:56.684 00:30:56.684 INFO: response: 00:30:56.684 { 00:30:56.685 "jsonrpc": "2.0", 00:30:56.685 "id": 1, 00:30:56.685 "result": true 00:30:56.685 } 00:30:56.685 00:30:56.685 05:15:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:56.685 05:15:35 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:56.685 05:15:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:56.685 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:30:56.685 INFO: Setting log level to 40 00:30:56.685 INFO: Setting log level to 40 00:30:56.685 INFO: Setting log level to 40 00:30:56.685 [2024-04-23 05:15:35.614974] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:56.685 05:15:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:56.685 05:15:35 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:30:56.685 05:15:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:56.685 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:30:56.685 05:15:35 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:30:56.685 05:15:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:56.685 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:31:00.006 Nvme0n1 00:31:00.006 05:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.006 05:15:38 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:00.006 05:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:00.006 05:15:38 -- common/autotest_common.sh@10 -- # set +x 00:31:00.006 05:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.006 05:15:38 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:00.006 05:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:00.006 05:15:38 -- common/autotest_common.sh@10 -- # set +x 00:31:00.006 05:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.006 05:15:38 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:00.006 05:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:00.006 05:15:38 -- common/autotest_common.sh@10 -- # set +x 00:31:00.006 [2024-04-23 05:15:38.512369] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:00.006 05:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.006 05:15:38 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:00.006 05:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:00.006 05:15:38 -- common/autotest_common.sh@10 -- # set +x 00:31:00.006 [2024-04-23 05:15:38.520082] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:00.006 [ 00:31:00.006 { 00:31:00.006 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:00.006 "subtype": "Discovery", 00:31:00.006 "listen_addresses": [], 00:31:00.006 "allow_any_host": true, 00:31:00.006 "hosts": [] 00:31:00.006 }, 00:31:00.006 { 00:31:00.006 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:00.006 "subtype": "NVMe", 00:31:00.006 "listen_addresses": [ 00:31:00.006 { 00:31:00.006 "transport": "TCP", 00:31:00.006 "trtype": "TCP", 00:31:00.006 "adrfam": "IPv4", 00:31:00.006 "traddr": "10.0.0.2", 00:31:00.006 "trsvcid": "4420" 00:31:00.006 } 00:31:00.006 ], 00:31:00.006 "allow_any_host": true, 00:31:00.006 "hosts": [], 00:31:00.006 "serial_number": "SPDK00000000000001", 00:31:00.006 "model_number": "SPDK bdev Controller", 00:31:00.006 "max_namespaces": 1, 00:31:00.006 "min_cntlid": 1, 00:31:00.006 "max_cntlid": 65519, 00:31:00.006 "namespaces": [ 00:31:00.006 { 00:31:00.006 "nsid": 1, 00:31:00.006 "bdev_name": "Nvme0n1", 00:31:00.006 "name": "Nvme0n1", 00:31:00.006 "nguid": "FE91CC84802B468988EB45CDE78DA4DF", 00:31:00.006 "uuid": "fe91cc84-802b-4689-88eb-45cde78da4df" 00:31:00.006 } 00:31:00.006 ] 00:31:00.006 } 00:31:00.006 ] 00:31:00.006 05:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.006 05:15:38 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:00.006 05:15:38 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:00.006 05:15:38 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:00.006 EAL: No free 2048 kB hugepages reported on node 1 00:31:00.006 05:15:38 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:00.006 05:15:38 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:00.006 05:15:38 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:00.006 05:15:38 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:00.006 EAL: No free 2048 kB hugepages reported on node 1 00:31:00.006 05:15:38 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:00.006 05:15:38 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:00.006 05:15:38 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:00.006 05:15:38 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:00.006 05:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:00.006 05:15:38 -- common/autotest_common.sh@10 -- # set +x 00:31:00.006 05:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.006 05:15:38 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:00.006 05:15:38 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:00.006 05:15:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:00.006 05:15:38 -- nvmf/common.sh@117 -- # sync 00:31:00.006 05:15:38 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:31:00.006 05:15:38 -- nvmf/common.sh@120 -- # set +e 00:31:00.006 05:15:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:00.006 05:15:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:31:00.006 rmmod nvme_tcp 00:31:00.006 rmmod nvme_fabrics 00:31:00.006 rmmod nvme_keyring 00:31:00.006 05:15:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:00.006 05:15:38 -- nvmf/common.sh@124 -- # set -e 00:31:00.006 05:15:38 -- nvmf/common.sh@125 -- # return 0 00:31:00.006 05:15:38 -- nvmf/common.sh@478 -- # '[' -n 2533651 ']' 00:31:00.006 05:15:38 -- nvmf/common.sh@479 -- # killprocess 2533651 00:31:00.006 05:15:38 -- common/autotest_common.sh@936 -- # '[' -z 2533651 ']' 00:31:00.006 05:15:38 -- common/autotest_common.sh@940 -- # kill -0 2533651 00:31:00.006 05:15:38 -- common/autotest_common.sh@941 -- # uname 00:31:00.006 05:15:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:00.006 05:15:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2533651 00:31:00.006 05:15:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:00.006 05:15:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:00.006 05:15:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2533651' 00:31:00.006 killing process with pid 2533651 00:31:00.006 05:15:38 -- common/autotest_common.sh@955 -- # kill 2533651 00:31:00.006 [2024-04-23 05:15:38.950372] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:00.006 05:15:38 -- common/autotest_common.sh@960 -- # wait 2533651 00:31:01.381 05:15:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:01.381 05:15:40 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:31:01.381 05:15:40 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:31:01.381 05:15:40 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:01.381 05:15:40 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:31:01.381 05:15:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:01.381 05:15:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:01.381 05:15:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:03.916 05:15:42 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:31:03.916 00:31:03.916 real 0m17.900s 00:31:03.917 user 0m26.693s 00:31:03.917 sys 0m2.287s 00:31:03.917 05:15:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:03.917 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:31:03.917 ************************************ 00:31:03.917 END TEST nvmf_identify_passthru 00:31:03.917 ************************************ 00:31:03.917 05:15:42 -- spdk/autotest.sh@290 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:03.917 05:15:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:03.917 05:15:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:03.917 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:31:03.917 ************************************ 00:31:03.917 START TEST nvmf_dif 00:31:03.917 ************************************ 00:31:03.917 05:15:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:03.917 * Looking for test storage... 00:31:03.917 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:03.917 05:15:42 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:03.917 05:15:42 -- nvmf/common.sh@7 -- # uname -s 00:31:03.917 05:15:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:03.917 05:15:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:03.917 05:15:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:03.917 05:15:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:03.917 05:15:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:03.917 05:15:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:03.917 05:15:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:03.917 05:15:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:03.917 05:15:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:03.917 05:15:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:03.917 05:15:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:03.917 05:15:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:03.917 05:15:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:03.917 05:15:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:03.917 05:15:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:03.917 05:15:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:03.917 05:15:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:03.917 05:15:42 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:03.917 05:15:42 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:03.917 05:15:42 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:03.917 05:15:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:03.917 05:15:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:03.917 05:15:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:03.917 05:15:42 -- paths/export.sh@5 -- # export PATH 00:31:03.917 05:15:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:03.917 05:15:42 -- nvmf/common.sh@47 -- # : 0 00:31:03.917 05:15:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:03.917 05:15:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:03.917 05:15:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:03.917 05:15:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:03.917 05:15:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:03.917 05:15:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:03.917 05:15:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:03.917 05:15:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:03.917 05:15:42 -- target/dif.sh@15 -- # NULL_META=16 00:31:03.917 05:15:42 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:03.917 05:15:42 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:03.917 05:15:42 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:03.917 05:15:42 -- target/dif.sh@135 -- # nvmftestinit 00:31:03.917 05:15:42 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:31:03.917 05:15:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:03.917 05:15:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:03.917 05:15:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:03.917 05:15:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:03.917 05:15:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:03.917 05:15:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:03.917 05:15:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:03.917 05:15:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:03.917 05:15:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:03.917 05:15:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:03.917 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:31:05.821 05:15:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:05.821 05:15:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:31:05.821 05:15:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:31:05.821 05:15:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:31:05.821 05:15:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:31:05.821 05:15:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:31:05.821 05:15:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:31:05.821 05:15:44 -- nvmf/common.sh@295 -- # net_devs=() 00:31:05.821 05:15:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:31:05.821 05:15:44 -- nvmf/common.sh@296 -- # e810=() 00:31:05.821 05:15:44 -- nvmf/common.sh@296 -- # local -ga e810 00:31:05.821 05:15:44 -- nvmf/common.sh@297 -- # x722=() 00:31:05.821 05:15:44 -- nvmf/common.sh@297 -- # local -ga x722 00:31:05.821 05:15:44 -- nvmf/common.sh@298 -- # mlx=() 00:31:05.821 05:15:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:31:05.821 05:15:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:05.821 05:15:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:31:05.821 05:15:44 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:31:05.821 05:15:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:31:05.821 05:15:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:05.821 05:15:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:05.821 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:05.821 05:15:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:05.821 05:15:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:05.821 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:05.821 05:15:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:31:05.821 05:15:44 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:31:05.821 05:15:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:05.821 05:15:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:05.821 05:15:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:05.821 05:15:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:05.822 05:15:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:05.822 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:05.822 05:15:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:05.822 05:15:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:05.822 05:15:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:05.822 05:15:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:05.822 05:15:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:05.822 05:15:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:05.822 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:05.822 05:15:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:05.822 05:15:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:31:05.822 05:15:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:31:05.822 05:15:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:31:05.822 05:15:44 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:31:05.822 05:15:44 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:31:05.822 05:15:44 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:05.822 05:15:44 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:05.822 05:15:44 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:05.822 05:15:44 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:31:05.822 05:15:44 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:05.822 05:15:44 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:05.822 05:15:44 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:31:05.822 05:15:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:05.822 05:15:44 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:05.822 05:15:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:31:05.822 05:15:44 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:31:05.822 05:15:44 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:31:05.822 05:15:44 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:05.822 05:15:44 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:05.822 05:15:44 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:05.822 05:15:44 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:31:05.822 05:15:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:05.822 05:15:44 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:05.822 05:15:44 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:05.822 05:15:44 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:31:05.822 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:05.822 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:31:05.822 00:31:05.822 --- 10.0.0.2 ping statistics --- 00:31:05.822 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:05.822 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:31:05.822 05:15:44 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:05.822 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:05.822 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:31:05.822 00:31:05.822 --- 10.0.0.1 ping statistics --- 00:31:05.822 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:05.822 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:31:05.822 05:15:44 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:05.822 05:15:44 -- nvmf/common.sh@411 -- # return 0 00:31:05.822 05:15:44 -- nvmf/common.sh@439 -- # '[' iso == iso ']' 00:31:05.822 05:15:44 -- nvmf/common.sh@440 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:06.757 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:06.757 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:06.757 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:06.757 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:06.757 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:06.757 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:06.757 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:06.757 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:06.757 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:06.757 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:06.757 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:06.757 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:06.757 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:06.757 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:06.757 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:06.757 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:06.757 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:06.757 05:15:45 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:06.757 05:15:45 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:31:06.757 05:15:45 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:31:06.757 05:15:45 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:06.757 05:15:45 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:31:06.757 05:15:45 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:31:06.757 05:15:45 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:06.757 05:15:45 -- target/dif.sh@137 -- # nvmfappstart 00:31:06.757 05:15:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:31:06.757 05:15:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:31:06.757 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:31:06.757 05:15:45 -- nvmf/common.sh@470 -- # nvmfpid=2536796 00:31:06.757 05:15:45 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:06.757 05:15:45 -- nvmf/common.sh@471 -- # waitforlisten 2536796 00:31:06.757 05:15:45 -- common/autotest_common.sh@817 -- # '[' -z 2536796 ']' 00:31:06.757 05:15:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:06.757 05:15:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:06.757 05:15:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:06.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:06.757 05:15:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:06.757 05:15:45 -- common/autotest_common.sh@10 -- # set +x 00:31:07.016 [2024-04-23 05:15:45.949763] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:31:07.016 [2024-04-23 05:15:45.949850] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:07.016 EAL: No free 2048 kB hugepages reported on node 1 00:31:07.016 [2024-04-23 05:15:45.987988] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:31:07.016 [2024-04-23 05:15:46.014302] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:07.016 [2024-04-23 05:15:46.096227] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:07.016 [2024-04-23 05:15:46.096282] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:07.016 [2024-04-23 05:15:46.096311] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:31:07.016 [2024-04-23 05:15:46.096322] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:31:07.016 [2024-04-23 05:15:46.096332] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:07.016 [2024-04-23 05:15:46.096389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:07.274 05:15:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:07.274 05:15:46 -- common/autotest_common.sh@850 -- # return 0 00:31:07.274 05:15:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:31:07.274 05:15:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:31:07.274 05:15:46 -- common/autotest_common.sh@10 -- # set +x 00:31:07.274 05:15:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:07.274 05:15:46 -- target/dif.sh@139 -- # create_transport 00:31:07.274 05:15:46 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:07.274 05:15:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:07.274 05:15:46 -- common/autotest_common.sh@10 -- # set +x 00:31:07.274 [2024-04-23 05:15:46.223439] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:07.274 05:15:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:07.274 05:15:46 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:07.274 05:15:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:07.274 05:15:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:07.274 05:15:46 -- common/autotest_common.sh@10 -- # set +x 00:31:07.274 ************************************ 00:31:07.274 START TEST fio_dif_1_default 00:31:07.274 ************************************ 00:31:07.274 05:15:46 -- common/autotest_common.sh@1111 -- # fio_dif_1 00:31:07.274 05:15:46 -- target/dif.sh@86 -- # create_subsystems 0 00:31:07.274 05:15:46 -- target/dif.sh@28 -- # local sub 00:31:07.275 05:15:46 -- target/dif.sh@30 -- # for sub in "$@" 00:31:07.275 05:15:46 -- target/dif.sh@31 -- # create_subsystem 0 00:31:07.275 05:15:46 -- target/dif.sh@18 -- # local sub_id=0 00:31:07.275 05:15:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:07.275 05:15:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:07.275 05:15:46 -- common/autotest_common.sh@10 -- # set +x 00:31:07.275 bdev_null0 00:31:07.275 05:15:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:07.275 05:15:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:07.275 05:15:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:07.275 05:15:46 -- common/autotest_common.sh@10 -- # set +x 00:31:07.275 05:15:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:07.275 05:15:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:07.275 05:15:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:07.275 05:15:46 -- common/autotest_common.sh@10 -- # set +x 00:31:07.275 05:15:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:07.275 05:15:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:07.275 05:15:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:07.275 05:15:46 -- common/autotest_common.sh@10 -- # set +x 00:31:07.275 [2024-04-23 05:15:46.347938] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:07.275 05:15:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:07.275 05:15:46 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:07.275 05:15:46 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:07.275 05:15:46 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:07.275 05:15:46 -- nvmf/common.sh@521 -- # config=() 00:31:07.275 05:15:46 -- nvmf/common.sh@521 -- # local subsystem config 00:31:07.275 05:15:46 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:07.275 05:15:46 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:07.275 05:15:46 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:07.275 { 00:31:07.275 "params": { 00:31:07.275 "name": "Nvme$subsystem", 00:31:07.275 "trtype": "$TEST_TRANSPORT", 00:31:07.275 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:07.275 "adrfam": "ipv4", 00:31:07.275 "trsvcid": "$NVMF_PORT", 00:31:07.275 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:07.275 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:07.275 "hdgst": ${hdgst:-false}, 00:31:07.275 "ddgst": ${ddgst:-false} 00:31:07.275 }, 00:31:07.275 "method": "bdev_nvme_attach_controller" 00:31:07.275 } 00:31:07.275 EOF 00:31:07.275 )") 00:31:07.275 05:15:46 -- target/dif.sh@82 -- # gen_fio_conf 00:31:07.275 05:15:46 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:07.275 05:15:46 -- target/dif.sh@54 -- # local file 00:31:07.275 05:15:46 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:31:07.275 05:15:46 -- target/dif.sh@56 -- # cat 00:31:07.275 05:15:46 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:07.275 05:15:46 -- common/autotest_common.sh@1325 -- # local sanitizers 00:31:07.275 05:15:46 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:07.275 05:15:46 -- common/autotest_common.sh@1327 -- # shift 00:31:07.275 05:15:46 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:31:07.275 05:15:46 -- nvmf/common.sh@543 -- # cat 00:31:07.275 05:15:46 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:07.275 05:15:46 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:07.275 05:15:46 -- target/dif.sh@72 -- # (( file <= files )) 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # grep libasan 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:07.275 05:15:46 -- nvmf/common.sh@545 -- # jq . 00:31:07.275 05:15:46 -- nvmf/common.sh@546 -- # IFS=, 00:31:07.275 05:15:46 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:31:07.275 "params": { 00:31:07.275 "name": "Nvme0", 00:31:07.275 "trtype": "tcp", 00:31:07.275 "traddr": "10.0.0.2", 00:31:07.275 "adrfam": "ipv4", 00:31:07.275 "trsvcid": "4420", 00:31:07.275 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:07.275 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:07.275 "hdgst": false, 00:31:07.275 "ddgst": false 00:31:07.275 }, 00:31:07.275 "method": "bdev_nvme_attach_controller" 00:31:07.275 }' 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:07.275 05:15:46 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:07.275 05:15:46 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:07.275 05:15:46 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:07.275 05:15:46 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:07.275 05:15:46 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:07.275 05:15:46 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:07.535 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:07.535 fio-3.35 00:31:07.535 Starting 1 thread 00:31:07.535 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.751 00:31:19.751 filename0: (groupid=0, jobs=1): err= 0: pid=2537033: Tue Apr 23 05:15:57 2024 00:31:19.751 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10003msec) 00:31:19.751 slat (nsec): min=4756, max=53465, avg=9346.35, stdev=2847.45 00:31:19.751 clat (usec): min=672, max=49044, avg=21072.54, stdev=20252.44 00:31:19.751 lat (usec): min=680, max=49060, avg=21081.88, stdev=20252.71 00:31:19.751 clat percentiles (usec): 00:31:19.751 | 1.00th=[ 693], 5.00th=[ 701], 10.00th=[ 717], 20.00th=[ 725], 00:31:19.751 | 30.00th=[ 742], 40.00th=[ 783], 50.00th=[41157], 60.00th=[41157], 00:31:19.751 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:19.751 | 99.00th=[41157], 99.50th=[41157], 99.90th=[49021], 99.95th=[49021], 00:31:19.751 | 99.99th=[49021] 00:31:19.751 bw ( KiB/s): min= 672, max= 768, per=100.00%, avg=759.58, stdev=25.78, samples=19 00:31:19.751 iops : min= 168, max= 192, avg=189.89, stdev= 6.45, samples=19 00:31:19.751 lat (usec) : 750=34.60%, 1000=15.19% 00:31:19.751 lat (msec) : 50=50.21% 00:31:19.751 cpu : usr=89.80%, sys=9.91%, ctx=9, majf=0, minf=215 00:31:19.751 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:19.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:19.751 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:19.751 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:19.751 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:19.751 00:31:19.751 Run status group 0 (all jobs): 00:31:19.751 READ: bw=758KiB/s (776kB/s), 758KiB/s-758KiB/s (776kB/s-776kB/s), io=7584KiB (7766kB), run=10003-10003msec 00:31:19.751 05:15:57 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:19.751 05:15:57 -- target/dif.sh@43 -- # local sub 00:31:19.751 05:15:57 -- target/dif.sh@45 -- # for sub in "$@" 00:31:19.751 05:15:57 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:19.751 05:15:57 -- target/dif.sh@36 -- # local sub_id=0 00:31:19.751 05:15:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:19.751 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.751 05:15:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:19.751 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.751 00:31:19.751 real 0m11.032s 00:31:19.751 user 0m10.123s 00:31:19.751 sys 0m1.248s 00:31:19.751 05:15:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 ************************************ 00:31:19.751 END TEST fio_dif_1_default 00:31:19.751 ************************************ 00:31:19.751 05:15:57 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:19.751 05:15:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:19.751 05:15:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 ************************************ 00:31:19.751 START TEST fio_dif_1_multi_subsystems 00:31:19.751 ************************************ 00:31:19.751 05:15:57 -- common/autotest_common.sh@1111 -- # fio_dif_1_multi_subsystems 00:31:19.751 05:15:57 -- target/dif.sh@92 -- # local files=1 00:31:19.751 05:15:57 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:19.751 05:15:57 -- target/dif.sh@28 -- # local sub 00:31:19.751 05:15:57 -- target/dif.sh@30 -- # for sub in "$@" 00:31:19.751 05:15:57 -- target/dif.sh@31 -- # create_subsystem 0 00:31:19.751 05:15:57 -- target/dif.sh@18 -- # local sub_id=0 00:31:19.751 05:15:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:19.751 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 bdev_null0 00:31:19.751 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.751 05:15:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:19.751 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.751 05:15:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:19.751 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.751 05:15:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:19.751 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.751 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.751 [2024-04-23 05:15:57.509814] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:19.751 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.751 05:15:57 -- target/dif.sh@30 -- # for sub in "$@" 00:31:19.751 05:15:57 -- target/dif.sh@31 -- # create_subsystem 1 00:31:19.752 05:15:57 -- target/dif.sh@18 -- # local sub_id=1 00:31:19.752 05:15:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:19.752 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.752 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.752 bdev_null1 00:31:19.752 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.752 05:15:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:19.752 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.752 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.752 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.752 05:15:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:19.752 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.752 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.752 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.752 05:15:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:19.752 05:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:19.752 05:15:57 -- common/autotest_common.sh@10 -- # set +x 00:31:19.752 05:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:19.752 05:15:57 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:19.752 05:15:57 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:19.752 05:15:57 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:19.752 05:15:57 -- nvmf/common.sh@521 -- # config=() 00:31:19.752 05:15:57 -- nvmf/common.sh@521 -- # local subsystem config 00:31:19.752 05:15:57 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:19.752 05:15:57 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:19.752 { 00:31:19.752 "params": { 00:31:19.752 "name": "Nvme$subsystem", 00:31:19.752 "trtype": "$TEST_TRANSPORT", 00:31:19.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:19.752 "adrfam": "ipv4", 00:31:19.752 "trsvcid": "$NVMF_PORT", 00:31:19.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:19.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:19.752 "hdgst": ${hdgst:-false}, 00:31:19.752 "ddgst": ${ddgst:-false} 00:31:19.752 }, 00:31:19.752 "method": "bdev_nvme_attach_controller" 00:31:19.752 } 00:31:19.752 EOF 00:31:19.752 )") 00:31:19.752 05:15:57 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:19.752 05:15:57 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:19.752 05:15:57 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:31:19.752 05:15:57 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:19.752 05:15:57 -- common/autotest_common.sh@1325 -- # local sanitizers 00:31:19.752 05:15:57 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:19.752 05:15:57 -- common/autotest_common.sh@1327 -- # shift 00:31:19.752 05:15:57 -- target/dif.sh@82 -- # gen_fio_conf 00:31:19.752 05:15:57 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:31:19.752 05:15:57 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:19.752 05:15:57 -- target/dif.sh@54 -- # local file 00:31:19.752 05:15:57 -- target/dif.sh@56 -- # cat 00:31:19.752 05:15:57 -- nvmf/common.sh@543 -- # cat 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # grep libasan 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:19.752 05:15:57 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:19.752 05:15:57 -- target/dif.sh@72 -- # (( file <= files )) 00:31:19.752 05:15:57 -- target/dif.sh@73 -- # cat 00:31:19.752 05:15:57 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:19.752 05:15:57 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:19.752 { 00:31:19.752 "params": { 00:31:19.752 "name": "Nvme$subsystem", 00:31:19.752 "trtype": "$TEST_TRANSPORT", 00:31:19.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:19.752 "adrfam": "ipv4", 00:31:19.752 "trsvcid": "$NVMF_PORT", 00:31:19.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:19.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:19.752 "hdgst": ${hdgst:-false}, 00:31:19.752 "ddgst": ${ddgst:-false} 00:31:19.752 }, 00:31:19.752 "method": "bdev_nvme_attach_controller" 00:31:19.752 } 00:31:19.752 EOF 00:31:19.752 )") 00:31:19.752 05:15:57 -- nvmf/common.sh@543 -- # cat 00:31:19.752 05:15:57 -- target/dif.sh@72 -- # (( file++ )) 00:31:19.752 05:15:57 -- target/dif.sh@72 -- # (( file <= files )) 00:31:19.752 05:15:57 -- nvmf/common.sh@545 -- # jq . 00:31:19.752 05:15:57 -- nvmf/common.sh@546 -- # IFS=, 00:31:19.752 05:15:57 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:31:19.752 "params": { 00:31:19.752 "name": "Nvme0", 00:31:19.752 "trtype": "tcp", 00:31:19.752 "traddr": "10.0.0.2", 00:31:19.752 "adrfam": "ipv4", 00:31:19.752 "trsvcid": "4420", 00:31:19.752 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:19.752 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:19.752 "hdgst": false, 00:31:19.752 "ddgst": false 00:31:19.752 }, 00:31:19.752 "method": "bdev_nvme_attach_controller" 00:31:19.752 },{ 00:31:19.752 "params": { 00:31:19.752 "name": "Nvme1", 00:31:19.752 "trtype": "tcp", 00:31:19.752 "traddr": "10.0.0.2", 00:31:19.752 "adrfam": "ipv4", 00:31:19.752 "trsvcid": "4420", 00:31:19.752 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:19.752 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:19.752 "hdgst": false, 00:31:19.752 "ddgst": false 00:31:19.752 }, 00:31:19.752 "method": "bdev_nvme_attach_controller" 00:31:19.752 }' 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:19.752 05:15:57 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:19.752 05:15:57 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:19.752 05:15:57 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:19.752 05:15:57 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:19.752 05:15:57 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:19.752 05:15:57 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:19.752 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:19.752 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:19.752 fio-3.35 00:31:19.752 Starting 2 threads 00:31:19.752 EAL: No free 2048 kB hugepages reported on node 1 00:31:29.798 00:31:29.798 filename0: (groupid=0, jobs=1): err= 0: pid=2538444: Tue Apr 23 05:16:08 2024 00:31:29.798 read: IOPS=189, BW=759KiB/s (777kB/s)(7616KiB/10040msec) 00:31:29.798 slat (nsec): min=4236, max=36814, avg=9133.54, stdev=3553.99 00:31:29.798 clat (usec): min=692, max=43370, avg=21062.76, stdev=20171.86 00:31:29.798 lat (usec): min=699, max=43388, avg=21071.89, stdev=20171.86 00:31:29.798 clat percentiles (usec): 00:31:29.798 | 1.00th=[ 717], 5.00th=[ 750], 10.00th=[ 766], 20.00th=[ 799], 00:31:29.798 | 30.00th=[ 832], 40.00th=[ 848], 50.00th=[41157], 60.00th=[41157], 00:31:29.798 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:29.798 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43254], 99.95th=[43254], 00:31:29.798 | 99.99th=[43254] 00:31:29.798 bw ( KiB/s): min= 672, max= 768, per=50.20%, avg=760.00, stdev=25.16, samples=20 00:31:29.798 iops : min= 168, max= 192, avg=190.00, stdev= 6.29, samples=20 00:31:29.798 lat (usec) : 750=5.36%, 1000=44.43% 00:31:29.798 lat (msec) : 50=50.21% 00:31:29.798 cpu : usr=94.68%, sys=5.01%, ctx=19, majf=0, minf=182 00:31:29.798 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:29.798 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.798 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.798 issued rwts: total=1904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:29.798 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:29.798 filename1: (groupid=0, jobs=1): err= 0: pid=2538445: Tue Apr 23 05:16:08 2024 00:31:29.798 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10003msec) 00:31:29.798 slat (nsec): min=4770, max=45926, avg=9075.77, stdev=3276.26 00:31:29.798 clat (usec): min=707, max=44345, avg=21073.69, stdev=20155.11 00:31:29.798 lat (usec): min=715, max=44357, avg=21082.77, stdev=20155.07 00:31:29.798 clat percentiles (usec): 00:31:29.798 | 1.00th=[ 734], 5.00th=[ 791], 10.00th=[ 807], 20.00th=[ 824], 00:31:29.798 | 30.00th=[ 848], 40.00th=[ 873], 50.00th=[40633], 60.00th=[41157], 00:31:29.798 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:29.798 | 99.00th=[41681], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:31:29.798 | 99.99th=[44303] 00:31:29.798 bw ( KiB/s): min= 672, max= 768, per=50.13%, avg=759.58, stdev=25.78, samples=19 00:31:29.798 iops : min= 168, max= 192, avg=189.89, stdev= 6.45, samples=19 00:31:29.798 lat (usec) : 750=2.06%, 1000=47.10% 00:31:29.798 lat (msec) : 2=0.63%, 50=50.21% 00:31:29.798 cpu : usr=95.09%, sys=4.61%, ctx=12, majf=0, minf=87 00:31:29.798 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:29.798 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.798 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.798 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:29.798 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:29.798 00:31:29.798 Run status group 0 (all jobs): 00:31:29.798 READ: bw=1514KiB/s (1550kB/s), 758KiB/s-759KiB/s (776kB/s-777kB/s), io=14.8MiB (15.6MB), run=10003-10040msec 00:31:29.798 05:16:08 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:29.798 05:16:08 -- target/dif.sh@43 -- # local sub 00:31:29.798 05:16:08 -- target/dif.sh@45 -- # for sub in "$@" 00:31:29.798 05:16:08 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:29.798 05:16:08 -- target/dif.sh@36 -- # local sub_id=0 00:31:29.798 05:16:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:29.798 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:29.798 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.798 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:29.798 05:16:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:29.798 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:29.798 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.798 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:29.798 05:16:08 -- target/dif.sh@45 -- # for sub in "$@" 00:31:29.798 05:16:08 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:29.798 05:16:08 -- target/dif.sh@36 -- # local sub_id=1 00:31:29.798 05:16:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:29.798 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:29.798 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.798 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:29.798 05:16:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:29.798 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:29.798 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.798 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:29.798 00:31:29.798 real 0m11.338s 00:31:29.798 user 0m20.226s 00:31:29.798 sys 0m1.281s 00:31:29.798 05:16:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:29.798 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.798 ************************************ 00:31:29.798 END TEST fio_dif_1_multi_subsystems 00:31:29.798 ************************************ 00:31:29.798 05:16:08 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:29.798 05:16:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:29.798 05:16:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:29.798 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.798 ************************************ 00:31:29.798 START TEST fio_dif_rand_params 00:31:29.798 ************************************ 00:31:29.799 05:16:08 -- common/autotest_common.sh@1111 -- # fio_dif_rand_params 00:31:29.799 05:16:08 -- target/dif.sh@100 -- # local NULL_DIF 00:31:29.799 05:16:08 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:29.799 05:16:08 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:29.799 05:16:08 -- target/dif.sh@103 -- # bs=128k 00:31:29.799 05:16:08 -- target/dif.sh@103 -- # numjobs=3 00:31:29.799 05:16:08 -- target/dif.sh@103 -- # iodepth=3 00:31:29.799 05:16:08 -- target/dif.sh@103 -- # runtime=5 00:31:29.799 05:16:08 -- target/dif.sh@105 -- # create_subsystems 0 00:31:29.799 05:16:08 -- target/dif.sh@28 -- # local sub 00:31:29.799 05:16:08 -- target/dif.sh@30 -- # for sub in "$@" 00:31:29.799 05:16:08 -- target/dif.sh@31 -- # create_subsystem 0 00:31:29.799 05:16:08 -- target/dif.sh@18 -- # local sub_id=0 00:31:29.799 05:16:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:29.799 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:29.799 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.799 bdev_null0 00:31:29.799 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:29.799 05:16:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:29.799 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:29.799 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:29.799 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:29.799 05:16:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:29.799 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:29.799 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:30.060 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:30.060 05:16:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:30.060 05:16:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:30.060 05:16:08 -- common/autotest_common.sh@10 -- # set +x 00:31:30.060 [2024-04-23 05:16:08.971440] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:30.060 05:16:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:30.060 05:16:08 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:30.060 05:16:08 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:30.060 05:16:08 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:30.060 05:16:08 -- nvmf/common.sh@521 -- # config=() 00:31:30.060 05:16:08 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:30.060 05:16:08 -- nvmf/common.sh@521 -- # local subsystem config 00:31:30.060 05:16:08 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:30.060 05:16:08 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:30.060 05:16:08 -- target/dif.sh@82 -- # gen_fio_conf 00:31:30.060 05:16:08 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:31:30.060 05:16:08 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:30.060 { 00:31:30.060 "params": { 00:31:30.060 "name": "Nvme$subsystem", 00:31:30.060 "trtype": "$TEST_TRANSPORT", 00:31:30.060 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:30.060 "adrfam": "ipv4", 00:31:30.060 "trsvcid": "$NVMF_PORT", 00:31:30.060 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:30.060 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:30.060 "hdgst": ${hdgst:-false}, 00:31:30.060 "ddgst": ${ddgst:-false} 00:31:30.060 }, 00:31:30.060 "method": "bdev_nvme_attach_controller" 00:31:30.060 } 00:31:30.060 EOF 00:31:30.060 )") 00:31:30.060 05:16:08 -- target/dif.sh@54 -- # local file 00:31:30.060 05:16:08 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:30.060 05:16:08 -- target/dif.sh@56 -- # cat 00:31:30.060 05:16:08 -- common/autotest_common.sh@1325 -- # local sanitizers 00:31:30.060 05:16:08 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:30.060 05:16:08 -- common/autotest_common.sh@1327 -- # shift 00:31:30.060 05:16:08 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:31:30.060 05:16:08 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:30.060 05:16:08 -- nvmf/common.sh@543 -- # cat 00:31:30.060 05:16:08 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:30.060 05:16:08 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:30.060 05:16:08 -- target/dif.sh@72 -- # (( file <= files )) 00:31:30.060 05:16:08 -- common/autotest_common.sh@1331 -- # grep libasan 00:31:30.060 05:16:08 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:30.060 05:16:08 -- nvmf/common.sh@545 -- # jq . 00:31:30.060 05:16:08 -- nvmf/common.sh@546 -- # IFS=, 00:31:30.060 05:16:08 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:31:30.060 "params": { 00:31:30.060 "name": "Nvme0", 00:31:30.060 "trtype": "tcp", 00:31:30.060 "traddr": "10.0.0.2", 00:31:30.060 "adrfam": "ipv4", 00:31:30.060 "trsvcid": "4420", 00:31:30.060 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:30.060 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:30.060 "hdgst": false, 00:31:30.060 "ddgst": false 00:31:30.060 }, 00:31:30.060 "method": "bdev_nvme_attach_controller" 00:31:30.060 }' 00:31:30.060 05:16:08 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:30.060 05:16:08 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:30.060 05:16:08 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:30.060 05:16:09 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:30.060 05:16:09 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:31:30.060 05:16:09 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:30.060 05:16:09 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:30.060 05:16:09 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:30.060 05:16:09 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:30.061 05:16:09 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:30.319 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:30.319 ... 00:31:30.319 fio-3.35 00:31:30.319 Starting 3 threads 00:31:30.319 EAL: No free 2048 kB hugepages reported on node 1 00:31:36.880 00:31:36.880 filename0: (groupid=0, jobs=1): err= 0: pid=2539851: Tue Apr 23 05:16:14 2024 00:31:36.880 read: IOPS=207, BW=26.0MiB/s (27.2MB/s)(131MiB/5044msec) 00:31:36.880 slat (nsec): min=7224, max=43272, avg=13486.75, stdev=4347.52 00:31:36.880 clat (usec): min=5073, max=55766, avg=14380.33, stdev=11223.89 00:31:36.880 lat (usec): min=5089, max=55779, avg=14393.81, stdev=11223.73 00:31:36.880 clat percentiles (usec): 00:31:36.880 | 1.00th=[ 5538], 5.00th=[ 6063], 10.00th=[ 7635], 20.00th=[ 8717], 00:31:36.880 | 30.00th=[ 9503], 40.00th=[10421], 50.00th=[11600], 60.00th=[12518], 00:31:36.880 | 70.00th=[13435], 80.00th=[14615], 90.00th=[16909], 95.00th=[50594], 00:31:36.880 | 99.00th=[54264], 99.50th=[54264], 99.90th=[55837], 99.95th=[55837], 00:31:36.881 | 99.99th=[55837] 00:31:36.881 bw ( KiB/s): min=20736, max=35584, per=33.75%, avg=26757.20, stdev=4104.82, samples=10 00:31:36.881 iops : min= 162, max= 278, avg=209.00, stdev=32.07, samples=10 00:31:36.881 lat (msec) : 10=36.74%, 20=55.34%, 50=1.62%, 100=6.30% 00:31:36.881 cpu : usr=90.52%, sys=9.02%, ctx=9, majf=0, minf=125 00:31:36.881 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:36.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.881 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.881 issued rwts: total=1048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:36.881 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:36.881 filename0: (groupid=0, jobs=1): err= 0: pid=2539852: Tue Apr 23 05:16:14 2024 00:31:36.881 read: IOPS=219, BW=27.4MiB/s (28.7MB/s)(137MiB/5007msec) 00:31:36.881 slat (nsec): min=7158, max=41423, avg=13328.54, stdev=4134.05 00:31:36.881 clat (usec): min=5100, max=57926, avg=13660.51, stdev=10340.47 00:31:36.881 lat (usec): min=5112, max=57939, avg=13673.84, stdev=10340.57 00:31:36.881 clat percentiles (usec): 00:31:36.881 | 1.00th=[ 5407], 5.00th=[ 5997], 10.00th=[ 7373], 20.00th=[ 8848], 00:31:36.881 | 30.00th=[ 9634], 40.00th=[10421], 50.00th=[11207], 60.00th=[11863], 00:31:36.881 | 70.00th=[12911], 80.00th=[14091], 90.00th=[16450], 95.00th=[49546], 00:31:36.881 | 99.00th=[53216], 99.50th=[53740], 99.90th=[57410], 99.95th=[57934], 00:31:36.881 | 99.99th=[57934] 00:31:36.881 bw ( KiB/s): min=19968, max=33536, per=35.36%, avg=28032.00, stdev=4597.32, samples=10 00:31:36.881 iops : min= 156, max= 262, avg=219.00, stdev=35.92, samples=10 00:31:36.881 lat (msec) : 10=35.06%, 20=58.29%, 50=2.55%, 100=4.10% 00:31:36.881 cpu : usr=91.43%, sys=8.11%, ctx=8, majf=0, minf=110 00:31:36.881 IO depths : 1=0.7%, 2=99.3%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:36.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.881 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.881 issued rwts: total=1098,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:36.881 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:36.881 filename0: (groupid=0, jobs=1): err= 0: pid=2539853: Tue Apr 23 05:16:14 2024 00:31:36.881 read: IOPS=194, BW=24.3MiB/s (25.5MB/s)(123MiB/5047msec) 00:31:36.881 slat (nsec): min=7167, max=46506, avg=13963.12, stdev=4983.45 00:31:36.881 clat (usec): min=5007, max=55414, avg=15389.03, stdev=12657.78 00:31:36.881 lat (usec): min=5019, max=55434, avg=15402.99, stdev=12657.77 00:31:36.881 clat percentiles (usec): 00:31:36.881 | 1.00th=[ 5669], 5.00th=[ 6128], 10.00th=[ 7701], 20.00th=[ 8717], 00:31:36.881 | 30.00th=[ 9503], 40.00th=[10421], 50.00th=[11731], 60.00th=[12649], 00:31:36.881 | 70.00th=[13698], 80.00th=[15008], 90.00th=[47449], 95.00th=[51119], 00:31:36.881 | 99.00th=[53740], 99.50th=[54789], 99.90th=[55313], 99.95th=[55313], 00:31:36.881 | 99.99th=[55313] 00:31:36.881 bw ( KiB/s): min=17664, max=31232, per=31.55%, avg=25011.20, stdev=4047.81, samples=10 00:31:36.881 iops : min= 138, max= 244, avg=195.40, stdev=31.62, samples=10 00:31:36.881 lat (msec) : 10=36.12%, 20=53.27%, 50=3.16%, 100=7.45% 00:31:36.881 cpu : usr=90.98%, sys=8.58%, ctx=11, majf=0, minf=42 00:31:36.881 IO depths : 1=0.7%, 2=99.3%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:36.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.881 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.881 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:36.881 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:36.881 00:31:36.881 Run status group 0 (all jobs): 00:31:36.881 READ: bw=77.4MiB/s (81.2MB/s), 24.3MiB/s-27.4MiB/s (25.5MB/s-28.7MB/s), io=391MiB (410MB), run=5007-5047msec 00:31:36.881 05:16:15 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:36.881 05:16:15 -- target/dif.sh@43 -- # local sub 00:31:36.881 05:16:15 -- target/dif.sh@45 -- # for sub in "$@" 00:31:36.881 05:16:15 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:36.881 05:16:15 -- target/dif.sh@36 -- # local sub_id=0 00:31:36.881 05:16:15 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:36.881 05:16:15 -- target/dif.sh@109 -- # bs=4k 00:31:36.881 05:16:15 -- target/dif.sh@109 -- # numjobs=8 00:31:36.881 05:16:15 -- target/dif.sh@109 -- # iodepth=16 00:31:36.881 05:16:15 -- target/dif.sh@109 -- # runtime= 00:31:36.881 05:16:15 -- target/dif.sh@109 -- # files=2 00:31:36.881 05:16:15 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:36.881 05:16:15 -- target/dif.sh@28 -- # local sub 00:31:36.881 05:16:15 -- target/dif.sh@30 -- # for sub in "$@" 00:31:36.881 05:16:15 -- target/dif.sh@31 -- # create_subsystem 0 00:31:36.881 05:16:15 -- target/dif.sh@18 -- # local sub_id=0 00:31:36.881 05:16:15 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 bdev_null0 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 [2024-04-23 05:16:15.149521] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@30 -- # for sub in "$@" 00:31:36.881 05:16:15 -- target/dif.sh@31 -- # create_subsystem 1 00:31:36.881 05:16:15 -- target/dif.sh@18 -- # local sub_id=1 00:31:36.881 05:16:15 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 bdev_null1 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@30 -- # for sub in "$@" 00:31:36.881 05:16:15 -- target/dif.sh@31 -- # create_subsystem 2 00:31:36.881 05:16:15 -- target/dif.sh@18 -- # local sub_id=2 00:31:36.881 05:16:15 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 bdev_null2 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.881 05:16:15 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:36.881 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.881 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.881 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.882 05:16:15 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:36.882 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.882 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.882 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.882 05:16:15 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:36.882 05:16:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:36.882 05:16:15 -- common/autotest_common.sh@10 -- # set +x 00:31:36.882 05:16:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:36.882 05:16:15 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:36.882 05:16:15 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:36.882 05:16:15 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:36.882 05:16:15 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:36.882 05:16:15 -- nvmf/common.sh@521 -- # config=() 00:31:36.882 05:16:15 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:36.882 05:16:15 -- target/dif.sh@82 -- # gen_fio_conf 00:31:36.882 05:16:15 -- nvmf/common.sh@521 -- # local subsystem config 00:31:36.882 05:16:15 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:31:36.882 05:16:15 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:36.882 05:16:15 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:36.882 05:16:15 -- target/dif.sh@54 -- # local file 00:31:36.882 05:16:15 -- common/autotest_common.sh@1325 -- # local sanitizers 00:31:36.882 05:16:15 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:36.882 { 00:31:36.882 "params": { 00:31:36.882 "name": "Nvme$subsystem", 00:31:36.882 "trtype": "$TEST_TRANSPORT", 00:31:36.882 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:36.882 "adrfam": "ipv4", 00:31:36.882 "trsvcid": "$NVMF_PORT", 00:31:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:36.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:36.882 "hdgst": ${hdgst:-false}, 00:31:36.882 "ddgst": ${ddgst:-false} 00:31:36.882 }, 00:31:36.882 "method": "bdev_nvme_attach_controller" 00:31:36.882 } 00:31:36.882 EOF 00:31:36.882 )") 00:31:36.882 05:16:15 -- target/dif.sh@56 -- # cat 00:31:36.882 05:16:15 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:36.882 05:16:15 -- common/autotest_common.sh@1327 -- # shift 00:31:36.882 05:16:15 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:31:36.882 05:16:15 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:36.882 05:16:15 -- nvmf/common.sh@543 -- # cat 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:36.882 05:16:15 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # grep libasan 00:31:36.882 05:16:15 -- target/dif.sh@72 -- # (( file <= files )) 00:31:36.882 05:16:15 -- target/dif.sh@73 -- # cat 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:36.882 05:16:15 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:36.882 05:16:15 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:36.882 { 00:31:36.882 "params": { 00:31:36.882 "name": "Nvme$subsystem", 00:31:36.882 "trtype": "$TEST_TRANSPORT", 00:31:36.882 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:36.882 "adrfam": "ipv4", 00:31:36.882 "trsvcid": "$NVMF_PORT", 00:31:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:36.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:36.882 "hdgst": ${hdgst:-false}, 00:31:36.882 "ddgst": ${ddgst:-false} 00:31:36.882 }, 00:31:36.882 "method": "bdev_nvme_attach_controller" 00:31:36.882 } 00:31:36.882 EOF 00:31:36.882 )") 00:31:36.882 05:16:15 -- target/dif.sh@72 -- # (( file++ )) 00:31:36.882 05:16:15 -- target/dif.sh@72 -- # (( file <= files )) 00:31:36.882 05:16:15 -- target/dif.sh@73 -- # cat 00:31:36.882 05:16:15 -- nvmf/common.sh@543 -- # cat 00:31:36.882 05:16:15 -- target/dif.sh@72 -- # (( file++ )) 00:31:36.882 05:16:15 -- target/dif.sh@72 -- # (( file <= files )) 00:31:36.882 05:16:15 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:36.882 05:16:15 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:36.882 { 00:31:36.882 "params": { 00:31:36.882 "name": "Nvme$subsystem", 00:31:36.882 "trtype": "$TEST_TRANSPORT", 00:31:36.882 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:36.882 "adrfam": "ipv4", 00:31:36.882 "trsvcid": "$NVMF_PORT", 00:31:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:36.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:36.882 "hdgst": ${hdgst:-false}, 00:31:36.882 "ddgst": ${ddgst:-false} 00:31:36.882 }, 00:31:36.882 "method": "bdev_nvme_attach_controller" 00:31:36.882 } 00:31:36.882 EOF 00:31:36.882 )") 00:31:36.882 05:16:15 -- nvmf/common.sh@543 -- # cat 00:31:36.882 05:16:15 -- nvmf/common.sh@545 -- # jq . 00:31:36.882 05:16:15 -- nvmf/common.sh@546 -- # IFS=, 00:31:36.882 05:16:15 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:31:36.882 "params": { 00:31:36.882 "name": "Nvme0", 00:31:36.882 "trtype": "tcp", 00:31:36.882 "traddr": "10.0.0.2", 00:31:36.882 "adrfam": "ipv4", 00:31:36.882 "trsvcid": "4420", 00:31:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:36.882 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:36.882 "hdgst": false, 00:31:36.882 "ddgst": false 00:31:36.882 }, 00:31:36.882 "method": "bdev_nvme_attach_controller" 00:31:36.882 },{ 00:31:36.882 "params": { 00:31:36.882 "name": "Nvme1", 00:31:36.882 "trtype": "tcp", 00:31:36.882 "traddr": "10.0.0.2", 00:31:36.882 "adrfam": "ipv4", 00:31:36.882 "trsvcid": "4420", 00:31:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:36.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:36.882 "hdgst": false, 00:31:36.882 "ddgst": false 00:31:36.882 }, 00:31:36.882 "method": "bdev_nvme_attach_controller" 00:31:36.882 },{ 00:31:36.882 "params": { 00:31:36.882 "name": "Nvme2", 00:31:36.882 "trtype": "tcp", 00:31:36.882 "traddr": "10.0.0.2", 00:31:36.882 "adrfam": "ipv4", 00:31:36.882 "trsvcid": "4420", 00:31:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:36.882 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:36.882 "hdgst": false, 00:31:36.882 "ddgst": false 00:31:36.882 }, 00:31:36.882 "method": "bdev_nvme_attach_controller" 00:31:36.882 }' 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:36.882 05:16:15 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:36.882 05:16:15 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:36.882 05:16:15 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:36.882 05:16:15 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:36.882 05:16:15 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:36.882 05:16:15 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:36.882 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:36.882 ... 00:31:36.882 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:36.882 ... 00:31:36.882 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:36.882 ... 00:31:36.882 fio-3.35 00:31:36.882 Starting 24 threads 00:31:36.882 EAL: No free 2048 kB hugepages reported on node 1 00:31:49.085 00:31:49.085 filename0: (groupid=0, jobs=1): err= 0: pid=2540705: Tue Apr 23 05:16:26 2024 00:31:49.085 read: IOPS=466, BW=1867KiB/s (1911kB/s)(18.2MiB/10007msec) 00:31:49.085 slat (usec): min=8, max=103, avg=32.44, stdev=16.22 00:31:49.085 clat (usec): min=7342, max=68533, avg=34005.72, stdev=3196.32 00:31:49.085 lat (usec): min=7356, max=68566, avg=34038.16, stdev=3196.67 00:31:49.085 clat percentiles (usec): 00:31:49.085 | 1.00th=[32113], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.085 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.085 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.085 | 99.00th=[41157], 99.50th=[54264], 99.90th=[68682], 99.95th=[68682], 00:31:49.085 | 99.99th=[68682] 00:31:49.085 bw ( KiB/s): min= 1664, max= 1920, per=4.15%, avg=1852.63, stdev=74.40, samples=19 00:31:49.085 iops : min= 416, max= 480, avg=463.16, stdev=18.60, samples=19 00:31:49.086 lat (msec) : 10=0.34%, 20=0.49%, 50=98.63%, 100=0.54% 00:31:49.086 cpu : usr=98.43%, sys=1.18%, ctx=28, majf=0, minf=78 00:31:49.086 IO depths : 1=2.5%, 2=8.7%, 4=24.9%, 8=53.9%, 16=10.0%, 32=0.0%, >=64=0.0% 00:31:49.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 complete : 0=0.0%, 4=94.3%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 issued rwts: total=4670,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.086 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.086 filename0: (groupid=0, jobs=1): err= 0: pid=2540706: Tue Apr 23 05:16:26 2024 00:31:49.086 read: IOPS=467, BW=1872KiB/s (1917kB/s)(18.3MiB/10019msec) 00:31:49.086 slat (usec): min=8, max=101, avg=29.52, stdev=12.29 00:31:49.086 clat (usec): min=12693, max=45026, avg=33970.70, stdev=1824.11 00:31:49.086 lat (usec): min=12711, max=45063, avg=34000.22, stdev=1823.71 00:31:49.086 clat percentiles (usec): 00:31:49.086 | 1.00th=[30016], 5.00th=[33424], 10.00th=[33424], 20.00th=[33817], 00:31:49.086 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.086 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.086 | 99.00th=[40633], 99.50th=[40633], 99.90th=[44827], 99.95th=[44827], 00:31:49.086 | 99.99th=[44827] 00:31:49.086 bw ( KiB/s): min= 1792, max= 1920, per=4.19%, avg=1868.80, stdev=64.34, samples=20 00:31:49.086 iops : min= 448, max= 480, avg=467.20, stdev=16.08, samples=20 00:31:49.086 lat (msec) : 20=0.34%, 50=99.66% 00:31:49.086 cpu : usr=97.30%, sys=1.85%, ctx=135, majf=0, minf=84 00:31:49.086 IO depths : 1=2.6%, 2=8.8%, 4=25.0%, 8=53.7%, 16=9.9%, 32=0.0%, >=64=0.0% 00:31:49.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 issued rwts: total=4688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.086 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.086 filename0: (groupid=0, jobs=1): err= 0: pid=2540707: Tue Apr 23 05:16:26 2024 00:31:49.086 read: IOPS=470, BW=1883KiB/s (1928kB/s)(18.4MiB/10029msec) 00:31:49.086 slat (usec): min=5, max=137, avg=45.87, stdev=29.56 00:31:49.086 clat (usec): min=3975, max=44925, avg=33602.53, stdev=3273.37 00:31:49.086 lat (usec): min=3981, max=44946, avg=33648.40, stdev=3275.55 00:31:49.086 clat percentiles (usec): 00:31:49.086 | 1.00th=[ 9634], 5.00th=[32637], 10.00th=[32900], 20.00th=[33424], 00:31:49.086 | 30.00th=[33424], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.086 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.086 | 99.00th=[40109], 99.50th=[42730], 99.90th=[44827], 99.95th=[44827], 00:31:49.086 | 99.99th=[44827] 00:31:49.086 bw ( KiB/s): min= 1792, max= 2048, per=4.22%, avg=1881.60, stdev=73.12, samples=20 00:31:49.086 iops : min= 448, max= 512, avg=470.40, stdev=18.28, samples=20 00:31:49.086 lat (msec) : 4=0.08%, 10=1.08%, 20=0.19%, 50=98.64% 00:31:49.086 cpu : usr=97.18%, sys=1.94%, ctx=131, majf=0, minf=95 00:31:49.086 IO depths : 1=6.1%, 2=12.3%, 4=24.7%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:49.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 issued rwts: total=4720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.086 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.086 filename0: (groupid=0, jobs=1): err= 0: pid=2540708: Tue Apr 23 05:16:26 2024 00:31:49.086 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10006msec) 00:31:49.086 slat (usec): min=9, max=112, avg=36.87, stdev=12.42 00:31:49.086 clat (usec): min=32317, max=52134, avg=34067.91, stdev=1584.41 00:31:49.086 lat (usec): min=32377, max=52167, avg=34104.78, stdev=1584.42 00:31:49.086 clat percentiles (usec): 00:31:49.086 | 1.00th=[32900], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.086 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.086 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[36439], 00:31:49.086 | 99.00th=[40633], 99.50th=[44827], 99.90th=[52167], 99.95th=[52167], 00:31:49.086 | 99.99th=[52167] 00:31:49.086 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.086 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.086 lat (msec) : 50=99.66%, 100=0.34% 00:31:49.086 cpu : usr=96.31%, sys=2.12%, ctx=48, majf=0, minf=73 00:31:49.086 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.086 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.086 filename0: (groupid=0, jobs=1): err= 0: pid=2540709: Tue Apr 23 05:16:26 2024 00:31:49.086 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10006msec) 00:31:49.086 slat (usec): min=13, max=128, avg=38.52, stdev=13.93 00:31:49.086 clat (usec): min=32127, max=52158, avg=34030.17, stdev=1592.11 00:31:49.086 lat (usec): min=32171, max=52194, avg=34068.69, stdev=1592.19 00:31:49.086 clat percentiles (usec): 00:31:49.086 | 1.00th=[32637], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.086 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.086 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[36439], 00:31:49.086 | 99.00th=[40633], 99.50th=[44827], 99.90th=[52167], 99.95th=[52167], 00:31:49.086 | 99.99th=[52167] 00:31:49.086 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.086 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.086 lat (msec) : 50=99.66%, 100=0.34% 00:31:49.086 cpu : usr=97.71%, sys=1.51%, ctx=68, majf=0, minf=65 00:31:49.086 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.086 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.086 filename0: (groupid=0, jobs=1): err= 0: pid=2540710: Tue Apr 23 05:16:26 2024 00:31:49.086 read: IOPS=471, BW=1887KiB/s (1932kB/s)(18.4MiB/10007msec) 00:31:49.086 slat (usec): min=8, max=125, avg=30.28, stdev=20.63 00:31:49.086 clat (usec): min=7867, max=67768, avg=33703.97, stdev=8512.47 00:31:49.086 lat (usec): min=7877, max=67811, avg=33734.25, stdev=8515.29 00:31:49.086 clat percentiles (usec): 00:31:49.086 | 1.00th=[14222], 5.00th=[14484], 10.00th=[24249], 20.00th=[33424], 00:31:49.086 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.086 | 70.00th=[33817], 80.00th=[34341], 90.00th=[39060], 95.00th=[53216], 00:31:49.086 | 99.00th=[54264], 99.50th=[63177], 99.90th=[65799], 99.95th=[65799], 00:31:49.086 | 99.99th=[67634] 00:31:49.086 bw ( KiB/s): min= 1664, max= 2064, per=4.20%, avg=1872.84, stdev=92.60, samples=19 00:31:49.086 iops : min= 416, max= 516, avg=468.21, stdev=23.15, samples=19 00:31:49.086 lat (msec) : 10=0.19%, 20=8.54%, 50=83.09%, 100=8.18% 00:31:49.086 cpu : usr=98.09%, sys=1.51%, ctx=36, majf=0, minf=103 00:31:49.086 IO depths : 1=0.4%, 2=4.5%, 4=16.7%, 8=64.6%, 16=13.8%, 32=0.0%, >=64=0.0% 00:31:49.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 complete : 0=0.0%, 4=92.6%, 8=3.5%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 issued rwts: total=4720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.086 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.086 filename0: (groupid=0, jobs=1): err= 0: pid=2540711: Tue Apr 23 05:16:26 2024 00:31:49.086 read: IOPS=465, BW=1863KiB/s (1908kB/s)(18.2MiB/10007msec) 00:31:49.086 slat (usec): min=8, max=134, avg=54.83, stdev=29.02 00:31:49.086 clat (usec): min=7333, max=68371, avg=33843.54, stdev=3416.55 00:31:49.086 lat (usec): min=7341, max=68402, avg=33898.37, stdev=3416.04 00:31:49.086 clat percentiles (usec): 00:31:49.086 | 1.00th=[32113], 5.00th=[32637], 10.00th=[32900], 20.00th=[33162], 00:31:49.086 | 30.00th=[33424], 40.00th=[33424], 50.00th=[33817], 60.00th=[33817], 00:31:49.086 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[35914], 00:31:49.086 | 99.00th=[45351], 99.50th=[56361], 99.90th=[68682], 99.95th=[68682], 00:31:49.086 | 99.99th=[68682] 00:31:49.086 bw ( KiB/s): min= 1664, max= 1920, per=4.14%, avg=1848.42, stdev=83.71, samples=19 00:31:49.086 iops : min= 416, max= 480, avg=462.11, stdev=20.93, samples=19 00:31:49.086 lat (msec) : 10=0.34%, 20=0.47%, 50=98.50%, 100=0.69% 00:31:49.086 cpu : usr=97.73%, sys=1.54%, ctx=117, majf=0, minf=61 00:31:49.086 IO depths : 1=6.2%, 2=12.4%, 4=24.8%, 8=50.3%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:49.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.086 issued rwts: total=4662,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.086 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.086 filename0: (groupid=0, jobs=1): err= 0: pid=2540712: Tue Apr 23 05:16:26 2024 00:31:49.086 read: IOPS=465, BW=1864KiB/s (1908kB/s)(18.2MiB/10006msec) 00:31:49.086 slat (usec): min=8, max=126, avg=31.02, stdev=13.70 00:31:49.086 clat (usec): min=11001, max=74407, avg=34047.56, stdev=3204.89 00:31:49.086 lat (usec): min=11064, max=74439, avg=34078.58, stdev=3204.41 00:31:49.086 clat percentiles (usec): 00:31:49.087 | 1.00th=[28967], 5.00th=[33424], 10.00th=[33424], 20.00th=[33424], 00:31:49.087 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.087 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.087 | 99.00th=[41157], 99.50th=[56361], 99.90th=[71828], 99.95th=[72877], 00:31:49.087 | 99.99th=[73925] 00:31:49.087 bw ( KiB/s): min= 1536, max= 1968, per=4.16%, avg=1855.16, stdev=101.26, samples=19 00:31:49.087 iops : min= 384, max= 492, avg=463.79, stdev=25.31, samples=19 00:31:49.087 lat (msec) : 20=0.51%, 50=98.93%, 100=0.56% 00:31:49.087 cpu : usr=97.31%, sys=1.64%, ctx=107, majf=0, minf=61 00:31:49.087 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.5%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:49.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 issued rwts: total=4662,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.087 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.087 filename1: (groupid=0, jobs=1): err= 0: pid=2540713: Tue Apr 23 05:16:26 2024 00:31:49.087 read: IOPS=469, BW=1879KiB/s (1924kB/s)(18.4MiB/10016msec) 00:31:49.087 slat (usec): min=8, max=112, avg=21.34, stdev=22.64 00:31:49.087 clat (usec): min=8408, max=44631, avg=33860.97, stdev=2815.35 00:31:49.087 lat (usec): min=8422, max=44651, avg=33882.31, stdev=2815.51 00:31:49.087 clat percentiles (usec): 00:31:49.087 | 1.00th=[10814], 5.00th=[33162], 10.00th=[33424], 20.00th=[33817], 00:31:49.087 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.087 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.087 | 99.00th=[41157], 99.50th=[43254], 99.90th=[44827], 99.95th=[44827], 00:31:49.087 | 99.99th=[44827] 00:31:49.087 bw ( KiB/s): min= 1792, max= 1920, per=4.20%, avg=1875.20, stdev=62.64, samples=20 00:31:49.087 iops : min= 448, max= 480, avg=468.80, stdev=15.66, samples=20 00:31:49.087 lat (msec) : 10=0.68%, 20=0.34%, 50=98.98% 00:31:49.087 cpu : usr=96.61%, sys=2.11%, ctx=83, majf=0, minf=121 00:31:49.087 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 issued rwts: total=4704,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.087 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.087 filename1: (groupid=0, jobs=1): err= 0: pid=2540714: Tue Apr 23 05:16:26 2024 00:31:49.087 read: IOPS=465, BW=1862KiB/s (1907kB/s)(18.2MiB/10002msec) 00:31:49.087 slat (nsec): min=8034, max=75388, avg=34387.70, stdev=10089.79 00:31:49.087 clat (usec): min=16478, max=68148, avg=34053.18, stdev=2530.80 00:31:49.087 lat (usec): min=16502, max=68182, avg=34087.57, stdev=2530.22 00:31:49.087 clat percentiles (usec): 00:31:49.087 | 1.00th=[32900], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.087 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.087 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[35914], 00:31:49.087 | 99.00th=[40633], 99.50th=[44827], 99.90th=[67634], 99.95th=[67634], 00:31:49.087 | 99.99th=[67634] 00:31:49.087 bw ( KiB/s): min= 1664, max= 1920, per=4.15%, avg=1852.63, stdev=78.31, samples=19 00:31:49.087 iops : min= 416, max= 480, avg=463.16, stdev=19.58, samples=19 00:31:49.087 lat (msec) : 20=0.34%, 50=99.31%, 100=0.34% 00:31:49.087 cpu : usr=96.94%, sys=2.05%, ctx=147, majf=0, minf=57 00:31:49.087 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:49.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.087 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.087 filename1: (groupid=0, jobs=1): err= 0: pid=2540715: Tue Apr 23 05:16:26 2024 00:31:49.087 read: IOPS=464, BW=1856KiB/s (1901kB/s)(18.2MiB/10047msec) 00:31:49.087 slat (usec): min=9, max=112, avg=35.04, stdev=10.66 00:31:49.087 clat (usec): min=16554, max=66890, avg=34052.75, stdev=2510.72 00:31:49.087 lat (usec): min=16584, max=66909, avg=34087.78, stdev=2510.42 00:31:49.087 clat percentiles (usec): 00:31:49.087 | 1.00th=[32900], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.087 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.087 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[35914], 00:31:49.087 | 99.00th=[40633], 99.50th=[44827], 99.90th=[66847], 99.95th=[66847], 00:31:49.087 | 99.99th=[66847] 00:31:49.087 bw ( KiB/s): min= 1667, max= 1920, per=4.15%, avg=1852.79, stdev=77.91, samples=19 00:31:49.087 iops : min= 416, max= 480, avg=463.16, stdev=19.58, samples=19 00:31:49.087 lat (msec) : 20=0.34%, 50=99.31%, 100=0.34% 00:31:49.087 cpu : usr=97.93%, sys=1.45%, ctx=97, majf=0, minf=63 00:31:49.087 IO depths : 1=6.3%, 2=12.5%, 4=25.0%, 8=49.9%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 issued rwts: total=4663,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.087 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.087 filename1: (groupid=0, jobs=1): err= 0: pid=2540716: Tue Apr 23 05:16:26 2024 00:31:49.087 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10006msec) 00:31:49.087 slat (usec): min=8, max=139, avg=40.15, stdev=20.85 00:31:49.087 clat (usec): min=32296, max=52111, avg=34024.40, stdev=1608.00 00:31:49.087 lat (usec): min=32335, max=52140, avg=34064.55, stdev=1605.98 00:31:49.087 clat percentiles (usec): 00:31:49.087 | 1.00th=[32637], 5.00th=[33162], 10.00th=[33162], 20.00th=[33424], 00:31:49.087 | 30.00th=[33424], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.087 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.087 | 99.00th=[40633], 99.50th=[45351], 99.90th=[52167], 99.95th=[52167], 00:31:49.087 | 99.99th=[52167] 00:31:49.087 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.087 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.087 lat (msec) : 50=99.66%, 100=0.34% 00:31:49.087 cpu : usr=97.47%, sys=1.58%, ctx=93, majf=0, minf=71 00:31:49.087 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.087 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.087 filename1: (groupid=0, jobs=1): err= 0: pid=2540717: Tue Apr 23 05:16:26 2024 00:31:49.087 read: IOPS=465, BW=1861KiB/s (1905kB/s)(18.2MiB/10010msec) 00:31:49.087 slat (usec): min=9, max=122, avg=35.99, stdev=10.98 00:31:49.087 clat (usec): min=16359, max=76634, avg=34063.78, stdev=2934.49 00:31:49.087 lat (usec): min=16387, max=76666, avg=34099.77, stdev=2934.49 00:31:49.087 clat percentiles (usec): 00:31:49.087 | 1.00th=[32900], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.087 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.087 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[35914], 00:31:49.087 | 99.00th=[40633], 99.50th=[44827], 99.90th=[76022], 99.95th=[77071], 00:31:49.087 | 99.99th=[77071] 00:31:49.087 bw ( KiB/s): min= 1536, max= 1920, per=4.15%, avg=1852.63, stdev=98.86, samples=19 00:31:49.087 iops : min= 384, max= 480, avg=463.16, stdev=24.71, samples=19 00:31:49.087 lat (msec) : 20=0.34%, 50=99.31%, 100=0.34% 00:31:49.087 cpu : usr=97.55%, sys=1.83%, ctx=103, majf=0, minf=70 00:31:49.087 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:49.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.087 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.087 filename1: (groupid=0, jobs=1): err= 0: pid=2540718: Tue Apr 23 05:16:26 2024 00:31:49.087 read: IOPS=467, BW=1872KiB/s (1917kB/s)(18.3MiB/10018msec) 00:31:49.087 slat (usec): min=6, max=111, avg=26.41, stdev=15.58 00:31:49.087 clat (usec): min=12627, max=45044, avg=33972.79, stdev=1825.65 00:31:49.087 lat (usec): min=12634, max=45067, avg=33999.20, stdev=1825.40 00:31:49.087 clat percentiles (usec): 00:31:49.087 | 1.00th=[30540], 5.00th=[33424], 10.00th=[33424], 20.00th=[33817], 00:31:49.087 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.087 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.087 | 99.00th=[40633], 99.50th=[40633], 99.90th=[44827], 99.95th=[44827], 00:31:49.087 | 99.99th=[44827] 00:31:49.087 bw ( KiB/s): min= 1792, max= 1920, per=4.19%, avg=1868.80, stdev=64.34, samples=20 00:31:49.087 iops : min= 448, max= 480, avg=467.20, stdev=16.08, samples=20 00:31:49.087 lat (msec) : 20=0.34%, 50=99.66% 00:31:49.087 cpu : usr=98.10%, sys=1.53%, ctx=24, majf=0, minf=89 00:31:49.087 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:49.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.087 issued rwts: total=4688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.087 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.087 filename1: (groupid=0, jobs=1): err= 0: pid=2540719: Tue Apr 23 05:16:26 2024 00:31:49.088 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10006msec) 00:31:49.088 slat (usec): min=10, max=141, avg=34.03, stdev=13.40 00:31:49.088 clat (usec): min=32212, max=52097, avg=34091.19, stdev=1581.72 00:31:49.088 lat (usec): min=32255, max=52124, avg=34125.22, stdev=1581.85 00:31:49.088 clat percentiles (usec): 00:31:49.088 | 1.00th=[32900], 5.00th=[33424], 10.00th=[33424], 20.00th=[33424], 00:31:49.088 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.088 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[36439], 00:31:49.088 | 99.00th=[40633], 99.50th=[44827], 99.90th=[52167], 99.95th=[52167], 00:31:49.088 | 99.99th=[52167] 00:31:49.088 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.088 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.088 lat (msec) : 50=99.66%, 100=0.34% 00:31:49.088 cpu : usr=98.27%, sys=1.33%, ctx=50, majf=0, minf=75 00:31:49.088 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.088 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.088 filename1: (groupid=0, jobs=1): err= 0: pid=2540720: Tue Apr 23 05:16:26 2024 00:31:49.088 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10007msec) 00:31:49.088 slat (usec): min=10, max=132, avg=34.82, stdev=17.60 00:31:49.088 clat (usec): min=31206, max=52718, avg=34075.15, stdev=1621.42 00:31:49.088 lat (usec): min=31243, max=52738, avg=34109.97, stdev=1620.49 00:31:49.088 clat percentiles (usec): 00:31:49.088 | 1.00th=[32900], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.088 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.088 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.088 | 99.00th=[41157], 99.50th=[44827], 99.90th=[52691], 99.95th=[52691], 00:31:49.088 | 99.99th=[52691] 00:31:49.088 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.088 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.088 lat (msec) : 50=99.66%, 100=0.34% 00:31:49.088 cpu : usr=95.97%, sys=2.46%, ctx=283, majf=0, minf=52 00:31:49.088 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:49.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.088 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.088 filename2: (groupid=0, jobs=1): err= 0: pid=2540721: Tue Apr 23 05:16:26 2024 00:31:49.088 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10007msec) 00:31:49.088 slat (usec): min=8, max=146, avg=35.11, stdev=26.88 00:31:49.088 clat (usec): min=11658, max=66963, avg=34079.02, stdev=1984.52 00:31:49.088 lat (usec): min=11748, max=66988, avg=34114.13, stdev=1980.10 00:31:49.088 clat percentiles (usec): 00:31:49.088 | 1.00th=[32113], 5.00th=[32900], 10.00th=[33162], 20.00th=[33424], 00:31:49.088 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.088 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34866], 95.00th=[35914], 00:31:49.088 | 99.00th=[41157], 99.50th=[44827], 99.90th=[53740], 99.95th=[60556], 00:31:49.088 | 99.99th=[66847] 00:31:49.088 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.088 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.088 lat (msec) : 20=0.09%, 50=99.48%, 100=0.43% 00:31:49.088 cpu : usr=94.51%, sys=3.16%, ctx=256, majf=0, minf=69 00:31:49.088 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:49.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.088 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.088 filename2: (groupid=0, jobs=1): err= 0: pid=2540722: Tue Apr 23 05:16:26 2024 00:31:49.088 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10007msec) 00:31:49.088 slat (usec): min=7, max=118, avg=31.18, stdev=12.89 00:31:49.088 clat (usec): min=12168, max=55079, avg=34111.54, stdev=1668.38 00:31:49.088 lat (usec): min=12190, max=55135, avg=34142.72, stdev=1669.10 00:31:49.088 clat percentiles (usec): 00:31:49.088 | 1.00th=[33162], 5.00th=[33424], 10.00th=[33424], 20.00th=[33424], 00:31:49.088 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.088 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[35914], 00:31:49.088 | 99.00th=[44303], 99.50th=[45876], 99.90th=[46400], 99.95th=[51643], 00:31:49.088 | 99.99th=[55313] 00:31:49.088 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.088 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.088 lat (msec) : 20=0.04%, 50=99.87%, 100=0.09% 00:31:49.088 cpu : usr=98.22%, sys=1.39%, ctx=17, majf=0, minf=62 00:31:49.088 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:49.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.088 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.088 filename2: (groupid=0, jobs=1): err= 0: pid=2540723: Tue Apr 23 05:16:26 2024 00:31:49.088 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10006msec) 00:31:49.088 slat (nsec): min=8276, max=78671, avg=31704.03, stdev=11827.10 00:31:49.088 clat (usec): min=32432, max=52028, avg=34111.27, stdev=1575.75 00:31:49.088 lat (usec): min=32472, max=52059, avg=34142.98, stdev=1574.74 00:31:49.088 clat percentiles (usec): 00:31:49.088 | 1.00th=[33162], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.088 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.088 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[36439], 00:31:49.088 | 99.00th=[40633], 99.50th=[44827], 99.90th=[52167], 99.95th=[52167], 00:31:49.088 | 99.99th=[52167] 00:31:49.088 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.088 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.088 lat (msec) : 50=99.66%, 100=0.34% 00:31:49.088 cpu : usr=95.18%, sys=2.87%, ctx=247, majf=0, minf=74 00:31:49.088 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:49.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.088 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.088 filename2: (groupid=0, jobs=1): err= 0: pid=2540724: Tue Apr 23 05:16:26 2024 00:31:49.088 read: IOPS=469, BW=1877KiB/s (1922kB/s)(18.4MiB/10026msec) 00:31:49.088 slat (usec): min=8, max=110, avg=28.39, stdev=18.36 00:31:49.088 clat (usec): min=9040, max=64555, avg=33849.67, stdev=2523.42 00:31:49.088 lat (usec): min=9064, max=64572, avg=33878.05, stdev=2522.91 00:31:49.088 clat percentiles (usec): 00:31:49.088 | 1.00th=[23725], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.088 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.088 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[36439], 00:31:49.088 | 99.00th=[40633], 99.50th=[40633], 99.90th=[44827], 99.95th=[44827], 00:31:49.088 | 99.99th=[64750] 00:31:49.088 bw ( KiB/s): min= 1792, max= 1920, per=4.20%, avg=1875.20, stdev=61.11, samples=20 00:31:49.088 iops : min= 448, max= 480, avg=468.80, stdev=15.28, samples=20 00:31:49.088 lat (msec) : 10=0.34%, 20=0.38%, 50=99.23%, 100=0.04% 00:31:49.088 cpu : usr=97.23%, sys=1.90%, ctx=69, majf=0, minf=91 00:31:49.088 IO depths : 1=3.8%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.7%, 32=0.0%, >=64=0.0% 00:31:49.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 issued rwts: total=4704,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.088 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.088 filename2: (groupid=0, jobs=1): err= 0: pid=2540725: Tue Apr 23 05:16:26 2024 00:31:49.088 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10005msec) 00:31:49.088 slat (usec): min=7, max=123, avg=43.32, stdev=22.80 00:31:49.088 clat (usec): min=16324, max=70681, avg=33967.51, stdev=2671.18 00:31:49.088 lat (usec): min=16354, max=70709, avg=34010.83, stdev=2668.40 00:31:49.088 clat percentiles (usec): 00:31:49.088 | 1.00th=[32637], 5.00th=[32900], 10.00th=[33162], 20.00th=[33424], 00:31:49.088 | 30.00th=[33424], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.088 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[35914], 00:31:49.088 | 99.00th=[40633], 99.50th=[44827], 99.90th=[70779], 99.95th=[70779], 00:31:49.088 | 99.99th=[70779] 00:31:49.088 bw ( KiB/s): min= 1539, max= 1920, per=4.15%, avg=1852.79, stdev=98.33, samples=19 00:31:49.088 iops : min= 384, max= 480, avg=463.16, stdev=24.71, samples=19 00:31:49.088 lat (msec) : 20=0.34%, 50=99.31%, 100=0.34% 00:31:49.088 cpu : usr=98.28%, sys=1.29%, ctx=23, majf=0, minf=76 00:31:49.088 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:49.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.088 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.089 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.089 filename2: (groupid=0, jobs=1): err= 0: pid=2540726: Tue Apr 23 05:16:26 2024 00:31:49.089 read: IOPS=466, BW=1865KiB/s (1910kB/s)(18.2MiB/10008msec) 00:31:49.089 slat (usec): min=10, max=125, avg=37.17, stdev=16.27 00:31:49.089 clat (usec): min=7356, max=66872, avg=33953.88, stdev=2751.08 00:31:49.089 lat (usec): min=7388, max=66891, avg=33991.05, stdev=2751.42 00:31:49.089 clat percentiles (usec): 00:31:49.089 | 1.00th=[32637], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.089 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.089 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[35914], 00:31:49.089 | 99.00th=[40633], 99.50th=[44827], 99.90th=[66847], 99.95th=[66847], 00:31:49.089 | 99.99th=[66847] 00:31:49.089 bw ( KiB/s): min= 1667, max= 1920, per=4.15%, avg=1852.79, stdev=77.91, samples=19 00:31:49.089 iops : min= 416, max= 480, avg=463.16, stdev=19.58, samples=19 00:31:49.089 lat (msec) : 10=0.21%, 20=0.34%, 50=99.10%, 100=0.34% 00:31:49.089 cpu : usr=97.47%, sys=1.90%, ctx=100, majf=0, minf=67 00:31:49.089 IO depths : 1=6.3%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.089 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.089 issued rwts: total=4666,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.089 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.089 filename2: (groupid=0, jobs=1): err= 0: pid=2540727: Tue Apr 23 05:16:26 2024 00:31:49.089 read: IOPS=465, BW=1862KiB/s (1907kB/s)(18.2MiB/10003msec) 00:31:49.089 slat (usec): min=7, max=110, avg=33.13, stdev=14.83 00:31:49.089 clat (usec): min=15638, max=69824, avg=34070.32, stdev=2634.99 00:31:49.089 lat (usec): min=15660, max=69842, avg=34103.45, stdev=2634.29 00:31:49.089 clat percentiles (usec): 00:31:49.089 | 1.00th=[32637], 5.00th=[33162], 10.00th=[33424], 20.00th=[33424], 00:31:49.089 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.089 | 70.00th=[33817], 80.00th=[33817], 90.00th=[34341], 95.00th=[35390], 00:31:49.089 | 99.00th=[41157], 99.50th=[44827], 99.90th=[69731], 99.95th=[69731], 00:31:49.089 | 99.99th=[69731] 00:31:49.089 bw ( KiB/s): min= 1664, max= 1920, per=4.15%, avg=1852.63, stdev=78.31, samples=19 00:31:49.089 iops : min= 416, max= 480, avg=463.16, stdev=19.58, samples=19 00:31:49.089 lat (msec) : 20=0.34%, 50=99.31%, 100=0.34% 00:31:49.089 cpu : usr=98.44%, sys=1.18%, ctx=13, majf=0, minf=47 00:31:49.089 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.089 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.089 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.089 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.089 filename2: (groupid=0, jobs=1): err= 0: pid=2540728: Tue Apr 23 05:16:26 2024 00:31:49.089 read: IOPS=465, BW=1861KiB/s (1906kB/s)(18.2MiB/10006msec) 00:31:49.089 slat (nsec): min=13124, max=96596, avg=34169.08, stdev=8993.21 00:31:49.089 clat (usec): min=32598, max=52111, avg=34084.34, stdev=1578.09 00:31:49.089 lat (usec): min=32654, max=52140, avg=34118.51, stdev=1578.37 00:31:49.089 clat percentiles (usec): 00:31:49.089 | 1.00th=[33162], 5.00th=[33424], 10.00th=[33424], 20.00th=[33424], 00:31:49.089 | 30.00th=[33817], 40.00th=[33817], 50.00th=[33817], 60.00th=[33817], 00:31:49.089 | 70.00th=[33817], 80.00th=[34341], 90.00th=[34341], 95.00th=[36439], 00:31:49.089 | 99.00th=[40633], 99.50th=[44827], 99.90th=[52167], 99.95th=[52167], 00:31:49.089 | 99.99th=[52167] 00:31:49.089 bw ( KiB/s): min= 1664, max= 1920, per=4.17%, avg=1859.37, stdev=78.31, samples=19 00:31:49.089 iops : min= 416, max= 480, avg=464.84, stdev=19.58, samples=19 00:31:49.089 lat (msec) : 50=99.66%, 100=0.34% 00:31:49.089 cpu : usr=92.90%, sys=3.82%, ctx=331, majf=0, minf=68 00:31:49.089 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:49.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.089 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.089 issued rwts: total=4656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.089 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:49.089 00:31:49.089 Run status group 0 (all jobs): 00:31:49.089 READ: bw=43.6MiB/s (45.7MB/s), 1856KiB/s-1887KiB/s (1901kB/s-1932kB/s), io=438MiB (459MB), run=10002-10047msec 00:31:49.089 05:16:26 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:49.089 05:16:26 -- target/dif.sh@43 -- # local sub 00:31:49.089 05:16:26 -- target/dif.sh@45 -- # for sub in "$@" 00:31:49.089 05:16:26 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:49.089 05:16:26 -- target/dif.sh@36 -- # local sub_id=0 00:31:49.089 05:16:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:49.089 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.089 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.089 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.089 05:16:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:49.089 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.089 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.089 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.089 05:16:26 -- target/dif.sh@45 -- # for sub in "$@" 00:31:49.089 05:16:26 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:49.089 05:16:26 -- target/dif.sh@36 -- # local sub_id=1 00:31:49.089 05:16:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:49.089 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.089 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.089 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.089 05:16:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:49.089 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.089 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.089 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.089 05:16:26 -- target/dif.sh@45 -- # for sub in "$@" 00:31:49.089 05:16:26 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:49.089 05:16:26 -- target/dif.sh@36 -- # local sub_id=2 00:31:49.089 05:16:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:49.089 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.089 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.089 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.089 05:16:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:49.089 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.089 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.089 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.089 05:16:26 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:49.089 05:16:26 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:49.089 05:16:26 -- target/dif.sh@115 -- # numjobs=2 00:31:49.089 05:16:26 -- target/dif.sh@115 -- # iodepth=8 00:31:49.089 05:16:26 -- target/dif.sh@115 -- # runtime=5 00:31:49.089 05:16:26 -- target/dif.sh@115 -- # files=1 00:31:49.089 05:16:26 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:49.089 05:16:26 -- target/dif.sh@28 -- # local sub 00:31:49.089 05:16:26 -- target/dif.sh@30 -- # for sub in "$@" 00:31:49.089 05:16:26 -- target/dif.sh@31 -- # create_subsystem 0 00:31:49.089 05:16:26 -- target/dif.sh@18 -- # local sub_id=0 00:31:49.089 05:16:26 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:49.089 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.089 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.089 bdev_null0 00:31:49.089 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:49.090 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.090 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.090 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:49.090 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.090 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.090 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:49.090 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.090 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.090 [2024-04-23 05:16:26.663708] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:49.090 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@30 -- # for sub in "$@" 00:31:49.090 05:16:26 -- target/dif.sh@31 -- # create_subsystem 1 00:31:49.090 05:16:26 -- target/dif.sh@18 -- # local sub_id=1 00:31:49.090 05:16:26 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:49.090 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.090 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.090 bdev_null1 00:31:49.090 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:49.090 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.090 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.090 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:49.090 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.090 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.090 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:49.090 05:16:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:49.090 05:16:26 -- common/autotest_common.sh@10 -- # set +x 00:31:49.090 05:16:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:49.090 05:16:26 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:49.090 05:16:26 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:49.090 05:16:26 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:49.090 05:16:26 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.090 05:16:26 -- nvmf/common.sh@521 -- # config=() 00:31:49.090 05:16:26 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.090 05:16:26 -- nvmf/common.sh@521 -- # local subsystem config 00:31:49.090 05:16:26 -- target/dif.sh@82 -- # gen_fio_conf 00:31:49.090 05:16:26 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:31:49.090 05:16:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:49.090 05:16:26 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:49.090 05:16:26 -- target/dif.sh@54 -- # local file 00:31:49.090 05:16:26 -- common/autotest_common.sh@1325 -- # local sanitizers 00:31:49.090 05:16:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:49.090 { 00:31:49.090 "params": { 00:31:49.090 "name": "Nvme$subsystem", 00:31:49.090 "trtype": "$TEST_TRANSPORT", 00:31:49.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:49.090 "adrfam": "ipv4", 00:31:49.090 "trsvcid": "$NVMF_PORT", 00:31:49.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:49.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:49.090 "hdgst": ${hdgst:-false}, 00:31:49.090 "ddgst": ${ddgst:-false} 00:31:49.090 }, 00:31:49.090 "method": "bdev_nvme_attach_controller" 00:31:49.090 } 00:31:49.090 EOF 00:31:49.090 )") 00:31:49.090 05:16:26 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.090 05:16:26 -- target/dif.sh@56 -- # cat 00:31:49.090 05:16:26 -- common/autotest_common.sh@1327 -- # shift 00:31:49.090 05:16:26 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:31:49.090 05:16:26 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:49.090 05:16:26 -- nvmf/common.sh@543 -- # cat 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # grep libasan 00:31:49.090 05:16:26 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:49.090 05:16:26 -- target/dif.sh@72 -- # (( file <= files )) 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:49.090 05:16:26 -- target/dif.sh@73 -- # cat 00:31:49.090 05:16:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:49.090 05:16:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:49.090 { 00:31:49.090 "params": { 00:31:49.090 "name": "Nvme$subsystem", 00:31:49.090 "trtype": "$TEST_TRANSPORT", 00:31:49.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:49.090 "adrfam": "ipv4", 00:31:49.090 "trsvcid": "$NVMF_PORT", 00:31:49.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:49.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:49.090 "hdgst": ${hdgst:-false}, 00:31:49.090 "ddgst": ${ddgst:-false} 00:31:49.090 }, 00:31:49.090 "method": "bdev_nvme_attach_controller" 00:31:49.090 } 00:31:49.090 EOF 00:31:49.090 )") 00:31:49.090 05:16:26 -- nvmf/common.sh@543 -- # cat 00:31:49.090 05:16:26 -- target/dif.sh@72 -- # (( file++ )) 00:31:49.090 05:16:26 -- target/dif.sh@72 -- # (( file <= files )) 00:31:49.090 05:16:26 -- nvmf/common.sh@545 -- # jq . 00:31:49.090 05:16:26 -- nvmf/common.sh@546 -- # IFS=, 00:31:49.090 05:16:26 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:31:49.090 "params": { 00:31:49.090 "name": "Nvme0", 00:31:49.090 "trtype": "tcp", 00:31:49.090 "traddr": "10.0.0.2", 00:31:49.090 "adrfam": "ipv4", 00:31:49.090 "trsvcid": "4420", 00:31:49.090 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:49.090 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:49.090 "hdgst": false, 00:31:49.090 "ddgst": false 00:31:49.090 }, 00:31:49.090 "method": "bdev_nvme_attach_controller" 00:31:49.090 },{ 00:31:49.090 "params": { 00:31:49.090 "name": "Nvme1", 00:31:49.090 "trtype": "tcp", 00:31:49.090 "traddr": "10.0.0.2", 00:31:49.090 "adrfam": "ipv4", 00:31:49.090 "trsvcid": "4420", 00:31:49.090 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:49.090 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:49.090 "hdgst": false, 00:31:49.090 "ddgst": false 00:31:49.090 }, 00:31:49.090 "method": "bdev_nvme_attach_controller" 00:31:49.090 }' 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:49.090 05:16:26 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:49.090 05:16:26 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:49.090 05:16:26 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:49.090 05:16:26 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:49.090 05:16:26 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:49.090 05:16:26 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.090 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:49.090 ... 00:31:49.090 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:49.090 ... 00:31:49.090 fio-3.35 00:31:49.090 Starting 4 threads 00:31:49.090 EAL: No free 2048 kB hugepages reported on node 1 00:31:54.354 00:31:54.354 filename0: (groupid=0, jobs=1): err= 0: pid=2542084: Tue Apr 23 05:16:32 2024 00:31:54.354 read: IOPS=1939, BW=15.1MiB/s (15.9MB/s)(75.8MiB/5003msec) 00:31:54.354 slat (nsec): min=4061, max=41042, avg=13916.34, stdev=5080.87 00:31:54.354 clat (usec): min=817, max=7887, avg=4073.96, stdev=582.14 00:31:54.354 lat (usec): min=831, max=7902, avg=4087.88, stdev=582.14 00:31:54.354 clat percentiles (usec): 00:31:54.354 | 1.00th=[ 2442], 5.00th=[ 3359], 10.00th=[ 3687], 20.00th=[ 3884], 00:31:54.354 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4080], 00:31:54.354 | 70.00th=[ 4113], 80.00th=[ 4178], 90.00th=[ 4424], 95.00th=[ 5080], 00:31:54.354 | 99.00th=[ 6521], 99.50th=[ 6849], 99.90th=[ 7439], 99.95th=[ 7635], 00:31:54.354 | 99.99th=[ 7898] 00:31:54.354 bw ( KiB/s): min=15184, max=16032, per=25.04%, avg=15601.78, stdev=269.33, samples=9 00:31:54.354 iops : min= 1898, max= 2004, avg=1950.22, stdev=33.67, samples=9 00:31:54.354 lat (usec) : 1000=0.07% 00:31:54.354 lat (msec) : 2=0.49%, 4=37.98%, 10=61.45% 00:31:54.354 cpu : usr=89.66%, sys=7.70%, ctx=266, majf=0, minf=9 00:31:54.354 IO depths : 1=0.1%, 2=13.0%, 4=59.6%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 issued rwts: total=9702,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.354 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:54.354 filename0: (groupid=0, jobs=1): err= 0: pid=2542085: Tue Apr 23 05:16:32 2024 00:31:54.354 read: IOPS=1926, BW=15.0MiB/s (15.8MB/s)(75.3MiB/5002msec) 00:31:54.354 slat (nsec): min=4558, max=34183, avg=12382.69, stdev=3690.20 00:31:54.354 clat (usec): min=830, max=7523, avg=4114.63, stdev=601.46 00:31:54.354 lat (usec): min=843, max=7532, avg=4127.01, stdev=601.24 00:31:54.354 clat percentiles (usec): 00:31:54.354 | 1.00th=[ 2704], 5.00th=[ 3392], 10.00th=[ 3621], 20.00th=[ 3884], 00:31:54.354 | 30.00th=[ 3982], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4080], 00:31:54.354 | 70.00th=[ 4113], 80.00th=[ 4228], 90.00th=[ 4555], 95.00th=[ 5473], 00:31:54.354 | 99.00th=[ 6521], 99.50th=[ 6718], 99.90th=[ 7177], 99.95th=[ 7373], 00:31:54.354 | 99.99th=[ 7504] 00:31:54.354 bw ( KiB/s): min=14848, max=16192, per=24.74%, avg=15409.40, stdev=416.70, samples=10 00:31:54.354 iops : min= 1856, max= 2024, avg=1926.10, stdev=52.13, samples=10 00:31:54.354 lat (usec) : 1000=0.02% 00:31:54.354 lat (msec) : 2=0.32%, 4=31.42%, 10=68.24% 00:31:54.354 cpu : usr=93.68%, sys=5.82%, ctx=19, majf=0, minf=0 00:31:54.354 IO depths : 1=0.1%, 2=8.2%, 4=61.7%, 8=30.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 complete : 0=0.0%, 4=94.3%, 8=5.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 issued rwts: total=9634,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.354 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:54.354 filename1: (groupid=0, jobs=1): err= 0: pid=2542086: Tue Apr 23 05:16:32 2024 00:31:54.354 read: IOPS=1979, BW=15.5MiB/s (16.2MB/s)(77.4MiB/5003msec) 00:31:54.354 slat (nsec): min=4384, max=56421, avg=12514.95, stdev=3908.63 00:31:54.354 clat (usec): min=879, max=9016, avg=3999.89, stdev=551.57 00:31:54.354 lat (usec): min=893, max=9034, avg=4012.40, stdev=551.70 00:31:54.354 clat percentiles (usec): 00:31:54.354 | 1.00th=[ 2606], 5.00th=[ 3130], 10.00th=[ 3425], 20.00th=[ 3785], 00:31:54.354 | 30.00th=[ 3916], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4047], 00:31:54.354 | 70.00th=[ 4113], 80.00th=[ 4146], 90.00th=[ 4293], 95.00th=[ 4686], 00:31:54.354 | 99.00th=[ 6128], 99.50th=[ 6652], 99.90th=[ 7439], 99.95th=[ 8979], 00:31:54.354 | 99.99th=[ 8979] 00:31:54.354 bw ( KiB/s): min=15200, max=16784, per=25.42%, avg=15838.40, stdev=500.56, samples=10 00:31:54.354 iops : min= 1900, max= 2098, avg=1979.80, stdev=62.57, samples=10 00:31:54.354 lat (usec) : 1000=0.03% 00:31:54.354 lat (msec) : 2=0.34%, 4=37.54%, 10=62.09% 00:31:54.354 cpu : usr=93.22%, sys=5.94%, ctx=28, majf=0, minf=0 00:31:54.354 IO depths : 1=0.1%, 2=7.9%, 4=64.4%, 8=27.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 issued rwts: total=9904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.354 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:54.354 filename1: (groupid=0, jobs=1): err= 0: pid=2542087: Tue Apr 23 05:16:32 2024 00:31:54.354 read: IOPS=1942, BW=15.2MiB/s (15.9MB/s)(75.9MiB/5002msec) 00:31:54.354 slat (nsec): min=4479, max=58295, avg=13698.46, stdev=4430.44 00:31:54.354 clat (usec): min=814, max=7372, avg=4072.87, stdev=565.45 00:31:54.354 lat (usec): min=827, max=7387, avg=4086.57, stdev=565.36 00:31:54.354 clat percentiles (usec): 00:31:54.354 | 1.00th=[ 2507], 5.00th=[ 3326], 10.00th=[ 3621], 20.00th=[ 3851], 00:31:54.354 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4080], 00:31:54.354 | 70.00th=[ 4113], 80.00th=[ 4178], 90.00th=[ 4490], 95.00th=[ 5080], 00:31:54.354 | 99.00th=[ 6390], 99.50th=[ 6652], 99.90th=[ 7111], 99.95th=[ 7308], 00:31:54.354 | 99.99th=[ 7373] 00:31:54.354 bw ( KiB/s): min=14864, max=15968, per=25.03%, avg=15592.89, stdev=316.19, samples=9 00:31:54.354 iops : min= 1858, max= 1996, avg=1949.11, stdev=39.52, samples=9 00:31:54.354 lat (usec) : 1000=0.07% 00:31:54.354 lat (msec) : 2=0.30%, 4=37.56%, 10=62.07% 00:31:54.354 cpu : usr=92.48%, sys=6.44%, ctx=63, majf=0, minf=9 00:31:54.354 IO depths : 1=0.1%, 2=9.9%, 4=61.2%, 8=28.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.354 issued rwts: total=9717,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.354 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:54.354 00:31:54.354 Run status group 0 (all jobs): 00:31:54.354 READ: bw=60.8MiB/s (63.8MB/s), 15.0MiB/s-15.5MiB/s (15.8MB/s-16.2MB/s), io=304MiB (319MB), run=5002-5003msec 00:31:54.354 05:16:32 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:54.354 05:16:32 -- target/dif.sh@43 -- # local sub 00:31:54.354 05:16:32 -- target/dif.sh@45 -- # for sub in "$@" 00:31:54.354 05:16:32 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:54.354 05:16:32 -- target/dif.sh@36 -- # local sub_id=0 00:31:54.354 05:16:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:54.354 05:16:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.354 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.354 05:16:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.354 05:16:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:54.354 05:16:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.354 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.354 05:16:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.354 05:16:32 -- target/dif.sh@45 -- # for sub in "$@" 00:31:54.354 05:16:32 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:54.354 05:16:32 -- target/dif.sh@36 -- # local sub_id=1 00:31:54.354 05:16:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:54.354 05:16:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.354 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.354 05:16:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.354 05:16:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:54.354 05:16:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.354 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.354 05:16:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.354 00:31:54.354 real 0m23.927s 00:31:54.354 user 4m29.784s 00:31:54.354 sys 0m8.081s 00:31:54.354 05:16:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:54.354 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.354 ************************************ 00:31:54.354 END TEST fio_dif_rand_params 00:31:54.354 ************************************ 00:31:54.354 05:16:32 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:54.354 05:16:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:54.354 05:16:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:54.354 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.354 ************************************ 00:31:54.354 START TEST fio_dif_digest 00:31:54.354 ************************************ 00:31:54.354 05:16:32 -- common/autotest_common.sh@1111 -- # fio_dif_digest 00:31:54.354 05:16:32 -- target/dif.sh@123 -- # local NULL_DIF 00:31:54.354 05:16:32 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:54.354 05:16:32 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:54.354 05:16:32 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:54.354 05:16:32 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:54.354 05:16:32 -- target/dif.sh@127 -- # numjobs=3 00:31:54.354 05:16:32 -- target/dif.sh@127 -- # iodepth=3 00:31:54.354 05:16:32 -- target/dif.sh@127 -- # runtime=10 00:31:54.354 05:16:32 -- target/dif.sh@128 -- # hdgst=true 00:31:54.354 05:16:32 -- target/dif.sh@128 -- # ddgst=true 00:31:54.354 05:16:32 -- target/dif.sh@130 -- # create_subsystems 0 00:31:54.354 05:16:32 -- target/dif.sh@28 -- # local sub 00:31:54.354 05:16:32 -- target/dif.sh@30 -- # for sub in "$@" 00:31:54.354 05:16:32 -- target/dif.sh@31 -- # create_subsystem 0 00:31:54.354 05:16:32 -- target/dif.sh@18 -- # local sub_id=0 00:31:54.354 05:16:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:54.354 05:16:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.354 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.354 bdev_null0 00:31:54.354 05:16:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.354 05:16:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:54.355 05:16:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.355 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.355 05:16:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.355 05:16:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:54.355 05:16:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.355 05:16:32 -- common/autotest_common.sh@10 -- # set +x 00:31:54.355 05:16:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.355 05:16:33 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:54.355 05:16:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.355 05:16:33 -- common/autotest_common.sh@10 -- # set +x 00:31:54.355 [2024-04-23 05:16:33.010495] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:54.355 05:16:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.355 05:16:33 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:54.355 05:16:33 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:54.355 05:16:33 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:54.355 05:16:33 -- nvmf/common.sh@521 -- # config=() 00:31:54.355 05:16:33 -- nvmf/common.sh@521 -- # local subsystem config 00:31:54.355 05:16:33 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:31:54.355 05:16:33 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:54.355 05:16:33 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:31:54.355 { 00:31:54.355 "params": { 00:31:54.355 "name": "Nvme$subsystem", 00:31:54.355 "trtype": "$TEST_TRANSPORT", 00:31:54.355 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:54.355 "adrfam": "ipv4", 00:31:54.355 "trsvcid": "$NVMF_PORT", 00:31:54.355 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:54.355 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:54.355 "hdgst": ${hdgst:-false}, 00:31:54.355 "ddgst": ${ddgst:-false} 00:31:54.355 }, 00:31:54.355 "method": "bdev_nvme_attach_controller" 00:31:54.355 } 00:31:54.355 EOF 00:31:54.355 )") 00:31:54.355 05:16:33 -- target/dif.sh@82 -- # gen_fio_conf 00:31:54.355 05:16:33 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:54.355 05:16:33 -- target/dif.sh@54 -- # local file 00:31:54.355 05:16:33 -- target/dif.sh@56 -- # cat 00:31:54.355 05:16:33 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:31:54.355 05:16:33 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:54.355 05:16:33 -- common/autotest_common.sh@1325 -- # local sanitizers 00:31:54.355 05:16:33 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:54.355 05:16:33 -- common/autotest_common.sh@1327 -- # shift 00:31:54.355 05:16:33 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:31:54.355 05:16:33 -- nvmf/common.sh@543 -- # cat 00:31:54.355 05:16:33 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:54.355 05:16:33 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:54.355 05:16:33 -- target/dif.sh@72 -- # (( file <= files )) 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # grep libasan 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:54.355 05:16:33 -- nvmf/common.sh@545 -- # jq . 00:31:54.355 05:16:33 -- nvmf/common.sh@546 -- # IFS=, 00:31:54.355 05:16:33 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:31:54.355 "params": { 00:31:54.355 "name": "Nvme0", 00:31:54.355 "trtype": "tcp", 00:31:54.355 "traddr": "10.0.0.2", 00:31:54.355 "adrfam": "ipv4", 00:31:54.355 "trsvcid": "4420", 00:31:54.355 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:54.355 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:54.355 "hdgst": true, 00:31:54.355 "ddgst": true 00:31:54.355 }, 00:31:54.355 "method": "bdev_nvme_attach_controller" 00:31:54.355 }' 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:54.355 05:16:33 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:54.355 05:16:33 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:31:54.355 05:16:33 -- common/autotest_common.sh@1331 -- # asan_lib= 00:31:54.355 05:16:33 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:31:54.355 05:16:33 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:54.355 05:16:33 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:54.355 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:54.355 ... 00:31:54.355 fio-3.35 00:31:54.355 Starting 3 threads 00:31:54.355 EAL: No free 2048 kB hugepages reported on node 1 00:32:06.553 00:32:06.553 filename0: (groupid=0, jobs=1): err= 0: pid=2542873: Tue Apr 23 05:16:43 2024 00:32:06.553 read: IOPS=214, BW=26.8MiB/s (28.1MB/s)(269MiB/10045msec) 00:32:06.553 slat (nsec): min=4743, max=45373, avg=16613.86, stdev=4338.88 00:32:06.553 clat (usec): min=10194, max=53370, avg=13955.76, stdev=1583.54 00:32:06.553 lat (usec): min=10209, max=53388, avg=13972.38, stdev=1583.42 00:32:06.553 clat percentiles (usec): 00:32:06.553 | 1.00th=[11469], 5.00th=[12256], 10.00th=[12649], 20.00th=[13042], 00:32:06.553 | 30.00th=[13435], 40.00th=[13698], 50.00th=[13960], 60.00th=[14091], 00:32:06.553 | 70.00th=[14353], 80.00th=[14746], 90.00th=[15270], 95.00th=[15795], 00:32:06.553 | 99.00th=[16581], 99.50th=[16909], 99.90th=[22938], 99.95th=[51119], 00:32:06.553 | 99.99th=[53216] 00:32:06.553 bw ( KiB/s): min=26368, max=28160, per=34.30%, avg=27532.80, stdev=501.62, samples=20 00:32:06.553 iops : min= 206, max= 220, avg=215.10, stdev= 3.92, samples=20 00:32:06.553 lat (msec) : 20=99.77%, 50=0.14%, 100=0.09% 00:32:06.553 cpu : usr=86.99%, sys=9.91%, ctx=1142, majf=0, minf=151 00:32:06.553 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.553 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.553 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.553 issued rwts: total=2153,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.553 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:06.553 filename0: (groupid=0, jobs=1): err= 0: pid=2542874: Tue Apr 23 05:16:43 2024 00:32:06.553 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(258MiB/10042msec) 00:32:06.553 slat (nsec): min=4185, max=28206, avg=14856.64, stdev=2170.03 00:32:06.553 clat (usec): min=11098, max=55597, avg=14585.27, stdev=1649.79 00:32:06.553 lat (usec): min=11112, max=55605, avg=14600.13, stdev=1649.59 00:32:06.553 clat percentiles (usec): 00:32:06.553 | 1.00th=[12256], 5.00th=[12911], 10.00th=[13304], 20.00th=[13698], 00:32:06.553 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:32:06.554 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15926], 95.00th=[16450], 00:32:06.554 | 99.00th=[17433], 99.50th=[17695], 99.90th=[22676], 99.95th=[53216], 00:32:06.554 | 99.99th=[55837] 00:32:06.554 bw ( KiB/s): min=25394, max=26880, per=32.82%, avg=26344.90, stdev=399.68, samples=20 00:32:06.554 iops : min= 198, max= 210, avg=205.80, stdev= 3.17, samples=20 00:32:06.554 lat (msec) : 20=99.76%, 50=0.15%, 100=0.10% 00:32:06.554 cpu : usr=92.22%, sys=7.27%, ctx=37, majf=0, minf=84 00:32:06.554 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.554 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.554 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.554 issued rwts: total=2060,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.554 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:06.554 filename0: (groupid=0, jobs=1): err= 0: pid=2542875: Tue Apr 23 05:16:43 2024 00:32:06.554 read: IOPS=207, BW=26.0MiB/s (27.2MB/s)(261MiB/10045msec) 00:32:06.554 slat (nsec): min=5110, max=29137, avg=13693.22, stdev=1674.19 00:32:06.554 clat (usec): min=11254, max=51746, avg=14408.26, stdev=1539.13 00:32:06.554 lat (usec): min=11268, max=51760, avg=14421.96, stdev=1539.07 00:32:06.554 clat percentiles (usec): 00:32:06.554 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13042], 20.00th=[13435], 00:32:06.554 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:32:06.554 | 70.00th=[14877], 80.00th=[15270], 90.00th=[15664], 95.00th=[16057], 00:32:06.554 | 99.00th=[16909], 99.50th=[17171], 99.90th=[23725], 99.95th=[49021], 00:32:06.554 | 99.99th=[51643] 00:32:06.554 bw ( KiB/s): min=25600, max=27136, per=33.23%, avg=26675.20, stdev=376.97, samples=20 00:32:06.554 iops : min= 200, max= 212, avg=208.40, stdev= 2.95, samples=20 00:32:06.554 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:32:06.554 cpu : usr=92.66%, sys=6.87%, ctx=19, majf=0, minf=173 00:32:06.554 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.554 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.554 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.554 issued rwts: total=2086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.554 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:06.554 00:32:06.554 Run status group 0 (all jobs): 00:32:06.554 READ: bw=78.4MiB/s (82.2MB/s), 25.6MiB/s-26.8MiB/s (26.9MB/s-28.1MB/s), io=787MiB (826MB), run=10042-10045msec 00:32:06.554 05:16:43 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:06.554 05:16:43 -- target/dif.sh@43 -- # local sub 00:32:06.554 05:16:43 -- target/dif.sh@45 -- # for sub in "$@" 00:32:06.554 05:16:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:06.554 05:16:43 -- target/dif.sh@36 -- # local sub_id=0 00:32:06.554 05:16:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:06.554 05:16:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.554 05:16:43 -- common/autotest_common.sh@10 -- # set +x 00:32:06.554 05:16:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.554 05:16:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:06.554 05:16:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.554 05:16:43 -- common/autotest_common.sh@10 -- # set +x 00:32:06.554 05:16:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.554 00:32:06.554 real 0m10.990s 00:32:06.554 user 0m28.176s 00:32:06.554 sys 0m2.681s 00:32:06.554 05:16:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:06.554 05:16:43 -- common/autotest_common.sh@10 -- # set +x 00:32:06.554 ************************************ 00:32:06.554 END TEST fio_dif_digest 00:32:06.554 ************************************ 00:32:06.554 05:16:43 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:06.554 05:16:43 -- target/dif.sh@147 -- # nvmftestfini 00:32:06.554 05:16:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:32:06.554 05:16:43 -- nvmf/common.sh@117 -- # sync 00:32:06.554 05:16:43 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:32:06.554 05:16:43 -- nvmf/common.sh@120 -- # set +e 00:32:06.554 05:16:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:32:06.554 05:16:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:32:06.554 rmmod nvme_tcp 00:32:06.554 rmmod nvme_fabrics 00:32:06.554 rmmod nvme_keyring 00:32:06.554 05:16:44 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:32:06.554 05:16:44 -- nvmf/common.sh@124 -- # set -e 00:32:06.554 05:16:44 -- nvmf/common.sh@125 -- # return 0 00:32:06.554 05:16:44 -- nvmf/common.sh@478 -- # '[' -n 2536796 ']' 00:32:06.554 05:16:44 -- nvmf/common.sh@479 -- # killprocess 2536796 00:32:06.554 05:16:44 -- common/autotest_common.sh@936 -- # '[' -z 2536796 ']' 00:32:06.554 05:16:44 -- common/autotest_common.sh@940 -- # kill -0 2536796 00:32:06.554 05:16:44 -- common/autotest_common.sh@941 -- # uname 00:32:06.554 05:16:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:06.554 05:16:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2536796 00:32:06.554 05:16:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:06.554 05:16:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:06.554 05:16:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2536796' 00:32:06.554 killing process with pid 2536796 00:32:06.554 05:16:44 -- common/autotest_common.sh@955 -- # kill 2536796 00:32:06.554 05:16:44 -- common/autotest_common.sh@960 -- # wait 2536796 00:32:06.554 05:16:44 -- nvmf/common.sh@481 -- # '[' iso == iso ']' 00:32:06.554 05:16:44 -- nvmf/common.sh@482 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:06.554 Waiting for block devices as requested 00:32:06.554 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:06.554 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:06.554 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:06.554 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:06.554 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:06.554 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:06.554 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:06.554 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:06.813 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:06.813 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:06.813 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:06.813 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:07.071 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:07.071 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:07.071 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:07.330 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:07.330 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:07.330 05:16:46 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:32:07.330 05:16:46 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:32:07.330 05:16:46 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:07.330 05:16:46 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:32:07.330 05:16:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:07.330 05:16:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:07.330 05:16:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:09.298 05:16:48 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:32:09.298 00:32:09.298 real 1m5.763s 00:32:09.298 user 6m24.522s 00:32:09.298 sys 0m19.970s 00:32:09.298 05:16:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:09.298 05:16:48 -- common/autotest_common.sh@10 -- # set +x 00:32:09.298 ************************************ 00:32:09.298 END TEST nvmf_dif 00:32:09.298 ************************************ 00:32:09.556 05:16:48 -- spdk/autotest.sh@291 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:09.556 05:16:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:09.556 05:16:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:09.556 05:16:48 -- common/autotest_common.sh@10 -- # set +x 00:32:09.556 ************************************ 00:32:09.556 START TEST nvmf_abort_qd_sizes 00:32:09.556 ************************************ 00:32:09.556 05:16:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:09.556 * Looking for test storage... 00:32:09.556 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:09.556 05:16:48 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:09.556 05:16:48 -- nvmf/common.sh@7 -- # uname -s 00:32:09.556 05:16:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:09.556 05:16:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:09.556 05:16:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:09.556 05:16:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:09.556 05:16:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:09.556 05:16:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:09.556 05:16:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:09.556 05:16:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:09.556 05:16:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:09.556 05:16:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:09.556 05:16:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:09.556 05:16:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:09.556 05:16:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:09.556 05:16:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:09.557 05:16:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:09.557 05:16:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:32:09.557 05:16:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:09.557 05:16:48 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:09.557 05:16:48 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:09.557 05:16:48 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:09.557 05:16:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.557 05:16:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.557 05:16:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.557 05:16:48 -- paths/export.sh@5 -- # export PATH 00:32:09.557 05:16:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.557 05:16:48 -- nvmf/common.sh@47 -- # : 0 00:32:09.557 05:16:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:32:09.557 05:16:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:32:09.557 05:16:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:32:09.557 05:16:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:09.557 05:16:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:09.557 05:16:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:32:09.557 05:16:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:32:09.557 05:16:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:32:09.557 05:16:48 -- target/abort_qd_sizes.sh@70 -- # nvmftestinit 00:32:09.557 05:16:48 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:32:09.557 05:16:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:09.557 05:16:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:32:09.557 05:16:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:32:09.557 05:16:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:32:09.557 05:16:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:09.557 05:16:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:09.557 05:16:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:09.557 05:16:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:32:09.557 05:16:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:32:09.557 05:16:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:32:09.557 05:16:48 -- common/autotest_common.sh@10 -- # set +x 00:32:11.460 05:16:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:11.460 05:16:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:32:11.460 05:16:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:32:11.460 05:16:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:32:11.460 05:16:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:32:11.460 05:16:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:32:11.460 05:16:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:32:11.460 05:16:50 -- nvmf/common.sh@295 -- # net_devs=() 00:32:11.460 05:16:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:32:11.460 05:16:50 -- nvmf/common.sh@296 -- # e810=() 00:32:11.460 05:16:50 -- nvmf/common.sh@296 -- # local -ga e810 00:32:11.460 05:16:50 -- nvmf/common.sh@297 -- # x722=() 00:32:11.460 05:16:50 -- nvmf/common.sh@297 -- # local -ga x722 00:32:11.460 05:16:50 -- nvmf/common.sh@298 -- # mlx=() 00:32:11.460 05:16:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:32:11.460 05:16:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:11.460 05:16:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:32:11.460 05:16:50 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:32:11.460 05:16:50 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:32:11.460 05:16:50 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:32:11.460 05:16:50 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:32:11.461 05:16:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:32:11.461 05:16:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:11.461 05:16:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:11.461 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:11.461 05:16:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:11.461 05:16:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:11.461 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:11.461 05:16:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:32:11.461 05:16:50 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:11.461 05:16:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:11.461 05:16:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:11.461 05:16:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:11.461 05:16:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:11.461 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:11.461 05:16:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:11.461 05:16:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:11.461 05:16:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:11.461 05:16:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:11.461 05:16:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:11.461 05:16:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:11.461 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:11.461 05:16:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:11.461 05:16:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:32:11.461 05:16:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:32:11.461 05:16:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:32:11.461 05:16:50 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:32:11.461 05:16:50 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:11.461 05:16:50 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:11.461 05:16:50 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:11.461 05:16:50 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:32:11.461 05:16:50 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:11.461 05:16:50 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:11.461 05:16:50 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:32:11.461 05:16:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:11.461 05:16:50 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:11.461 05:16:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:32:11.461 05:16:50 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:32:11.461 05:16:50 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:32:11.461 05:16:50 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:11.461 05:16:50 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:11.461 05:16:50 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:11.461 05:16:50 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:32:11.461 05:16:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:11.720 05:16:50 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:11.720 05:16:50 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:11.720 05:16:50 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:32:11.720 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:11.720 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:32:11.720 00:32:11.720 --- 10.0.0.2 ping statistics --- 00:32:11.720 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:11.720 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:32:11.720 05:16:50 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:11.720 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:11.720 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:32:11.720 00:32:11.720 --- 10.0.0.1 ping statistics --- 00:32:11.720 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:11.720 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:32:11.720 05:16:50 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:11.720 05:16:50 -- nvmf/common.sh@411 -- # return 0 00:32:11.720 05:16:50 -- nvmf/common.sh@439 -- # '[' iso == iso ']' 00:32:11.720 05:16:50 -- nvmf/common.sh@440 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:12.656 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:12.656 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:12.656 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:12.656 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:12.656 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:12.656 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:12.656 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:12.656 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:12.656 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:14.039 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:14.039 05:16:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:14.039 05:16:52 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:32:14.039 05:16:52 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:32:14.039 05:16:52 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:14.039 05:16:52 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:32:14.039 05:16:52 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:32:14.039 05:16:52 -- target/abort_qd_sizes.sh@71 -- # nvmfappstart -m 0xf 00:32:14.039 05:16:52 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:32:14.039 05:16:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:32:14.039 05:16:52 -- common/autotest_common.sh@10 -- # set +x 00:32:14.039 05:16:52 -- nvmf/common.sh@470 -- # nvmfpid=2547667 00:32:14.039 05:16:52 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:14.039 05:16:52 -- nvmf/common.sh@471 -- # waitforlisten 2547667 00:32:14.039 05:16:52 -- common/autotest_common.sh@817 -- # '[' -z 2547667 ']' 00:32:14.039 05:16:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:14.039 05:16:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:14.039 05:16:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:14.039 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:14.039 05:16:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:14.039 05:16:52 -- common/autotest_common.sh@10 -- # set +x 00:32:14.039 [2024-04-23 05:16:53.015790] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:32:14.039 [2024-04-23 05:16:53.015892] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:14.039 EAL: No free 2048 kB hugepages reported on node 1 00:32:14.039 [2024-04-23 05:16:53.053716] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:32:14.039 [2024-04-23 05:16:53.079863] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:14.039 [2024-04-23 05:16:53.169409] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:14.039 [2024-04-23 05:16:53.169478] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:14.039 [2024-04-23 05:16:53.169492] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:32:14.039 [2024-04-23 05:16:53.169503] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:32:14.039 [2024-04-23 05:16:53.169512] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:14.039 [2024-04-23 05:16:53.169582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:14.039 [2024-04-23 05:16:53.169642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:14.039 [2024-04-23 05:16:53.169707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:14.039 [2024-04-23 05:16:53.169710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:14.297 05:16:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:14.297 05:16:53 -- common/autotest_common.sh@850 -- # return 0 00:32:14.297 05:16:53 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:32:14.297 05:16:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:32:14.297 05:16:53 -- common/autotest_common.sh@10 -- # set +x 00:32:14.297 05:16:53 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@73 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@75 -- # mapfile -t nvmes 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@75 -- # nvme_in_userspace 00:32:14.297 05:16:53 -- scripts/common.sh@309 -- # local bdf bdfs 00:32:14.297 05:16:53 -- scripts/common.sh@310 -- # local nvmes 00:32:14.297 05:16:53 -- scripts/common.sh@312 -- # [[ -n 0000:88:00.0 ]] 00:32:14.297 05:16:53 -- scripts/common.sh@313 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:14.297 05:16:53 -- scripts/common.sh@318 -- # for bdf in "${nvmes[@]}" 00:32:14.297 05:16:53 -- scripts/common.sh@319 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:14.297 05:16:53 -- scripts/common.sh@320 -- # uname -s 00:32:14.297 05:16:53 -- scripts/common.sh@320 -- # [[ Linux == FreeBSD ]] 00:32:14.297 05:16:53 -- scripts/common.sh@323 -- # bdfs+=("$bdf") 00:32:14.297 05:16:53 -- scripts/common.sh@325 -- # (( 1 )) 00:32:14.297 05:16:53 -- scripts/common.sh@326 -- # printf '%s\n' 0000:88:00.0 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@76 -- # (( 1 > 0 )) 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@78 -- # nvme=0000:88:00.0 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@80 -- # run_test spdk_target_abort spdk_target 00:32:14.297 05:16:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:14.297 05:16:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:14.297 05:16:53 -- common/autotest_common.sh@10 -- # set +x 00:32:14.297 ************************************ 00:32:14.297 START TEST spdk_target_abort 00:32:14.297 ************************************ 00:32:14.297 05:16:53 -- common/autotest_common.sh@1111 -- # spdk_target 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:14.297 05:16:53 -- target/abort_qd_sizes.sh@45 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:14.297 05:16:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.297 05:16:53 -- common/autotest_common.sh@10 -- # set +x 00:32:17.578 spdk_targetn1 00:32:17.578 05:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@47 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:17.578 05:16:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.578 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:32:17.578 [2024-04-23 05:16:56.241284] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:17.578 05:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:testnqn -a -s SPDKISFASTANDAWESOME 00:32:17.578 05:16:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.578 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:32:17.578 05:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:testnqn spdk_targetn1 00:32:17.578 05:16:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.578 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:32:17.578 05:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:testnqn -t tcp -a 10.0.0.2 -s 4420 00:32:17.578 05:16:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.578 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:32:17.578 [2024-04-23 05:16:56.273584] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:17.578 05:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@52 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:testnqn 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:testnqn 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:17.578 05:16:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:17.578 EAL: No free 2048 kB hugepages reported on node 1 00:32:20.866 Initializing NVMe Controllers 00:32:20.866 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:testnqn 00:32:20.866 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:32:20.866 Initialization complete. Launching workers. 00:32:20.866 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 12767, failed: 0 00:32:20.866 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 1331, failed to submit 11436 00:32:20.866 success 823, unsuccess 508, failed 0 00:32:20.866 05:16:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:20.866 05:16:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:20.866 EAL: No free 2048 kB hugepages reported on node 1 00:32:24.152 [2024-04-23 05:17:02.624201] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd81db0 is same with the state(5) to be set 00:32:24.152 Initializing NVMe Controllers 00:32:24.152 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:testnqn 00:32:24.152 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:32:24.152 Initialization complete. Launching workers. 00:32:24.152 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 8527, failed: 0 00:32:24.152 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 1240, failed to submit 7287 00:32:24.152 success 321, unsuccess 919, failed 0 00:32:24.152 05:17:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:24.152 05:17:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:24.152 EAL: No free 2048 kB hugepages reported on node 1 00:32:27.435 Initializing NVMe Controllers 00:32:27.435 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:testnqn 00:32:27.435 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:32:27.435 Initialization complete. Launching workers. 00:32:27.435 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 32111, failed: 0 00:32:27.435 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 2807, failed to submit 29304 00:32:27.435 success 504, unsuccess 2303, failed 0 00:32:27.435 05:17:05 -- target/abort_qd_sizes.sh@54 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:testnqn 00:32:27.435 05:17:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.435 05:17:05 -- common/autotest_common.sh@10 -- # set +x 00:32:27.435 05:17:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.435 05:17:05 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:27.435 05:17:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.435 05:17:05 -- common/autotest_common.sh@10 -- # set +x 00:32:28.372 05:17:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.372 05:17:07 -- target/abort_qd_sizes.sh@61 -- # killprocess 2547667 00:32:28.372 05:17:07 -- common/autotest_common.sh@936 -- # '[' -z 2547667 ']' 00:32:28.372 05:17:07 -- common/autotest_common.sh@940 -- # kill -0 2547667 00:32:28.372 05:17:07 -- common/autotest_common.sh@941 -- # uname 00:32:28.372 05:17:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:28.372 05:17:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2547667 00:32:28.372 05:17:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:28.372 05:17:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:28.372 05:17:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2547667' 00:32:28.372 killing process with pid 2547667 00:32:28.372 05:17:07 -- common/autotest_common.sh@955 -- # kill 2547667 00:32:28.372 05:17:07 -- common/autotest_common.sh@960 -- # wait 2547667 00:32:28.372 00:32:28.372 real 0m14.057s 00:32:28.372 user 0m53.235s 00:32:28.372 sys 0m2.692s 00:32:28.372 05:17:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:28.372 05:17:07 -- common/autotest_common.sh@10 -- # set +x 00:32:28.372 ************************************ 00:32:28.372 END TEST spdk_target_abort 00:32:28.372 ************************************ 00:32:28.372 05:17:07 -- target/abort_qd_sizes.sh@81 -- # run_test kernel_target_abort kernel_target 00:32:28.372 05:17:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:28.372 05:17:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:28.372 05:17:07 -- common/autotest_common.sh@10 -- # set +x 00:32:28.630 ************************************ 00:32:28.630 START TEST kernel_target_abort 00:32:28.630 ************************************ 00:32:28.630 05:17:07 -- common/autotest_common.sh@1111 -- # kernel_target 00:32:28.630 05:17:07 -- target/abort_qd_sizes.sh@65 -- # get_main_ns_ip 00:32:28.630 05:17:07 -- nvmf/common.sh@717 -- # local ip 00:32:28.630 05:17:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.630 05:17:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.630 05:17:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.630 05:17:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.630 05:17:07 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:32:28.630 05:17:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:32:28.630 05:17:07 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:32:28.630 05:17:07 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:32:28.630 05:17:07 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:32:28.630 05:17:07 -- target/abort_qd_sizes.sh@65 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 10.0.0.1 00:32:28.630 05:17:07 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=10.0.0.1 00:32:28.630 05:17:07 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:32:28.630 05:17:07 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:32:28.630 05:17:07 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:32:28.630 05:17:07 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:28.630 05:17:07 -- nvmf/common.sh@628 -- # local block nvme 00:32:28.630 05:17:07 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:32:28.630 05:17:07 -- nvmf/common.sh@631 -- # modprobe nvmet 00:32:28.630 05:17:07 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:28.630 05:17:07 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:29.570 Waiting for block devices as requested 00:32:29.570 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:29.570 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:29.850 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:29.850 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:29.850 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:29.850 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:30.114 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:30.114 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:30.114 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:30.114 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:30.114 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:30.374 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:30.374 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:30.374 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:30.374 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:30.633 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:30.633 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:30.633 05:17:09 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:32:30.633 05:17:09 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:30.633 05:17:09 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:32:30.633 05:17:09 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:32:30.633 05:17:09 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:32:30.633 05:17:09 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:32:30.633 05:17:09 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:32:30.633 05:17:09 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:32:30.633 05:17:09 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:30.893 No valid GPT data, bailing 00:32:30.893 05:17:09 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:30.893 05:17:09 -- scripts/common.sh@391 -- # pt= 00:32:30.893 05:17:09 -- scripts/common.sh@392 -- # return 1 00:32:30.893 05:17:09 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:32:30.893 05:17:09 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:32:30.893 05:17:09 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:32:30.893 05:17:09 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:32:30.893 05:17:09 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:30.893 05:17:09 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:32:30.893 05:17:09 -- nvmf/common.sh@656 -- # echo 1 00:32:30.893 05:17:09 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:32:30.893 05:17:09 -- nvmf/common.sh@658 -- # echo 1 00:32:30.893 05:17:09 -- nvmf/common.sh@660 -- # echo 10.0.0.1 00:32:30.893 05:17:09 -- nvmf/common.sh@661 -- # echo tcp 00:32:30.893 05:17:09 -- nvmf/common.sh@662 -- # echo 4420 00:32:30.893 05:17:09 -- nvmf/common.sh@663 -- # echo ipv4 00:32:30.893 05:17:09 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:30.893 05:17:09 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:30.893 00:32:30.893 Discovery Log Number of Records 2, Generation counter 2 00:32:30.893 =====Discovery Log Entry 0====== 00:32:30.893 trtype: tcp 00:32:30.893 adrfam: ipv4 00:32:30.893 subtype: current discovery subsystem 00:32:30.893 treq: not specified, sq flow control disable supported 00:32:30.893 portid: 1 00:32:30.893 trsvcid: 4420 00:32:30.893 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:30.893 traddr: 10.0.0.1 00:32:30.893 eflags: none 00:32:30.893 sectype: none 00:32:30.893 =====Discovery Log Entry 1====== 00:32:30.893 trtype: tcp 00:32:30.893 adrfam: ipv4 00:32:30.893 subtype: nvme subsystem 00:32:30.893 treq: not specified, sq flow control disable supported 00:32:30.893 portid: 1 00:32:30.893 trsvcid: 4420 00:32:30.893 subnqn: nqn.2016-06.io.spdk:testnqn 00:32:30.893 traddr: 10.0.0.1 00:32:30.893 eflags: none 00:32:30.893 sectype: none 00:32:30.893 05:17:09 -- target/abort_qd_sizes.sh@66 -- # rabort tcp IPv4 10.0.0.1 4420 nqn.2016-06.io.spdk:testnqn 00:32:30.893 05:17:09 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:30.893 05:17:09 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:30.893 05:17:09 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:30.893 05:17:09 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:30.893 05:17:09 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:testnqn 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:30.894 05:17:09 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:30.894 EAL: No free 2048 kB hugepages reported on node 1 00:32:34.181 Initializing NVMe Controllers 00:32:34.181 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:32:34.181 Associating TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:32:34.181 Initialization complete. Launching workers. 00:32:34.181 NS: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 37664, failed: 0 00:32:34.181 CTRLR: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 37664, failed to submit 0 00:32:34.181 success 0, unsuccess 37664, failed 0 00:32:34.181 05:17:12 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:34.181 05:17:12 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:34.181 EAL: No free 2048 kB hugepages reported on node 1 00:32:37.469 Initializing NVMe Controllers 00:32:37.469 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:32:37.469 Associating TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:32:37.469 Initialization complete. Launching workers. 00:32:37.469 NS: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 74768, failed: 0 00:32:37.469 CTRLR: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 18850, failed to submit 55918 00:32:37.469 success 0, unsuccess 18850, failed 0 00:32:37.469 05:17:15 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:37.469 05:17:15 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:32:37.469 EAL: No free 2048 kB hugepages reported on node 1 00:32:40.002 Initializing NVMe Controllers 00:32:40.002 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:32:40.002 Associating TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:32:40.002 Initialization complete. Launching workers. 00:32:40.002 NS: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 68784, failed: 0 00:32:40.002 CTRLR: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 17158, failed to submit 51626 00:32:40.002 success 0, unsuccess 17158, failed 0 00:32:40.002 05:17:19 -- target/abort_qd_sizes.sh@67 -- # clean_kernel_target 00:32:40.002 05:17:19 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:32:40.002 05:17:19 -- nvmf/common.sh@675 -- # echo 0 00:32:40.002 05:17:19 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:32:40.002 05:17:19 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:32:40.002 05:17:19 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:40.002 05:17:19 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:32:40.002 05:17:19 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:32:40.002 05:17:19 -- nvmf/common.sh@684 -- # modprobe -r nvmet_tcp nvmet 00:32:40.002 05:17:19 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:41.383 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:41.383 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:41.383 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:41.383 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:41.383 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:41.383 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:41.383 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:41.383 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:41.383 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:42.321 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:42.321 00:32:42.321 real 0m13.695s 00:32:42.321 user 0m5.462s 00:32:42.321 sys 0m3.112s 00:32:42.321 05:17:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:42.321 05:17:21 -- common/autotest_common.sh@10 -- # set +x 00:32:42.321 ************************************ 00:32:42.321 END TEST kernel_target_abort 00:32:42.321 ************************************ 00:32:42.321 05:17:21 -- target/abort_qd_sizes.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:32:42.321 05:17:21 -- target/abort_qd_sizes.sh@84 -- # nvmftestfini 00:32:42.321 05:17:21 -- nvmf/common.sh@477 -- # nvmfcleanup 00:32:42.321 05:17:21 -- nvmf/common.sh@117 -- # sync 00:32:42.321 05:17:21 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:32:42.321 05:17:21 -- nvmf/common.sh@120 -- # set +e 00:32:42.321 05:17:21 -- nvmf/common.sh@121 -- # for i in {1..20} 00:32:42.321 05:17:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:32:42.321 rmmod nvme_tcp 00:32:42.321 rmmod nvme_fabrics 00:32:42.321 rmmod nvme_keyring 00:32:42.321 05:17:21 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:32:42.321 05:17:21 -- nvmf/common.sh@124 -- # set -e 00:32:42.321 05:17:21 -- nvmf/common.sh@125 -- # return 0 00:32:42.321 05:17:21 -- nvmf/common.sh@478 -- # '[' -n 2547667 ']' 00:32:42.321 05:17:21 -- nvmf/common.sh@479 -- # killprocess 2547667 00:32:42.321 05:17:21 -- common/autotest_common.sh@936 -- # '[' -z 2547667 ']' 00:32:42.321 05:17:21 -- common/autotest_common.sh@940 -- # kill -0 2547667 00:32:42.321 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2547667) - No such process 00:32:42.321 05:17:21 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2547667 is not found' 00:32:42.321 Process with pid 2547667 is not found 00:32:42.321 05:17:21 -- nvmf/common.sh@481 -- # '[' iso == iso ']' 00:32:42.321 05:17:21 -- nvmf/common.sh@482 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:43.254 Waiting for block devices as requested 00:32:43.254 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:43.511 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:43.511 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:43.511 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:43.511 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:43.770 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:43.770 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:43.770 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:43.770 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:44.030 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:44.030 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:44.030 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:44.030 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:44.289 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:44.289 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:44.289 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:44.289 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:44.549 05:17:23 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:32:44.549 05:17:23 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:32:44.549 05:17:23 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:44.549 05:17:23 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:32:44.549 05:17:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:44.549 05:17:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:44.549 05:17:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:46.456 05:17:25 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:32:46.456 00:32:46.456 real 0m36.977s 00:32:46.456 user 1m0.697s 00:32:46.456 sys 0m9.031s 00:32:46.456 05:17:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:46.456 05:17:25 -- common/autotest_common.sh@10 -- # set +x 00:32:46.456 ************************************ 00:32:46.456 END TEST nvmf_abort_qd_sizes 00:32:46.456 ************************************ 00:32:46.456 05:17:25 -- spdk/autotest.sh@293 -- # run_test keyring_file /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring/file.sh 00:32:46.456 05:17:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:46.456 05:17:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:46.456 05:17:25 -- common/autotest_common.sh@10 -- # set +x 00:32:46.715 ************************************ 00:32:46.715 START TEST keyring_file 00:32:46.715 ************************************ 00:32:46.715 05:17:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring/file.sh 00:32:46.715 * Looking for test storage... 00:32:46.715 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring 00:32:46.715 05:17:25 -- keyring/file.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring/common.sh 00:32:46.715 05:17:25 -- keyring/common.sh@4 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:46.715 05:17:25 -- nvmf/common.sh@7 -- # uname -s 00:32:46.715 05:17:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:46.715 05:17:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:46.715 05:17:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:46.715 05:17:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:46.715 05:17:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:46.715 05:17:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:46.715 05:17:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:46.715 05:17:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:46.715 05:17:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:46.715 05:17:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:46.715 05:17:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:46.715 05:17:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:46.715 05:17:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:46.715 05:17:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:46.715 05:17:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:46.715 05:17:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:32:46.715 05:17:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:46.715 05:17:25 -- scripts/common.sh@502 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:46.715 05:17:25 -- scripts/common.sh@510 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:46.715 05:17:25 -- scripts/common.sh@511 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:46.716 05:17:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.716 05:17:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.716 05:17:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.716 05:17:25 -- paths/export.sh@5 -- # export PATH 00:32:46.716 05:17:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.716 05:17:25 -- nvmf/common.sh@47 -- # : 0 00:32:46.716 05:17:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:32:46.716 05:17:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:32:46.716 05:17:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:32:46.716 05:17:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:46.716 05:17:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:46.716 05:17:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:32:46.716 05:17:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:32:46.716 05:17:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:32:46.716 05:17:25 -- keyring/common.sh@6 -- # bperfsock=/var/tmp/bperf.sock 00:32:46.716 05:17:25 -- keyring/file.sh@13 -- # subnqn=nqn.2016-06.io.spdk:cnode0 00:32:46.716 05:17:25 -- keyring/file.sh@14 -- # hostnqn=nqn.2016-06.io.spdk:host0 00:32:46.716 05:17:25 -- keyring/file.sh@15 -- # key0=00112233445566778899aabbccddeeff 00:32:46.716 05:17:25 -- keyring/file.sh@16 -- # key1=112233445566778899aabbccddeeff00 00:32:46.716 05:17:25 -- keyring/file.sh@24 -- # trap cleanup EXIT 00:32:46.716 05:17:25 -- keyring/file.sh@26 -- # prep_key key0 00112233445566778899aabbccddeeff 0 00:32:46.716 05:17:25 -- keyring/common.sh@15 -- # local name key digest path 00:32:46.716 05:17:25 -- keyring/common.sh@17 -- # name=key0 00:32:46.716 05:17:25 -- keyring/common.sh@17 -- # key=00112233445566778899aabbccddeeff 00:32:46.716 05:17:25 -- keyring/common.sh@17 -- # digest=0 00:32:46.716 05:17:25 -- keyring/common.sh@18 -- # mktemp 00:32:46.716 05:17:25 -- keyring/common.sh@18 -- # path=/tmp/tmp.EvPKqVeL3H 00:32:46.716 05:17:25 -- keyring/common.sh@20 -- # format_interchange_psk 00112233445566778899aabbccddeeff 0 00:32:46.716 05:17:25 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 0 00:32:46.716 05:17:25 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:46.716 05:17:25 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:32:46.716 05:17:25 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff 00:32:46.716 05:17:25 -- nvmf/common.sh@693 -- # digest=0 00:32:46.716 05:17:25 -- nvmf/common.sh@694 -- # python - 00:32:46.716 05:17:25 -- keyring/common.sh@21 -- # chmod 0600 /tmp/tmp.EvPKqVeL3H 00:32:46.716 05:17:25 -- keyring/common.sh@23 -- # echo /tmp/tmp.EvPKqVeL3H 00:32:46.716 05:17:25 -- keyring/file.sh@26 -- # key0path=/tmp/tmp.EvPKqVeL3H 00:32:46.716 05:17:25 -- keyring/file.sh@27 -- # prep_key key1 112233445566778899aabbccddeeff00 0 00:32:46.716 05:17:25 -- keyring/common.sh@15 -- # local name key digest path 00:32:46.716 05:17:25 -- keyring/common.sh@17 -- # name=key1 00:32:46.716 05:17:25 -- keyring/common.sh@17 -- # key=112233445566778899aabbccddeeff00 00:32:46.716 05:17:25 -- keyring/common.sh@17 -- # digest=0 00:32:46.716 05:17:25 -- keyring/common.sh@18 -- # mktemp 00:32:46.716 05:17:25 -- keyring/common.sh@18 -- # path=/tmp/tmp.KMzxzmIvqF 00:32:46.716 05:17:25 -- keyring/common.sh@20 -- # format_interchange_psk 112233445566778899aabbccddeeff00 0 00:32:46.716 05:17:25 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 112233445566778899aabbccddeeff00 0 00:32:46.716 05:17:25 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:46.716 05:17:25 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:32:46.716 05:17:25 -- nvmf/common.sh@693 -- # key=112233445566778899aabbccddeeff00 00:32:46.716 05:17:25 -- nvmf/common.sh@693 -- # digest=0 00:32:46.716 05:17:25 -- nvmf/common.sh@694 -- # python - 00:32:46.716 05:17:25 -- keyring/common.sh@21 -- # chmod 0600 /tmp/tmp.KMzxzmIvqF 00:32:46.716 05:17:25 -- keyring/common.sh@23 -- # echo /tmp/tmp.KMzxzmIvqF 00:32:46.716 05:17:25 -- keyring/file.sh@27 -- # key1path=/tmp/tmp.KMzxzmIvqF 00:32:46.716 05:17:25 -- keyring/file.sh@30 -- # tgtpid=2553389 00:32:46.716 05:17:25 -- keyring/file.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:32:46.716 05:17:25 -- keyring/file.sh@32 -- # waitforlisten 2553389 00:32:46.716 05:17:25 -- common/autotest_common.sh@817 -- # '[' -z 2553389 ']' 00:32:46.716 05:17:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:46.716 05:17:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:46.716 05:17:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:46.716 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:46.716 05:17:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:46.716 05:17:25 -- common/autotest_common.sh@10 -- # set +x 00:32:46.975 [2024-04-23 05:17:25.903474] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:32:46.975 [2024-04-23 05:17:25.903607] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2553389 ] 00:32:46.975 EAL: No free 2048 kB hugepages reported on node 1 00:32:46.975 [2024-04-23 05:17:25.935993] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:32:46.975 [2024-04-23 05:17:25.961965] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:32:46.975 [2024-04-23 05:17:26.043766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:47.234 05:17:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:47.234 05:17:26 -- common/autotest_common.sh@850 -- # return 0 00:32:47.234 05:17:26 -- keyring/file.sh@33 -- # rpc_cmd 00:32:47.234 05:17:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:47.234 05:17:26 -- common/autotest_common.sh@10 -- # set +x 00:32:47.234 [2024-04-23 05:17:26.289318] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:47.234 null0 00:32:47.234 [2024-04-23 05:17:26.321386] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:32:47.234 [2024-04-23 05:17:26.321920] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:32:47.234 [2024-04-23 05:17:26.329405] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:32:47.234 05:17:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:47.234 05:17:26 -- keyring/file.sh@43 -- # NOT rpc_cmd nvmf_subsystem_add_listener -t tcp -a 127.0.0.1 -s 4420 nqn.2016-06.io.spdk:cnode0 00:32:47.234 05:17:26 -- common/autotest_common.sh@638 -- # local es=0 00:32:47.234 05:17:26 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd nvmf_subsystem_add_listener -t tcp -a 127.0.0.1 -s 4420 nqn.2016-06.io.spdk:cnode0 00:32:47.234 05:17:26 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:32:47.234 05:17:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:47.234 05:17:26 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:32:47.234 05:17:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:47.234 05:17:26 -- common/autotest_common.sh@641 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 127.0.0.1 -s 4420 nqn.2016-06.io.spdk:cnode0 00:32:47.234 05:17:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:47.234 05:17:26 -- common/autotest_common.sh@10 -- # set +x 00:32:47.234 [2024-04-23 05:17:26.337400] nvmf_rpc.c: 769:nvmf_rpc_listen_paused: *ERROR*: A listener already exists with different secure channel option.request: 00:32:47.234 { 00:32:47.234 "nqn": "nqn.2016-06.io.spdk:cnode0", 00:32:47.234 "secure_channel": false, 00:32:47.234 "listen_address": { 00:32:47.234 "trtype": "tcp", 00:32:47.234 "traddr": "127.0.0.1", 00:32:47.234 "trsvcid": "4420" 00:32:47.234 }, 00:32:47.234 "method": "nvmf_subsystem_add_listener", 00:32:47.234 "req_id": 1 00:32:47.234 } 00:32:47.234 Got JSON-RPC error response 00:32:47.234 response: 00:32:47.234 { 00:32:47.234 "code": -32602, 00:32:47.234 "message": "Invalid parameters" 00:32:47.234 } 00:32:47.234 05:17:26 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:32:47.234 05:17:26 -- common/autotest_common.sh@641 -- # es=1 00:32:47.234 05:17:26 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:47.234 05:17:26 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:47.234 05:17:26 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:47.234 05:17:26 -- keyring/file.sh@46 -- # bperfpid=2553441 00:32:47.234 05:17:26 -- keyring/file.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -q 128 -o 4k -w randrw -M 50 -t 1 -m 2 -r /var/tmp/bperf.sock -z 00:32:47.234 05:17:26 -- keyring/file.sh@48 -- # waitforlisten 2553441 /var/tmp/bperf.sock 00:32:47.234 05:17:26 -- common/autotest_common.sh@817 -- # '[' -z 2553441 ']' 00:32:47.234 05:17:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:32:47.234 05:17:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:47.234 05:17:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:32:47.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:32:47.234 05:17:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:47.234 05:17:26 -- common/autotest_common.sh@10 -- # set +x 00:32:47.234 [2024-04-23 05:17:26.385303] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:32:47.234 [2024-04-23 05:17:26.385365] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2553441 ] 00:32:47.493 EAL: No free 2048 kB hugepages reported on node 1 00:32:47.493 [2024-04-23 05:17:26.417080] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:32:47.493 [2024-04-23 05:17:26.446312] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:32:47.493 [2024-04-23 05:17:26.536523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:47.493 05:17:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:47.493 05:17:26 -- common/autotest_common.sh@850 -- # return 0 00:32:47.493 05:17:26 -- keyring/file.sh@49 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:47.493 05:17:26 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:47.752 05:17:26 -- keyring/file.sh@50 -- # bperf_cmd keyring_file_add_key key1 /tmp/tmp.KMzxzmIvqF 00:32:47.752 05:17:26 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key1 /tmp/tmp.KMzxzmIvqF 00:32:48.010 05:17:27 -- keyring/file.sh@51 -- # get_key key0 00:32:48.010 05:17:27 -- keyring/file.sh@51 -- # jq -r .path 00:32:48.010 05:17:27 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:48.010 05:17:27 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:48.010 05:17:27 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:48.268 05:17:27 -- keyring/file.sh@51 -- # [[ /tmp/tmp.EvPKqVeL3H == \/\t\m\p\/\t\m\p\.\E\v\P\K\q\V\e\L\3\H ]] 00:32:48.268 05:17:27 -- keyring/file.sh@52 -- # get_key key1 00:32:48.268 05:17:27 -- keyring/file.sh@52 -- # jq -r .path 00:32:48.268 05:17:27 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:48.268 05:17:27 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:48.268 05:17:27 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:32:48.551 05:17:27 -- keyring/file.sh@52 -- # [[ /tmp/tmp.KMzxzmIvqF == \/\t\m\p\/\t\m\p\.\K\M\z\x\z\m\I\v\q\F ]] 00:32:48.552 05:17:27 -- keyring/file.sh@53 -- # get_refcnt key0 00:32:48.552 05:17:27 -- keyring/common.sh@12 -- # get_key key0 00:32:48.552 05:17:27 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:48.552 05:17:27 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:48.552 05:17:27 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:48.552 05:17:27 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:48.809 05:17:27 -- keyring/file.sh@53 -- # (( 1 == 1 )) 00:32:48.809 05:17:27 -- keyring/file.sh@54 -- # get_refcnt key1 00:32:48.809 05:17:27 -- keyring/common.sh@12 -- # get_key key1 00:32:48.809 05:17:27 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:48.809 05:17:27 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:48.809 05:17:27 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:48.809 05:17:27 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:32:49.067 05:17:28 -- keyring/file.sh@54 -- # (( 1 == 1 )) 00:32:49.067 05:17:28 -- keyring/file.sh@57 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:49.067 05:17:28 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:49.325 [2024-04-23 05:17:28.352934] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:32:49.325 nvme0n1 00:32:49.325 05:17:28 -- keyring/file.sh@59 -- # get_refcnt key0 00:32:49.325 05:17:28 -- keyring/common.sh@12 -- # get_key key0 00:32:49.325 05:17:28 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:49.325 05:17:28 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:49.325 05:17:28 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:49.325 05:17:28 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:49.584 05:17:28 -- keyring/file.sh@59 -- # (( 2 == 2 )) 00:32:49.584 05:17:28 -- keyring/file.sh@60 -- # get_refcnt key1 00:32:49.584 05:17:28 -- keyring/common.sh@12 -- # get_key key1 00:32:49.584 05:17:28 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:49.584 05:17:28 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:49.584 05:17:28 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:49.584 05:17:28 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:32:49.843 05:17:28 -- keyring/file.sh@60 -- # (( 1 == 1 )) 00:32:49.843 05:17:28 -- keyring/file.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:32:50.101 Running I/O for 1 seconds... 00:32:51.041 00:32:51.041 Latency(us) 00:32:51.041 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:32:51.041 Job: nvme0n1 (Core Mask 0x2, workload: randrw, percentage: 50, depth: 128, IO size: 4096) 00:32:51.041 nvme0n1 : 1.01 6681.87 26.10 0.00 0.00 19062.99 10243.03 32234.00 00:32:51.041 =================================================================================================================== 00:32:51.041 Total : 6681.87 26.10 0.00 0.00 19062.99 10243.03 32234.00 00:32:51.041 0 00:32:51.041 05:17:30 -- keyring/file.sh@64 -- # bperf_cmd bdev_nvme_detach_controller nvme0 00:32:51.041 05:17:30 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_detach_controller nvme0 00:32:51.299 05:17:30 -- keyring/file.sh@65 -- # get_refcnt key0 00:32:51.299 05:17:30 -- keyring/common.sh@12 -- # get_key key0 00:32:51.299 05:17:30 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:51.299 05:17:30 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:51.299 05:17:30 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:51.299 05:17:30 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:51.557 05:17:30 -- keyring/file.sh@65 -- # (( 1 == 1 )) 00:32:51.557 05:17:30 -- keyring/file.sh@66 -- # get_refcnt key1 00:32:51.557 05:17:30 -- keyring/common.sh@12 -- # get_key key1 00:32:51.557 05:17:30 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:51.557 05:17:30 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:51.557 05:17:30 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:51.557 05:17:30 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:32:51.816 05:17:30 -- keyring/file.sh@66 -- # (( 1 == 1 )) 00:32:51.816 05:17:30 -- keyring/file.sh@69 -- # NOT bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:32:51.816 05:17:30 -- common/autotest_common.sh@638 -- # local es=0 00:32:51.816 05:17:30 -- common/autotest_common.sh@640 -- # valid_exec_arg bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:32:51.816 05:17:30 -- common/autotest_common.sh@626 -- # local arg=bperf_cmd 00:32:51.816 05:17:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:51.816 05:17:30 -- common/autotest_common.sh@630 -- # type -t bperf_cmd 00:32:51.816 05:17:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:51.816 05:17:30 -- common/autotest_common.sh@641 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:32:51.816 05:17:30 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:32:52.074 [2024-04-23 05:17:31.026393] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:32:52.074 [2024-04-23 05:17:31.026858] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe7f8d0 (107): Transport endpoint is not connected 00:32:52.074 [2024-04-23 05:17:31.027851] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe7f8d0 (9): Bad file descriptor 00:32:52.074 [2024-04-23 05:17:31.028849] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:32:52.074 [2024-04-23 05:17:31.028872] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 127.0.0.1 00:32:52.074 [2024-04-23 05:17:31.028897] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:32:52.074 request: 00:32:52.074 { 00:32:52.074 "name": "nvme0", 00:32:52.074 "trtype": "tcp", 00:32:52.074 "traddr": "127.0.0.1", 00:32:52.074 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:52.074 "adrfam": "ipv4", 00:32:52.074 "trsvcid": "4420", 00:32:52.074 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:52.074 "psk": "key1", 00:32:52.074 "method": "bdev_nvme_attach_controller", 00:32:52.074 "req_id": 1 00:32:52.074 } 00:32:52.074 Got JSON-RPC error response 00:32:52.074 response: 00:32:52.074 { 00:32:52.074 "code": -32602, 00:32:52.074 "message": "Invalid parameters" 00:32:52.074 } 00:32:52.074 05:17:31 -- common/autotest_common.sh@641 -- # es=1 00:32:52.074 05:17:31 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:52.074 05:17:31 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:52.074 05:17:31 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:52.074 05:17:31 -- keyring/file.sh@71 -- # get_refcnt key0 00:32:52.074 05:17:31 -- keyring/common.sh@12 -- # get_key key0 00:32:52.074 05:17:31 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:52.074 05:17:31 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:52.074 05:17:31 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:52.074 05:17:31 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:52.333 05:17:31 -- keyring/file.sh@71 -- # (( 1 == 1 )) 00:32:52.333 05:17:31 -- keyring/file.sh@72 -- # get_refcnt key1 00:32:52.333 05:17:31 -- keyring/common.sh@12 -- # get_key key1 00:32:52.333 05:17:31 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:52.333 05:17:31 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:52.333 05:17:31 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:52.333 05:17:31 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:32:52.591 05:17:31 -- keyring/file.sh@72 -- # (( 1 == 1 )) 00:32:52.591 05:17:31 -- keyring/file.sh@75 -- # bperf_cmd keyring_file_remove_key key0 00:32:52.591 05:17:31 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key0 00:32:52.850 05:17:31 -- keyring/file.sh@76 -- # bperf_cmd keyring_file_remove_key key1 00:32:52.850 05:17:31 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key1 00:32:53.109 05:17:32 -- keyring/file.sh@77 -- # jq length 00:32:53.110 05:17:32 -- keyring/file.sh@77 -- # bperf_cmd keyring_get_keys 00:32:53.110 05:17:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:53.110 05:17:32 -- keyring/file.sh@77 -- # (( 0 == 0 )) 00:32:53.110 05:17:32 -- keyring/file.sh@80 -- # chmod 0660 /tmp/tmp.EvPKqVeL3H 00:32:53.368 05:17:32 -- keyring/file.sh@81 -- # NOT bperf_cmd keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:53.368 05:17:32 -- common/autotest_common.sh@638 -- # local es=0 00:32:53.368 05:17:32 -- common/autotest_common.sh@640 -- # valid_exec_arg bperf_cmd keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:53.368 05:17:32 -- common/autotest_common.sh@626 -- # local arg=bperf_cmd 00:32:53.368 05:17:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:53.368 05:17:32 -- common/autotest_common.sh@630 -- # type -t bperf_cmd 00:32:53.368 05:17:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:53.368 05:17:32 -- common/autotest_common.sh@641 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:53.368 05:17:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:53.368 [2024-04-23 05:17:32.502755] keyring.c: 34:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.EvPKqVeL3H': 0100660 00:32:53.368 [2024-04-23 05:17:32.502790] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:32:53.368 request: 00:32:53.368 { 00:32:53.368 "name": "key0", 00:32:53.368 "path": "/tmp/tmp.EvPKqVeL3H", 00:32:53.368 "method": "keyring_file_add_key", 00:32:53.368 "req_id": 1 00:32:53.368 } 00:32:53.368 Got JSON-RPC error response 00:32:53.368 response: 00:32:53.368 { 00:32:53.368 "code": -1, 00:32:53.368 "message": "Operation not permitted" 00:32:53.368 } 00:32:53.368 05:17:32 -- common/autotest_common.sh@641 -- # es=1 00:32:53.368 05:17:32 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:53.368 05:17:32 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:53.368 05:17:32 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:53.368 05:17:32 -- keyring/file.sh@84 -- # chmod 0600 /tmp/tmp.EvPKqVeL3H 00:32:53.368 05:17:32 -- keyring/file.sh@85 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:53.368 05:17:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.EvPKqVeL3H 00:32:53.627 05:17:32 -- keyring/file.sh@86 -- # rm -f /tmp/tmp.EvPKqVeL3H 00:32:53.627 05:17:32 -- keyring/file.sh@88 -- # get_refcnt key0 00:32:53.627 05:17:32 -- keyring/common.sh@12 -- # get_key key0 00:32:53.627 05:17:32 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:53.627 05:17:32 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:53.627 05:17:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:53.627 05:17:32 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:53.886 05:17:33 -- keyring/file.sh@88 -- # (( 1 == 1 )) 00:32:53.886 05:17:33 -- keyring/file.sh@90 -- # NOT bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:53.886 05:17:33 -- common/autotest_common.sh@638 -- # local es=0 00:32:53.886 05:17:33 -- common/autotest_common.sh@640 -- # valid_exec_arg bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:53.886 05:17:33 -- common/autotest_common.sh@626 -- # local arg=bperf_cmd 00:32:53.886 05:17:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:53.886 05:17:33 -- common/autotest_common.sh@630 -- # type -t bperf_cmd 00:32:53.886 05:17:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:53.886 05:17:33 -- common/autotest_common.sh@641 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:53.886 05:17:33 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:54.144 [2024-04-23 05:17:33.240765] keyring.c: 29:keyring_file_check_path: *ERROR*: Could not stat key file '/tmp/tmp.EvPKqVeL3H': No such file or directory 00:32:54.144 [2024-04-23 05:17:33.240799] nvme_tcp.c:2570:nvme_tcp_generate_tls_credentials: *ERROR*: Failed to obtain key 'key0': No such file or directory 00:32:54.144 [2024-04-23 05:17:33.240846] nvme.c: 683:nvme_ctrlr_probe: *ERROR*: Failed to construct NVMe controller for SSD: 127.0.0.1 00:32:54.144 [2024-04-23 05:17:33.240859] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:32:54.145 [2024-04-23 05:17:33.240873] bdev_nvme.c:6204:bdev_nvme_create: *ERROR*: No controller was found with provided trid (traddr: 127.0.0.1) 00:32:54.145 request: 00:32:54.145 { 00:32:54.145 "name": "nvme0", 00:32:54.145 "trtype": "tcp", 00:32:54.145 "traddr": "127.0.0.1", 00:32:54.145 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:54.145 "adrfam": "ipv4", 00:32:54.145 "trsvcid": "4420", 00:32:54.145 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:54.145 "psk": "key0", 00:32:54.145 "method": "bdev_nvme_attach_controller", 00:32:54.145 "req_id": 1 00:32:54.145 } 00:32:54.145 Got JSON-RPC error response 00:32:54.145 response: 00:32:54.145 { 00:32:54.145 "code": -19, 00:32:54.145 "message": "No such device" 00:32:54.145 } 00:32:54.145 05:17:33 -- common/autotest_common.sh@641 -- # es=1 00:32:54.145 05:17:33 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:54.145 05:17:33 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:54.145 05:17:33 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:54.145 05:17:33 -- keyring/file.sh@92 -- # bperf_cmd keyring_file_remove_key key0 00:32:54.145 05:17:33 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key0 00:32:54.403 05:17:33 -- keyring/file.sh@95 -- # prep_key key0 00112233445566778899aabbccddeeff 0 00:32:54.403 05:17:33 -- keyring/common.sh@15 -- # local name key digest path 00:32:54.403 05:17:33 -- keyring/common.sh@17 -- # name=key0 00:32:54.403 05:17:33 -- keyring/common.sh@17 -- # key=00112233445566778899aabbccddeeff 00:32:54.403 05:17:33 -- keyring/common.sh@17 -- # digest=0 00:32:54.403 05:17:33 -- keyring/common.sh@18 -- # mktemp 00:32:54.403 05:17:33 -- keyring/common.sh@18 -- # path=/tmp/tmp.wq1s5HTxG0 00:32:54.403 05:17:33 -- keyring/common.sh@20 -- # format_interchange_psk 00112233445566778899aabbccddeeff 0 00:32:54.403 05:17:33 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 0 00:32:54.403 05:17:33 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:54.403 05:17:33 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:32:54.403 05:17:33 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff 00:32:54.403 05:17:33 -- nvmf/common.sh@693 -- # digest=0 00:32:54.403 05:17:33 -- nvmf/common.sh@694 -- # python - 00:32:54.403 05:17:33 -- keyring/common.sh@21 -- # chmod 0600 /tmp/tmp.wq1s5HTxG0 00:32:54.403 05:17:33 -- keyring/common.sh@23 -- # echo /tmp/tmp.wq1s5HTxG0 00:32:54.403 05:17:33 -- keyring/file.sh@95 -- # key0path=/tmp/tmp.wq1s5HTxG0 00:32:54.403 05:17:33 -- keyring/file.sh@96 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.wq1s5HTxG0 00:32:54.403 05:17:33 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.wq1s5HTxG0 00:32:54.661 05:17:33 -- keyring/file.sh@97 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:54.662 05:17:33 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:54.921 nvme0n1 00:32:55.181 05:17:34 -- keyring/file.sh@99 -- # get_refcnt key0 00:32:55.181 05:17:34 -- keyring/common.sh@12 -- # get_key key0 00:32:55.181 05:17:34 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:55.181 05:17:34 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:55.181 05:17:34 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:55.181 05:17:34 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:55.181 05:17:34 -- keyring/file.sh@99 -- # (( 2 == 2 )) 00:32:55.181 05:17:34 -- keyring/file.sh@100 -- # bperf_cmd keyring_file_remove_key key0 00:32:55.181 05:17:34 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key0 00:32:55.439 05:17:34 -- keyring/file.sh@101 -- # get_key key0 00:32:55.439 05:17:34 -- keyring/file.sh@101 -- # jq -r .removed 00:32:55.439 05:17:34 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:55.439 05:17:34 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:55.439 05:17:34 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:55.697 05:17:34 -- keyring/file.sh@101 -- # [[ true == \t\r\u\e ]] 00:32:55.697 05:17:34 -- keyring/file.sh@102 -- # get_refcnt key0 00:32:55.697 05:17:34 -- keyring/common.sh@12 -- # get_key key0 00:32:55.697 05:17:34 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:55.697 05:17:34 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:55.697 05:17:34 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:55.697 05:17:34 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:55.955 05:17:35 -- keyring/file.sh@102 -- # (( 1 == 1 )) 00:32:55.955 05:17:35 -- keyring/file.sh@103 -- # bperf_cmd bdev_nvme_detach_controller nvme0 00:32:55.955 05:17:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_detach_controller nvme0 00:32:56.213 05:17:35 -- keyring/file.sh@104 -- # bperf_cmd keyring_get_keys 00:32:56.213 05:17:35 -- keyring/file.sh@104 -- # jq length 00:32:56.213 05:17:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:56.471 05:17:35 -- keyring/file.sh@104 -- # (( 0 == 0 )) 00:32:56.471 05:17:35 -- keyring/file.sh@107 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.wq1s5HTxG0 00:32:56.471 05:17:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.wq1s5HTxG0 00:32:56.729 05:17:35 -- keyring/file.sh@108 -- # bperf_cmd keyring_file_add_key key1 /tmp/tmp.KMzxzmIvqF 00:32:56.729 05:17:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key1 /tmp/tmp.KMzxzmIvqF 00:32:56.987 05:17:36 -- keyring/file.sh@109 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:56.987 05:17:36 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:32:57.245 nvme0n1 00:32:57.245 05:17:36 -- keyring/file.sh@112 -- # bperf_cmd save_config 00:32:57.245 05:17:36 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock save_config 00:32:57.504 05:17:36 -- keyring/file.sh@112 -- # config='{ 00:32:57.504 "subsystems": [ 00:32:57.504 { 00:32:57.504 "subsystem": "keyring", 00:32:57.504 "config": [ 00:32:57.504 { 00:32:57.504 "method": "keyring_file_add_key", 00:32:57.504 "params": { 00:32:57.504 "name": "key0", 00:32:57.504 "path": "/tmp/tmp.wq1s5HTxG0" 00:32:57.504 } 00:32:57.504 }, 00:32:57.504 { 00:32:57.504 "method": "keyring_file_add_key", 00:32:57.504 "params": { 00:32:57.504 "name": "key1", 00:32:57.504 "path": "/tmp/tmp.KMzxzmIvqF" 00:32:57.504 } 00:32:57.504 } 00:32:57.504 ] 00:32:57.504 }, 00:32:57.504 { 00:32:57.504 "subsystem": "iobuf", 00:32:57.504 "config": [ 00:32:57.504 { 00:32:57.504 "method": "iobuf_set_options", 00:32:57.504 "params": { 00:32:57.504 "small_pool_count": 8192, 00:32:57.504 "large_pool_count": 1024, 00:32:57.504 "small_bufsize": 8192, 00:32:57.504 "large_bufsize": 135168 00:32:57.504 } 00:32:57.504 } 00:32:57.504 ] 00:32:57.504 }, 00:32:57.504 { 00:32:57.504 "subsystem": "sock", 00:32:57.504 "config": [ 00:32:57.504 { 00:32:57.504 "method": "sock_impl_set_options", 00:32:57.504 "params": { 00:32:57.504 "impl_name": "posix", 00:32:57.504 "recv_buf_size": 2097152, 00:32:57.504 "send_buf_size": 2097152, 00:32:57.504 "enable_recv_pipe": true, 00:32:57.504 "enable_quickack": false, 00:32:57.504 "enable_placement_id": 0, 00:32:57.504 "enable_zerocopy_send_server": true, 00:32:57.504 "enable_zerocopy_send_client": false, 00:32:57.504 "zerocopy_threshold": 0, 00:32:57.504 "tls_version": 0, 00:32:57.504 "enable_ktls": false 00:32:57.504 } 00:32:57.504 }, 00:32:57.504 { 00:32:57.504 "method": "sock_impl_set_options", 00:32:57.504 "params": { 00:32:57.504 "impl_name": "ssl", 00:32:57.504 "recv_buf_size": 4096, 00:32:57.504 "send_buf_size": 4096, 00:32:57.504 "enable_recv_pipe": true, 00:32:57.504 "enable_quickack": false, 00:32:57.504 "enable_placement_id": 0, 00:32:57.504 "enable_zerocopy_send_server": true, 00:32:57.504 "enable_zerocopy_send_client": false, 00:32:57.504 "zerocopy_threshold": 0, 00:32:57.504 "tls_version": 0, 00:32:57.504 "enable_ktls": false 00:32:57.504 } 00:32:57.504 } 00:32:57.504 ] 00:32:57.504 }, 00:32:57.504 { 00:32:57.504 "subsystem": "vmd", 00:32:57.504 "config": [] 00:32:57.504 }, 00:32:57.504 { 00:32:57.504 "subsystem": "accel", 00:32:57.504 "config": [ 00:32:57.504 { 00:32:57.504 "method": "accel_set_options", 00:32:57.504 "params": { 00:32:57.504 "small_cache_size": 128, 00:32:57.504 "large_cache_size": 16, 00:32:57.504 "task_count": 2048, 00:32:57.504 "sequence_count": 2048, 00:32:57.504 "buf_count": 2048 00:32:57.504 } 00:32:57.504 } 00:32:57.504 ] 00:32:57.504 }, 00:32:57.504 { 00:32:57.504 "subsystem": "bdev", 00:32:57.504 "config": [ 00:32:57.504 { 00:32:57.505 "method": "bdev_set_options", 00:32:57.505 "params": { 00:32:57.505 "bdev_io_pool_size": 65535, 00:32:57.505 "bdev_io_cache_size": 256, 00:32:57.505 "bdev_auto_examine": true, 00:32:57.505 "iobuf_small_cache_size": 128, 00:32:57.505 "iobuf_large_cache_size": 16 00:32:57.505 } 00:32:57.505 }, 00:32:57.505 { 00:32:57.505 "method": "bdev_raid_set_options", 00:32:57.505 "params": { 00:32:57.505 "process_window_size_kb": 1024 00:32:57.505 } 00:32:57.505 }, 00:32:57.505 { 00:32:57.505 "method": "bdev_iscsi_set_options", 00:32:57.505 "params": { 00:32:57.505 "timeout_sec": 30 00:32:57.505 } 00:32:57.505 }, 00:32:57.505 { 00:32:57.505 "method": "bdev_nvme_set_options", 00:32:57.505 "params": { 00:32:57.505 "action_on_timeout": "none", 00:32:57.505 "timeout_us": 0, 00:32:57.505 "timeout_admin_us": 0, 00:32:57.505 "keep_alive_timeout_ms": 10000, 00:32:57.505 "arbitration_burst": 0, 00:32:57.505 "low_priority_weight": 0, 00:32:57.505 "medium_priority_weight": 0, 00:32:57.505 "high_priority_weight": 0, 00:32:57.505 "nvme_adminq_poll_period_us": 10000, 00:32:57.505 "nvme_ioq_poll_period_us": 0, 00:32:57.505 "io_queue_requests": 512, 00:32:57.505 "delay_cmd_submit": true, 00:32:57.505 "transport_retry_count": 4, 00:32:57.505 "bdev_retry_count": 3, 00:32:57.505 "transport_ack_timeout": 0, 00:32:57.505 "ctrlr_loss_timeout_sec": 0, 00:32:57.505 "reconnect_delay_sec": 0, 00:32:57.505 "fast_io_fail_timeout_sec": 0, 00:32:57.505 "disable_auto_failback": false, 00:32:57.505 "generate_uuids": false, 00:32:57.505 "transport_tos": 0, 00:32:57.505 "nvme_error_stat": false, 00:32:57.505 "rdma_srq_size": 0, 00:32:57.505 "io_path_stat": false, 00:32:57.505 "allow_accel_sequence": false, 00:32:57.505 "rdma_max_cq_size": 0, 00:32:57.505 "rdma_cm_event_timeout_ms": 0, 00:32:57.505 "dhchap_digests": [ 00:32:57.505 "sha256", 00:32:57.505 "sha384", 00:32:57.505 "sha512" 00:32:57.505 ], 00:32:57.505 "dhchap_dhgroups": [ 00:32:57.505 "null", 00:32:57.505 "ffdhe2048", 00:32:57.505 "ffdhe3072", 00:32:57.505 "ffdhe4096", 00:32:57.505 "ffdhe6144", 00:32:57.505 "ffdhe8192" 00:32:57.505 ] 00:32:57.505 } 00:32:57.505 }, 00:32:57.505 { 00:32:57.505 "method": "bdev_nvme_attach_controller", 00:32:57.505 "params": { 00:32:57.505 "name": "nvme0", 00:32:57.505 "trtype": "TCP", 00:32:57.505 "adrfam": "IPv4", 00:32:57.505 "traddr": "127.0.0.1", 00:32:57.505 "trsvcid": "4420", 00:32:57.505 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:57.505 "prchk_reftag": false, 00:32:57.505 "prchk_guard": false, 00:32:57.505 "ctrlr_loss_timeout_sec": 0, 00:32:57.505 "reconnect_delay_sec": 0, 00:32:57.505 "fast_io_fail_timeout_sec": 0, 00:32:57.505 "psk": "key0", 00:32:57.505 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:57.505 "hdgst": false, 00:32:57.505 "ddgst": false 00:32:57.505 } 00:32:57.505 }, 00:32:57.505 { 00:32:57.505 "method": "bdev_nvme_set_hotplug", 00:32:57.505 "params": { 00:32:57.505 "period_us": 100000, 00:32:57.505 "enable": false 00:32:57.505 } 00:32:57.505 }, 00:32:57.505 { 00:32:57.505 "method": "bdev_wait_for_examine" 00:32:57.505 } 00:32:57.505 ] 00:32:57.505 }, 00:32:57.505 { 00:32:57.505 "subsystem": "nbd", 00:32:57.505 "config": [] 00:32:57.505 } 00:32:57.505 ] 00:32:57.505 }' 00:32:57.505 05:17:36 -- keyring/file.sh@114 -- # killprocess 2553441 00:32:57.505 05:17:36 -- common/autotest_common.sh@936 -- # '[' -z 2553441 ']' 00:32:57.505 05:17:36 -- common/autotest_common.sh@940 -- # kill -0 2553441 00:32:57.505 05:17:36 -- common/autotest_common.sh@941 -- # uname 00:32:57.505 05:17:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:57.505 05:17:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2553441 00:32:57.764 05:17:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:32:57.764 05:17:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:32:57.764 05:17:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2553441' 00:32:57.764 killing process with pid 2553441 00:32:57.764 05:17:36 -- common/autotest_common.sh@955 -- # kill 2553441 00:32:57.764 Received shutdown signal, test time was about 1.000000 seconds 00:32:57.764 00:32:57.764 Latency(us) 00:32:57.764 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:32:57.764 =================================================================================================================== 00:32:57.764 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:32:57.764 05:17:36 -- common/autotest_common.sh@960 -- # wait 2553441 00:32:57.764 05:17:36 -- keyring/file.sh@117 -- # bperfpid=2554779 00:32:57.764 05:17:36 -- keyring/file.sh@119 -- # waitforlisten 2554779 /var/tmp/bperf.sock 00:32:57.764 05:17:36 -- common/autotest_common.sh@817 -- # '[' -z 2554779 ']' 00:32:57.764 05:17:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:32:57.764 05:17:36 -- keyring/file.sh@115 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -q 128 -o 4k -w randrw -M 50 -t 1 -m 2 -r /var/tmp/bperf.sock -z -c /dev/fd/63 00:32:57.764 05:17:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:57.764 05:17:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:32:57.764 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:32:57.764 05:17:36 -- keyring/file.sh@115 -- # echo '{ 00:32:57.764 "subsystems": [ 00:32:57.764 { 00:32:57.764 "subsystem": "keyring", 00:32:57.764 "config": [ 00:32:57.764 { 00:32:57.764 "method": "keyring_file_add_key", 00:32:57.764 "params": { 00:32:57.764 "name": "key0", 00:32:57.764 "path": "/tmp/tmp.wq1s5HTxG0" 00:32:57.764 } 00:32:57.764 }, 00:32:57.764 { 00:32:57.764 "method": "keyring_file_add_key", 00:32:57.764 "params": { 00:32:57.764 "name": "key1", 00:32:57.764 "path": "/tmp/tmp.KMzxzmIvqF" 00:32:57.764 } 00:32:57.764 } 00:32:57.764 ] 00:32:57.764 }, 00:32:57.764 { 00:32:57.764 "subsystem": "iobuf", 00:32:57.764 "config": [ 00:32:57.764 { 00:32:57.764 "method": "iobuf_set_options", 00:32:57.764 "params": { 00:32:57.764 "small_pool_count": 8192, 00:32:57.764 "large_pool_count": 1024, 00:32:57.764 "small_bufsize": 8192, 00:32:57.764 "large_bufsize": 135168 00:32:57.764 } 00:32:57.764 } 00:32:57.764 ] 00:32:57.764 }, 00:32:57.764 { 00:32:57.764 "subsystem": "sock", 00:32:57.764 "config": [ 00:32:57.764 { 00:32:57.764 "method": "sock_impl_set_options", 00:32:57.764 "params": { 00:32:57.764 "impl_name": "posix", 00:32:57.764 "recv_buf_size": 2097152, 00:32:57.764 "send_buf_size": 2097152, 00:32:57.764 "enable_recv_pipe": true, 00:32:57.764 "enable_quickack": false, 00:32:57.764 "enable_placement_id": 0, 00:32:57.764 "enable_zerocopy_send_server": true, 00:32:57.764 "enable_zerocopy_send_client": false, 00:32:57.764 "zerocopy_threshold": 0, 00:32:57.764 "tls_version": 0, 00:32:57.764 "enable_ktls": false 00:32:57.764 } 00:32:57.764 }, 00:32:57.764 { 00:32:57.764 "method": "sock_impl_set_options", 00:32:57.764 "params": { 00:32:57.765 "impl_name": "ssl", 00:32:57.765 "recv_buf_size": 4096, 00:32:57.765 "send_buf_size": 4096, 00:32:57.765 "enable_recv_pipe": true, 00:32:57.765 "enable_quickack": false, 00:32:57.765 "enable_placement_id": 0, 00:32:57.765 "enable_zerocopy_send_server": true, 00:32:57.765 "enable_zerocopy_send_client": false, 00:32:57.765 "zerocopy_threshold": 0, 00:32:57.765 "tls_version": 0, 00:32:57.765 "enable_ktls": false 00:32:57.765 } 00:32:57.765 } 00:32:57.765 ] 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "subsystem": "vmd", 00:32:57.765 "config": [] 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "subsystem": "accel", 00:32:57.765 "config": [ 00:32:57.765 { 00:32:57.765 "method": "accel_set_options", 00:32:57.765 "params": { 00:32:57.765 "small_cache_size": 128, 00:32:57.765 "large_cache_size": 16, 00:32:57.765 "task_count": 2048, 00:32:57.765 "sequence_count": 2048, 00:32:57.765 "buf_count": 2048 00:32:57.765 } 00:32:57.765 } 00:32:57.765 ] 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "subsystem": "bdev", 00:32:57.765 "config": [ 00:32:57.765 { 00:32:57.765 "method": "bdev_set_options", 00:32:57.765 "params": { 00:32:57.765 "bdev_io_pool_size": 65535, 00:32:57.765 "bdev_io_cache_size": 256, 00:32:57.765 "bdev_auto_examine": true, 00:32:57.765 "iobuf_small_cache_size": 128, 00:32:57.765 "iobuf_large_cache_size": 16 00:32:57.765 } 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "method": "bdev_raid_set_options", 00:32:57.765 "params": { 00:32:57.765 "process_window_size_kb": 1024 00:32:57.765 } 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "method": "bdev_iscsi_set_options", 00:32:57.765 "params": { 00:32:57.765 "timeout_sec": 30 00:32:57.765 } 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "method": "bdev_nvme_set_options", 00:32:57.765 "params": { 00:32:57.765 "action_on_timeout": "none", 00:32:57.765 "timeout_us": 0, 00:32:57.765 "timeout_admin_us": 0, 00:32:57.765 "keep_alive_timeout_ms": 10000, 00:32:57.765 "arbitration_burst": 0, 00:32:57.765 "low_priority_weight": 0, 00:32:57.765 "medium_priority_weight": 0, 00:32:57.765 "high_priority_weight": 0, 00:32:57.765 "nvme_adminq_poll_period_us": 10000, 00:32:57.765 "nvme_ioq_poll_period_us": 0, 00:32:57.765 "io_queue_requests": 512, 00:32:57.765 "delay_cmd_submit": true, 00:32:57.765 "transport_retry_count": 4, 00:32:57.765 "bdev_retry_count": 3, 00:32:57.765 "transport_ack_timeout": 0, 00:32:57.765 "ctrlr_loss_timeout_sec": 0, 00:32:57.765 "reconnect_delay_sec": 0, 00:32:57.765 "fast_io_fail_timeout_sec": 0, 00:32:57.765 "disable_auto_failback": false, 00:32:57.765 "generate_uuids": false, 00:32:57.765 "transport_tos": 0, 00:32:57.765 "nvme_error_stat": false, 00:32:57.765 "rdma_srq_size": 0, 00:32:57.765 "io_path_stat": false, 00:32:57.765 "allow_accel_sequence": false, 00:32:57.765 "rdma_max_cq_size": 0, 00:32:57.765 "rdma_cm_event_timeout_ms": 0, 00:32:57.765 "dhchap_digests": [ 00:32:57.765 "sha256", 00:32:57.765 "sha384", 00:32:57.765 "sha512" 00:32:57.765 ], 00:32:57.765 "dhchap_dhgroups": [ 00:32:57.765 "null", 00:32:57.765 "ffdhe2048", 00:32:57.765 "ffdhe3072", 00:32:57.765 "ffdhe4096", 00:32:57.765 "ffdhe6144", 00:32:57.765 "ffdhe8192" 00:32:57.765 ] 00:32:57.765 } 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "method": "bdev_nvme_attach_controller", 00:32:57.765 "params": { 00:32:57.765 "name": "nvme0", 00:32:57.765 "trtype": "TCP", 00:32:57.765 "adrfam": "IPv4", 00:32:57.765 "traddr": "127.0.0.1", 00:32:57.765 "trsvcid": "4420", 00:32:57.765 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:57.765 "prchk_reftag": false, 00:32:57.765 "prchk_guard": false, 00:32:57.765 "ctrlr_loss_timeout_sec": 0, 00:32:57.765 "reconnect_delay_sec": 0, 00:32:57.765 "fast_io_fail_timeout_sec": 0, 00:32:57.765 "psk": "key0", 00:32:57.765 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:57.765 "hdgst": false, 00:32:57.765 "ddgst": false 00:32:57.765 } 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "method": "bdev_nvme_set_hotplug", 00:32:57.765 "params": { 00:32:57.765 "period_us": 100000, 00:32:57.765 "enable": false 00:32:57.765 } 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "method": "bdev_wait_for_examine" 00:32:57.765 } 00:32:57.765 ] 00:32:57.765 }, 00:32:57.765 { 00:32:57.765 "subsystem": "nbd", 00:32:57.765 "config": [] 00:32:57.765 } 00:32:57.765 ] 00:32:57.765 }' 00:32:57.765 05:17:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:57.765 05:17:36 -- common/autotest_common.sh@10 -- # set +x 00:32:58.024 [2024-04-23 05:17:36.949359] Starting SPDK v24.05-pre git sha1 a1264177c / DPDK 24.07.0-rc0 initialization... 00:32:58.024 [2024-04-23 05:17:36.949447] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2554779 ] 00:32:58.024 EAL: No free 2048 kB hugepages reported on node 1 00:32:58.024 [2024-04-23 05:17:36.980414] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc0 is used. There is no support for it in SPDK. Enabled only for validation. 00:32:58.024 [2024-04-23 05:17:37.007837] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:32:58.024 [2024-04-23 05:17:37.094748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:58.282 [2024-04-23 05:17:37.266307] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:32:58.849 05:17:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:58.849 05:17:37 -- common/autotest_common.sh@850 -- # return 0 00:32:58.849 05:17:37 -- keyring/file.sh@120 -- # bperf_cmd keyring_get_keys 00:32:58.849 05:17:37 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:58.849 05:17:37 -- keyring/file.sh@120 -- # jq length 00:32:59.107 05:17:38 -- keyring/file.sh@120 -- # (( 2 == 2 )) 00:32:59.107 05:17:38 -- keyring/file.sh@121 -- # get_refcnt key0 00:32:59.107 05:17:38 -- keyring/common.sh@12 -- # get_key key0 00:32:59.107 05:17:38 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:59.107 05:17:38 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:59.107 05:17:38 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:59.107 05:17:38 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:32:59.365 05:17:38 -- keyring/file.sh@121 -- # (( 2 == 2 )) 00:32:59.365 05:17:38 -- keyring/file.sh@122 -- # get_refcnt key1 00:32:59.365 05:17:38 -- keyring/common.sh@12 -- # get_key key1 00:32:59.365 05:17:38 -- keyring/common.sh@12 -- # jq -r .refcnt 00:32:59.365 05:17:38 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:32:59.365 05:17:38 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:32:59.365 05:17:38 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:32:59.623 05:17:38 -- keyring/file.sh@122 -- # (( 1 == 1 )) 00:32:59.623 05:17:38 -- keyring/file.sh@123 -- # bperf_cmd bdev_nvme_get_controllers 00:32:59.623 05:17:38 -- keyring/file.sh@123 -- # jq -r '.[].name' 00:32:59.623 05:17:38 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_get_controllers 00:32:59.881 05:17:38 -- keyring/file.sh@123 -- # [[ nvme0 == nvme0 ]] 00:32:59.881 05:17:38 -- keyring/file.sh@1 -- # cleanup 00:32:59.881 05:17:38 -- keyring/file.sh@19 -- # rm -f /tmp/tmp.wq1s5HTxG0 /tmp/tmp.KMzxzmIvqF 00:32:59.881 05:17:38 -- keyring/file.sh@20 -- # killprocess 2554779 00:32:59.881 05:17:38 -- common/autotest_common.sh@936 -- # '[' -z 2554779 ']' 00:32:59.881 05:17:38 -- common/autotest_common.sh@940 -- # kill -0 2554779 00:32:59.881 05:17:38 -- common/autotest_common.sh@941 -- # uname 00:32:59.881 05:17:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:59.881 05:17:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2554779 00:32:59.881 05:17:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:32:59.881 05:17:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:32:59.881 05:17:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2554779' 00:32:59.881 killing process with pid 2554779 00:32:59.881 05:17:38 -- common/autotest_common.sh@955 -- # kill 2554779 00:32:59.881 Received shutdown signal, test time was about 1.000000 seconds 00:32:59.881 00:32:59.881 Latency(us) 00:32:59.881 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:32:59.881 =================================================================================================================== 00:32:59.881 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:32:59.881 05:17:38 -- common/autotest_common.sh@960 -- # wait 2554779 00:33:00.141 05:17:39 -- keyring/file.sh@21 -- # killprocess 2553389 00:33:00.141 05:17:39 -- common/autotest_common.sh@936 -- # '[' -z 2553389 ']' 00:33:00.141 05:17:39 -- common/autotest_common.sh@940 -- # kill -0 2553389 00:33:00.141 05:17:39 -- common/autotest_common.sh@941 -- # uname 00:33:00.141 05:17:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:00.141 05:17:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2553389 00:33:00.141 05:17:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:33:00.141 05:17:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:33:00.141 05:17:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2553389' 00:33:00.141 killing process with pid 2553389 00:33:00.141 05:17:39 -- common/autotest_common.sh@955 -- # kill 2553389 00:33:00.141 [2024-04-23 05:17:39.134487] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:33:00.141 05:17:39 -- common/autotest_common.sh@960 -- # wait 2553389 00:33:00.400 00:33:00.400 real 0m13.838s 00:33:00.400 user 0m34.365s 00:33:00.400 sys 0m3.251s 00:33:00.400 05:17:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:00.400 05:17:39 -- common/autotest_common.sh@10 -- # set +x 00:33:00.400 ************************************ 00:33:00.400 END TEST keyring_file 00:33:00.400 ************************************ 00:33:00.400 05:17:39 -- spdk/autotest.sh@294 -- # [[ n == y ]] 00:33:00.400 05:17:39 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:33:00.400 05:17:39 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:00.400 05:17:39 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:00.400 05:17:39 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:33:00.400 05:17:39 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:33:00.400 05:17:39 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:33:00.400 05:17:39 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:33:00.400 05:17:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:00.400 05:17:39 -- common/autotest_common.sh@10 -- # set +x 00:33:00.400 05:17:39 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:33:00.400 05:17:39 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:33:00.400 05:17:39 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:33:00.400 05:17:39 -- common/autotest_common.sh@10 -- # set +x 00:33:02.304 INFO: APP EXITING 00:33:02.304 INFO: killing all VMs 00:33:02.304 INFO: killing vhost app 00:33:02.304 INFO: EXIT DONE 00:33:03.280 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:03.280 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:03.280 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:03.280 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:03.280 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:03.280 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:03.280 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:03.280 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:03.280 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:03.280 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:03.539 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:03.539 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:03.539 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:03.539 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:03.539 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:03.539 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:03.539 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:04.917 Cleaning 00:33:04.917 Removing: /var/run/dpdk/spdk0/config 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:04.917 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:04.917 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:04.917 Removing: /var/run/dpdk/spdk1/config 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:04.917 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:04.917 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:04.917 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:04.917 Removing: /var/run/dpdk/spdk2/config 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:04.917 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:04.917 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:04.917 Removing: /var/run/dpdk/spdk3/config 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:04.917 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:04.917 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:04.917 Removing: /var/run/dpdk/spdk4/config 00:33:04.917 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:04.917 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:04.917 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:04.917 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:04.917 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:04.917 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:04.918 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:04.918 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:04.918 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:04.918 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:04.918 Removing: /dev/shm/bdev_svc_trace.1 00:33:04.918 Removing: /dev/shm/nvmf_trace.0 00:33:04.918 Removing: /dev/shm/spdk_tgt_trace.pid2268518 00:33:04.918 Removing: /var/run/dpdk/spdk0 00:33:04.918 Removing: /var/run/dpdk/spdk1 00:33:04.918 Removing: /var/run/dpdk/spdk2 00:33:04.918 Removing: /var/run/dpdk/spdk3 00:33:04.918 Removing: /var/run/dpdk/spdk4 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2266799 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2267555 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2268518 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2268999 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2269700 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2269840 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2270570 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2270582 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2270838 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2272145 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2273035 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2273269 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2273463 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2273670 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2273982 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2274162 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2274328 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2274563 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2275225 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2278096 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2278266 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2278434 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2278565 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2278880 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2279007 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2279323 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2279450 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2279625 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2279749 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2279926 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2279936 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2280333 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2280595 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2280804 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2280990 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2281084 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2281232 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2281504 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2281674 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2281836 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2282118 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2282281 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2282451 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2282726 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2282893 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2283061 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2283338 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2283508 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2283672 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2283950 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2284114 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2284285 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2284559 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2284730 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2284897 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2285175 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2285344 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2285537 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2285758 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2287905 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2341433 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2343944 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2349723 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2352978 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2355336 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2355744 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2362878 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2362880 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2363532 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2364188 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2364734 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2365131 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2365202 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2365392 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2365527 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2365529 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2366296 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2367339 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2368000 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2368395 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2368401 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2368663 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2369496 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2370271 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2375772 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2375939 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2378452 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2382162 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2384218 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2390595 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2395810 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2396999 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2397723 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2408364 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2410576 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2413370 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2414545 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2415746 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2415885 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2416018 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2416042 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2416462 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2417784 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2418389 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2418817 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2420434 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2420735 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2421298 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2423823 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2427083 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2430727 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2454002 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2456641 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2460522 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2461979 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2463080 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2465637 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2467874 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2472098 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2472105 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2474887 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2475018 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2475152 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2475439 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2475544 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2476617 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2477796 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2478975 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2480160 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2481336 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2482588 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2486189 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2486525 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2487654 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2488132 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2491710 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2494182 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2497593 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2500916 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2505248 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2505250 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2517021 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2517430 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2517862 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2518360 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2518953 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2519354 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2519764 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2520174 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2522675 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2522820 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2526623 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2526801 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2528916 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2534063 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2534068 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2536973 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2538260 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2539754 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2540529 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2541932 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2542696 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2548062 00:33:04.918 Removing: /var/run/dpdk/spdk_pid2548369 00:33:05.177 Removing: /var/run/dpdk/spdk_pid2548757 00:33:05.177 Removing: /var/run/dpdk/spdk_pid2550268 00:33:05.177 Removing: /var/run/dpdk/spdk_pid2550597 00:33:05.177 Removing: /var/run/dpdk/spdk_pid2550998 00:33:05.177 Removing: /var/run/dpdk/spdk_pid2553389 00:33:05.177 Removing: /var/run/dpdk/spdk_pid2553441 00:33:05.177 Removing: /var/run/dpdk/spdk_pid2554779 00:33:05.177 Clean 00:33:05.177 05:17:44 -- common/autotest_common.sh@1437 -- # return 0 00:33:05.177 05:17:44 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:33:05.177 05:17:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:05.177 05:17:44 -- common/autotest_common.sh@10 -- # set +x 00:33:05.177 05:17:44 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:33:05.177 05:17:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:05.177 05:17:44 -- common/autotest_common.sh@10 -- # set +x 00:33:05.177 05:17:44 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:05.177 05:17:44 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:05.177 05:17:44 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:05.177 05:17:44 -- spdk/autotest.sh@389 -- # hash lcov 00:33:05.177 05:17:44 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:33:05.177 05:17:44 -- spdk/autotest.sh@391 -- # hostname 00:33:05.177 05:17:44 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:05.436 geninfo: WARNING: invalid characters removed from testname! 00:33:37.523 05:18:11 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:37.523 05:18:15 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:39.422 05:18:18 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:41.951 05:18:21 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:45.230 05:18:23 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:47.757 05:18:26 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:51.069 05:18:29 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:51.069 05:18:29 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:51.069 05:18:29 -- scripts/common.sh@502 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:51.069 05:18:29 -- scripts/common.sh@510 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:51.069 05:18:29 -- scripts/common.sh@511 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:51.069 05:18:29 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:51.069 05:18:29 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:51.069 05:18:29 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:51.069 05:18:29 -- paths/export.sh@5 -- $ export PATH 00:33:51.069 05:18:29 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:51.069 05:18:29 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:51.069 05:18:29 -- common/autobuild_common.sh@435 -- $ date +%s 00:33:51.069 05:18:29 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713842309.XXXXXX 00:33:51.069 05:18:29 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713842309.OiAxXF 00:33:51.069 05:18:29 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:33:51.069 05:18:29 -- common/autobuild_common.sh@441 -- $ '[' -n main ']' 00:33:51.069 05:18:29 -- common/autobuild_common.sh@442 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:33:51.069 05:18:29 -- common/autobuild_common.sh@442 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:33:51.069 05:18:29 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:51.069 05:18:29 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:51.069 05:18:29 -- common/autobuild_common.sh@451 -- $ get_config_params 00:33:51.069 05:18:29 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:33:51.069 05:18:29 -- common/autotest_common.sh@10 -- $ set +x 00:33:51.069 05:18:29 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:33:51.069 05:18:29 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:33:51.069 05:18:29 -- pm/common@17 -- $ local monitor 00:33:51.069 05:18:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.069 05:18:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2565577 00:33:51.069 05:18:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.069 05:18:29 -- pm/common@21 -- $ date +%s 00:33:51.069 05:18:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2565579 00:33:51.069 05:18:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.069 05:18:29 -- pm/common@21 -- $ date +%s 00:33:51.069 05:18:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2565582 00:33:51.069 05:18:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.069 05:18:29 -- pm/common@21 -- $ date +%s 00:33:51.069 05:18:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2565585 00:33:51.069 05:18:29 -- pm/common@26 -- $ sleep 1 00:33:51.069 05:18:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713842309 00:33:51.069 05:18:29 -- pm/common@21 -- $ date +%s 00:33:51.069 05:18:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713842309 00:33:51.069 05:18:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713842309 00:33:51.069 05:18:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713842309 00:33:51.069 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713842309_collect-vmstat.pm.log 00:33:51.069 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713842309_collect-bmc-pm.bmc.pm.log 00:33:51.069 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713842309_collect-cpu-load.pm.log 00:33:51.069 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713842309_collect-cpu-temp.pm.log 00:33:51.639 05:18:30 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:33:51.639 05:18:30 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:33:51.639 05:18:30 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:51.639 05:18:30 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:51.639 05:18:30 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:51.639 05:18:30 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:51.639 05:18:30 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:51.639 05:18:30 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:51.639 05:18:30 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:51.639 05:18:30 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:51.639 05:18:30 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:51.639 05:18:30 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:33:51.639 05:18:30 -- pm/common@30 -- $ signal_monitor_resources TERM 00:33:51.639 05:18:30 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:33:51.639 05:18:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.639 05:18:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:33:51.639 05:18:30 -- pm/common@45 -- $ pid=2565602 00:33:51.639 05:18:30 -- pm/common@52 -- $ sudo kill -TERM 2565602 00:33:51.639 05:18:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.639 05:18:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:33:51.639 05:18:30 -- pm/common@45 -- $ pid=2565603 00:33:51.639 05:18:30 -- pm/common@52 -- $ sudo kill -TERM 2565603 00:33:51.639 05:18:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.639 05:18:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:33:51.639 05:18:30 -- pm/common@45 -- $ pid=2565600 00:33:51.639 05:18:30 -- pm/common@52 -- $ sudo kill -TERM 2565600 00:33:51.639 05:18:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:33:51.639 05:18:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:33:51.639 05:18:30 -- pm/common@45 -- $ pid=2565601 00:33:51.639 05:18:30 -- pm/common@52 -- $ sudo kill -TERM 2565601 00:33:51.639 + [[ -n 2161880 ]] 00:33:51.639 + sudo kill 2161880 00:33:51.649 [Pipeline] } 00:33:51.669 [Pipeline] // stage 00:33:51.675 [Pipeline] } 00:33:51.692 [Pipeline] // timeout 00:33:51.697 [Pipeline] } 00:33:51.714 [Pipeline] // catchError 00:33:51.719 [Pipeline] } 00:33:51.737 [Pipeline] // wrap 00:33:51.743 [Pipeline] } 00:33:51.758 [Pipeline] // catchError 00:33:51.767 [Pipeline] stage 00:33:51.770 [Pipeline] { (Epilogue) 00:33:51.784 [Pipeline] catchError 00:33:51.786 [Pipeline] { 00:33:51.800 [Pipeline] echo 00:33:51.802 Cleanup processes 00:33:51.808 [Pipeline] sh 00:33:52.094 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:52.094 2565723 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/sdr.cache 00:33:52.094 2565867 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:52.108 [Pipeline] sh 00:33:52.394 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:52.394 ++ grep -v 'sudo pgrep' 00:33:52.394 ++ awk '{print $1}' 00:33:52.394 + sudo kill -9 2565723 00:33:52.406 [Pipeline] sh 00:33:52.690 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:00.831 [Pipeline] sh 00:34:01.117 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:01.117 Artifacts sizes are good 00:34:01.132 [Pipeline] archiveArtifacts 00:34:01.140 Archiving artifacts 00:34:01.380 [Pipeline] sh 00:34:01.660 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:01.676 [Pipeline] cleanWs 00:34:01.687 [WS-CLEANUP] Deleting project workspace... 00:34:01.687 [WS-CLEANUP] Deferred wipeout is used... 00:34:01.694 [WS-CLEANUP] done 00:34:01.696 [Pipeline] } 00:34:01.715 [Pipeline] // catchError 00:34:01.726 [Pipeline] sh 00:34:02.008 + logger -p user.info -t JENKINS-CI 00:34:02.018 [Pipeline] } 00:34:02.035 [Pipeline] // stage 00:34:02.040 [Pipeline] } 00:34:02.059 [Pipeline] // node 00:34:02.064 [Pipeline] End of Pipeline 00:34:02.437 Finished: SUCCESS